Hey Michael,<br><br>Good tips on the GDAL/MapServer combo. I may have a look into such a setup for comparison purposes.<br><br>At the current moment though, I am in need of a solution that uses ArcGIS Server as the cache that I create will eventually be incorporated back into existing tiled services hosted on ArcGIS Server. I was hoping that there was a solution that would allow me to incorporate GDAL overviews into an ArcGIS mosaic dataset, though at the moment I am not sure how to do such a thing. <br>
<br>I'll keep looking at let you know if I find anything.<br><br>Thanks for your suggestion concerning MapServer though ... Seems like a lot of folks are headed towards alternatives to ArcGIS Server these days.<br><br>
Cheers,<br>Jon.<br><br><div class="gmail_quote">On Mon, Feb 27, 2012 at 8:56 AM, Smith, Michael-2 [via OSGeo.org] <span dir="ltr"><<a href="/user/SendEmail.jtp?type=node&node=4523268&i=0" target="_top" rel="nofollow" link="external">[hidden email]</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">
Hi Jon - alas for we ArcGIS users, which even here in 2012 is still a
<br>single-threaded application. Who needs more than one CPU core anyway?
<br>So your ArcGIS choice is to split your batch up into 12 groups and run
<br>the processes simultaneously (which will then take all your CPUs), or
<br>use something else.
<br><br>Might I suggest a pretty simple solution which uses GDAL and MapServer
<br>instead? In the state of Maine we now serve all of our enterprise web
<br>mapping services (WMS) for imagery using GDAL and MapServer. Using
<br>gdalwarp and gdal_translate we convert whatever the source imagery is
<br>into JPEG2000 compressed tiles, and generate overview images using
<br>gdalwarp. This system takes our 3.5TB of source imagery down to about
<br>700GB of JP2 files and is pretty darn fast.
<br><br>You could set something like this up on a simple PC (but don't use a USB
<br>drive for the data - put it on a fast internal drive) for a small group
<br>of users inside your organization, or on servers for a wide distribution
<br>to a large # of folks.
<br><br>Our system is designed to support about 2000 end-users and about 10,000
<br>requests per hour, using a dual-CPU (quad-core) HP server. We use MS4W
<br>which is super-easy to install, and then scripts to generate the tiles.
<br>I'd be happy to share some of these with you as examples.
<br><br><br>======================================
<br>Michael Smith
<br>State GIS Manager, Maine Office of GIS
<br>State of Maine, Office of Information Technology
<br>michael.smith _at_ <a href="http://maine.gov" target="_blank" rel="nofollow" link="external">maine.gov</a>
<br><a href="tel:207-215-5530" value="+12072155530" target="_blank">207-215-5530</a>
<br><br>Board Member, Maine GeoLibrary
<br>Board Member, Maine GIS Users Group
<br>State Rep, National States Geographic Information Council
<br><br>| MEGIS | GeoLibrary | MEGUG | NSGIC |
<br><br>State House Station 174
<br>264 Civic Center Drive
<br>Augusta, ME 04333-0174
<br><br>69 o 47' 49.5"W 44 o 20' 54.5"N
<br><br>Confidentiality Notice: This email message, including any attachments,
<br>is for the sole use of the intended recipients and may contain
<br>confidential and privileged information. If you are not the intended
<br>recipient, or an authorized agent of the intended recipient, please
<br>immediately contact the sender by reply email and destroy/delete all
<br>copies of the original message. Any unauthorized review, use, copying,
<br>forwarding, disclosure, or distribution by other than the intended
<br>recipient or authorized agent is prohibited.
<br><br>-----Original Message-----
<br></div></div><div class="im">From: <a href="http://user/SendEmail.jtp?type=node&node=4514858&i=0" rel="nofollow" link="external" target="_blank">[hidden email]</a>
<br>[mailto:<a href="http://user/SendEmail.jtp?type=node&node=4514858&i=1" rel="nofollow" link="external" target="_blank">[hidden email]</a>] On Behalf Of jgamble
<br>Sent: Saturday, February 25, 2012 1:21 PM
<br></div><div class="im">To: <a href="http://user/SendEmail.jtp?type=node&node=4514858&i=2" rel="nofollow" link="external" target="_blank">[hidden email]</a>
<br>Subject: [gdal-dev] Switching from ArcGIS to GDAL
<br><br></div><div><div class="h5">Hi All,
<br><br>I've recently been tasked to cache several large imagery datasets using
<br>ArcGIS and have found that my bottleneck has been generating overviews
<br>for
<br>the datasets prior to caching. ArcGIS appears to be limiting itself to
<br>a
<br>single core while building overviews, which seems ridiculous on a 12
<br>core
<br>machine ... which is why I am here for some help.
<br><br>I am using mosaic datasets in ArcGIS to manage my images. Footprints
<br>for
<br>the images have been created to clip out any bounding black pixels. Am
<br>I
<br>able to define overviews in ArcGIS and then use GDAL to build them with
<br>multiple cores ... Or at least utilize the footprints I've already
<br>defined
<br>in my mosaic dataset? Does GDAL have something similar to a mosaic
<br>dataset
<br>to manage images that I should be using?
<br><br>I'm extremely new to the thought of using GDAL, so any advice on how to
<br>go
<br>about utilizing it or at least pointing me in the right direction to
<br>some
<br>tutorials is much appreciated.
<br><br>Thanks
<br>Jon.
<br><br>--
<br>View this message in context:
<br><a href="http://osgeo-org.1560.n6.nabble.com/Switching-from-ArcGIS-to-GDAL-tp4507" rel="nofollow" link="external" target="_blank">http://osgeo-org.1560.n6.nabble.com/Switching-from-ArcGIS-to-GDAL-tp4507</a><br>244p4507244.html
<br>Sent from the GDAL - Dev mailing list archive at Nabble.com.
<br>_______________________________________________
<br>gdal-dev mailing list
<br></div></div><a href="http://user/SendEmail.jtp?type=node&node=4514858&i=3" rel="nofollow" link="external" target="_blank">[hidden email]</a>
<br><div class="im"><a href="http://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="nofollow" link="external" target="_blank">http://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>_______________________________________________
<br>gdal-dev mailing list
<br></div><div class="im"><a href="http://user/SendEmail.jtp?type=node&node=4514858&i=4" rel="nofollow" link="external" target="_blank">[hidden email]</a>
<br><a href="http://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="nofollow" link="external" target="_blank">http://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
<br>
<br>
<hr color="#cccccc" noshade size="1">
</div><div style="color:#444;font:12px tahoma,geneva,helvetica,arial,sans-serif"><div class="im">
<div style="font-weight:bold">If you reply to this email, your message will be added to the discussion below:</div>
</div><a href="http://osgeo-org.1560.n6.nabble.com/Switching-from-ArcGIS-to-GDAL-tp4507244p4514858.html" target="_blank" rel="nofollow" link="external">http://osgeo-org.1560.n6.nabble.com/Switching-from-ArcGIS-to-GDAL-tp4507244p4514858.html</a>
</div><div class="HOEnZb"><div class="h5">
<div style="color:#666;font:11px tahoma,geneva,helvetica,arial,sans-serif;margin-top:.4em;line-height:1.5em">
To unsubscribe from Switching from ArcGIS to GDAL, <a href="" target="_blank" rel="nofollow" link="external">click here</a>.<br>
<a href="http://osgeo-org.1560.n6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml" rel="nofollow" style="font:9px serif" target="_blank" link="external">NAML</a>
</div></div></div></blockquote></div><br>
<br/><hr align="left" width="300" />
View this message in context: <a href="http://osgeo-org.1560.n6.nabble.com/Switching-from-ArcGIS-to-GDAL-tp4507244p4523268.html">Re: Switching from ArcGIS to GDAL</a><br/>
Sent from the <a href="http://osgeo-org.1560.n6.nabble.com/GDAL-Dev-f3742093.html">GDAL - Dev mailing list archive</a> at Nabble.com.<br/>