[gdal-dev] Re: Switching from ArcGIS to GDAL

Tue Feb 28 13:33:14 EST 2012

Hey Michael,

Good tips on the GDAL/MapServer combo.  I may have a look into such a setup
for comparison purposes.

At the current moment though, I am in need of a solution that uses ArcGIS
Server as the cache that I create will eventually be incorporated back into
existing tiled services hosted on ArcGIS Server.  I was hoping that there
was a solution that would allow me to incorporate GDAL overviews into an
ArcGIS mosaic dataset, though at the moment I am not sure how to do such a
thing.

I'll keep looking at let you know if I find anything.

Thanks for your suggestion concerning MapServer though ... Seems like a lot
of folks are headed towards alternatives to ArcGIS Server these days.

Cheers,
Jon.

On Mon, Feb 27, 2012 at 8:56 AM, Smith, Michael-2 [via OSGeo.org] <
ml-node+s1560n4514858h2 at n6.nabble.com> wrote:

> Hi Jon - alas for we ArcGIS users, which even here in 2012 is still a
> single-threaded application.  Who needs more than one CPU core anyway?
> So your ArcGIS choice is to split your batch up into 12 groups and run
> the processes simultaneously (which will then take all your CPUs), or
> use something else.
>
> Might I suggest a pretty simple solution which uses GDAL and MapServer
> instead?  In the state of Maine we now serve all of our enterprise web
> mapping services (WMS) for imagery using GDAL and MapServer.  Using
> gdalwarp and gdal_translate we convert whatever the source imagery is
> into JPEG2000 compressed tiles, and generate overview images using
> gdalwarp.  This system takes our 3.5TB of source imagery down to about
> 700GB of JP2 files and is pretty darn fast.
>
> You could set something like this up on a simple PC (but don't use a USB
> drive for the data - put it on a fast internal drive) for a small group
> of users inside your organization, or on servers for a wide distribution
> to a large # of folks.
>
> Our system is designed to support about 2000 end-users and about 10,000
> requests per hour, using a dual-CPU (quad-core) HP server.  We use MS4W
> which is super-easy to install, and then scripts to generate the tiles.
> I'd be happy to share some of these with you as examples.
>
>
> ======================================
> Michael Smith
> State GIS Manager, Maine Office of GIS
> State of Maine, Office of Information Technology
> michael.smith _at_ maine.gov
> 207-215-5530
>
> Board Member, Maine GeoLibrary
> Board Member, Maine GIS Users Group
> State Rep, National States Geographic Information Council
>
> | MEGIS | GeoLibrary | MEGUG | NSGIC |
>
> State House Station 174
> 264 Civic Center Drive
> Augusta, ME 04333-0174
>
> 69 o 47' 49.5"W   44 o 20' 54.5"N
>
> Confidentiality Notice: This email message, including any attachments,
> is for the sole use of the intended recipients and may contain
> confidential and privileged information. If you are not the intended
> recipient, or an authorized agent of the intended recipient, please
> immediately contact the sender by reply email and destroy/delete all
> copies of the original message. Any unauthorized review, use, copying,
> forwarding, disclosure, or distribution by other than the intended
> recipient or authorized agent is prohibited.
>
> -----Original Message-----
> From: [hidden email]<http://user/SendEmail.jtp?type=node&node=4514858&i=0>
> [mailto:[hidden email]<http://user/SendEmail.jtp?type=node&node=4514858&i=1>]
> On Behalf Of jgamble
> Sent: Saturday, February 25, 2012 1:21 PM
> To: [hidden email] <http://user/SendEmail.jtp?type=node&node=4514858&i=2>
> Subject: [gdal-dev] Switching from ArcGIS to GDAL
>
> Hi All,
>
> I've recently been tasked to cache several large imagery datasets using
> ArcGIS and have found that my bottleneck has been generating overviews
> for
> the datasets prior to caching.  ArcGIS appears to be limiting itself to
> a
> single core while building overviews, which seems ridiculous on a 12
> core
> machine ... which is why I am here for some help.
>
> I am using mosaic datasets in ArcGIS to manage my images.  Footprints
> for
> the images have been created to clip out any bounding black pixels.  Am
> I
> able to define overviews in ArcGIS and then use GDAL to build them with
> multiple cores ... Or at least utilize the footprints I've already
> defined
> in my mosaic dataset?  Does GDAL have something similar to a mosaic
> dataset
> to manage images that I should be using?
>
> I'm extremely new to the thought of using GDAL, so any advice on how to
> go
> about utilizing it or at least pointing me in the right direction to
> some
> tutorials is much appreciated.
>
> Thanks
> Jon.
>
> --
> View this message in context:
> http://osgeo-org.1560.n6.nabble.com/Switching-from-ArcGIS-to-GDAL-tp4507
> 244p4507244.html
> Sent from the GDAL - Dev mailing list archive at Nabble.com.
> _______________________________________________
> gdal-dev mailing list
> [hidden email] <http://user/SendEmail.jtp?type=node&node=4514858&i=3>
> http://lists.osgeo.org/mailman/listinfo/gdal-dev
> _______________________________________________
> gdal-dev mailing list
> [hidden email] <http://user/SendEmail.jtp?type=node&node=4514858&i=4>
> http://lists.osgeo.org/mailman/listinfo/gdal-dev
>
>
> ------------------------------
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://osgeo-org.1560.n6.nabble.com/Switching-from-ArcGIS-to-GDAL-tp4507244p4514858.html
>  To unsubscribe from Switching from ArcGIS to GDAL, click here<http://osgeo-org.1560.n6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=4507244&code=amdhbWJsZTNAZ21haWwuY29tfDQ1MDcyNDR8NDU0MTk0NDEw>
> .
> NAML<http://osgeo-org.1560.n6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>

--
View this message in context: http://osgeo-org.1560.n6.nabble.com/Switching-from-ArcGIS-to-GDAL-tp4507244p4523268.html
Sent from the GDAL - Dev mailing list archive at Nabble.com.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.osgeo.org/pipermail/gdal-dev/attachments/20120228/a1ffd298/attachment.html