[gdal-dev] Distributed processing

Seth Price seth at pricepages.org
Sat Jun 13 12:28:47 EDT 2009


I would personally use Condor to distribute the processes, but the  
learning curve may be steep depending on where you're coming from.
~Seth

On Jun 12, 2009, at 5:05 AM, John Donovan wrote:

> Hi,
> We currently have a stand-alone app that converts, mosaicks and scales
> GDAL-supported images to a proprietary format. It works well, but we
> handle tens of thousands of source files at a time, which can slow the
> process down to a crawl.
>
> So we're investigating parallelising this process over several  
> machines,
> and I was wondering if anyone has any experience of this that they'd  
> be
> willing to share? It's still early days yet, so we're open to all
> suggestions.
>
> Regards,
> John Donovan - Programmer, Virtalis Ltd.
>
> ______________________________________________________________________
> This email has been scanned for Virtalis Ltd by the MessageLabs  
> Email Security System.  
> ______________________________________________________________________
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/gdal-dev



More information about the gdal-dev mailing list