<br><font size=2 face="sans-serif">huh - processing using Make - clever.</font>
<br>
<br><font size=2 face="sans-serif">We are researching several different
approaches for this also but I imagine we will use Conductor, created by
(UofA). Another of our commercial systems uses Condor (open source - </font><a href=http://www.cs.wisc.edu/condor/><font size=2 face="sans-serif">http://www.cs.wisc.edu/condor/</font></a><font size=2 face="sans-serif">
) .</font>
<br>
<br><font size=2 face="sans-serif">Currently the UofA Conductor HiRISE
pipeline uses our ISIS image processing software which is not yet multi-threaded.
Thus this system should also work well for GDAL processing. They also have
another tool that monitors Conductor called Maestro. Don't jump into this
lightly as I imagine it will be tricky to setup (it also requires a database
- MySQL). </font>
<br><a href=http://pirlwww.lpl.arizona.edu/software/Conductor.shtml><font size=2 face="sans-serif">http://pirlwww.lpl.arizona.edu/software/Conductor.shtml</font></a><font size=2 face="sans-serif">
BTW, they are a completely *nix house (Solaris, Mac OS-X, FreeBSD and Linux).</font>
<br>
<br><font size=2 face="sans-serif">here is an abstract (by the author B.
Castalia)</font>
<br><a href=http://www.lsstmail.org/meet_coll/ongoing/Software/><font size=2 face="sans-serif">http://www.lsstmail.org/meet_coll/ongoing/Software/</font></a>
<br>
<br><font size=2 face="sans-serif">Regards,</font>
<br><font size=2 face="sans-serif">Trent</font>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td><font size=1 color=#5f5f5f face="sans-serif">From:</font>
<td><font size=1 face="sans-serif">Fabrice LALLAURET - PSV <fabrice.lallauret@external.thalesgroup.com></font>
<tr valign=top>
<td><font size=1 color=#5f5f5f face="sans-serif">To:</font>
<td><font size=1 face="sans-serif">gdal-dev@lists.osgeo.org</font>
<tr valign=top>
<td><font size=1 color=#5f5f5f face="sans-serif">Date:</font>
<td><font size=1 face="sans-serif">06/16/2009 08:32 AM</font>
<tr valign=top>
<td><font size=1 color=#5f5f5f face="sans-serif">Subject:</font>
<td><font size=1 face="sans-serif">Re: [gdal-dev] Distributed processing</font>
<tr valign=top>
<td><font size=1 color=#5f5f5f face="sans-serif">Sent by:</font>
<td><font size=1 face="sans-serif">gdal-dev-bounces@lists.osgeo.org</font></table>
<br>
<hr noshade>
<br>
<br>
<br><tt><font size=2>John Donovan a écrit :<br>
> Hi,<br>
> We currently have a stand-alone app that converts, mosaicks and scales<br>
> GDAL-supported images to a proprietary format. It works well, but
we<br>
> handle tens of thousands of source files at a time, which can slow
the<br>
> process down to a crawl.<br>
><br>
> So we're investigating parallelising this process over several machines,<br>
> and I was wondering if anyone has any experience of this that they'd
be<br>
> willing to share? It's still early days yet, so we're open to all<br>
> suggestions.<br>
><br>
> Regards,<br>
> John Donovan - Programmer, Virtalis Ltd.<br>
><br>
> ______________________________________________________________________<br>
> This email has been scanned for Virtalis Ltd by the MessageLabs Email
Security System. ______________________________________________________________________<br>
> _______________________________________________<br>
> gdal-dev mailing list<br>
> gdal-dev@lists.osgeo.org<br>
> </font></tt><a href="http://lists.osgeo.org/mailman/listinfo/gdal-dev"><tt><font size=2>http://lists.osgeo.org/mailman/listinfo/gdal-dev</font></tt></a><tt><font size=2><br>
Personally, I create Makefile and use distmake for the distribution purpose.<br>
<br>
Regards<br>
_______________________________________________<br>
gdal-dev mailing list<br>
gdal-dev@lists.osgeo.org<br>
</font></tt><a href="http://lists.osgeo.org/mailman/listinfo/gdal-dev"><tt><font size=2>http://lists.osgeo.org/mailman/listinfo/gdal-dev</font></tt></a><tt><font size=2><br>
</font></tt>
<br>
<br>