<html><body>
<p><tt>>> Shaun Kolomeitz wrote:<br>
<br>
>> > could push beyond 1GB/s. Currently to process (mosaic) an 80GB image it<br>
>> > takes several days to complete. This is also on 32bit hardware, and I<br>
>> <br>
>> Shaun,<br>
> <br>
>> I suspect that there is a gross issue with how the warping is being done,<br>
>> and that it could be sped up substantially. On my two year old consumer<br>
>> grade desktop I'm able to warp/reproject around 30GB/hour with gdalwarp.<br>
<br>
>My numbers for warping single images or small mosaics with cubic spline option<br>
>show about 12 GB/hour. However, I have tried sometimes to warp tens of gigabytes<br>
>of imagery through .vrt file to a BigTIFF and that process progressed very very<br>
>slow. I need to admit that I used ER Mapper and ERDAS Imagine and never bothered<br>
>to investigate further what was going wrong when building mosaic with gdal. I<br>
>have lot of imagery easily available and I volunteer for testing is somebody has<br>
>suggestions for better gdalwarp parameters or has new program versions to try. <br>
<br>
>-Jukka Rahkonen-</tt><br>
<br>
Hi Folks,<br>
<br>
<tt>Here's the gdal command (gdal 1.6.2) I used to merge ~3500 1 meter NAIP quarter quads (uncompressed geotiff TIFF) in 3 UTM projections into one Bigtiff Image in the USGS Albers projection. It took about 15 hours ( on a 3 year old Intel Core2 Duo 64 bit Centos 5.3 Linux box with 6GB RAM) and created an uncompressed, tiled, bigtiff file of 485 GB. About 32 GB/hr. <br>
</tt><br>
<tt>gdalwarp -t_srs "+proj=aea +lat_1=29.5 +lat_2=45.5 +lat_0=23.0 +lon_0=-96 +x_0=0 +y_0=0 +ellps=GRS80 +datum=NAD83 +units=m no_defs <>" -wo "SKIP_NOSOURCE" --config "GDAL_CACHEMAX=500" -wm=5000 -co "TILED=YES" */*.tif /biggis/albers/nc_naip2008.tif<br>
</tt><br>
<tt>In the above command, -t_srs "+proj=aea +lat_1=29.5 +lat_2=45.5 +lat_0=23.0 +lon_0=-96 +x_0=0 +y_0=0 +ellps=GRS80 +datum=NAD83 +units=m no_defs <>" indicates the target projection, -wo "SKIP_NOSOURCE" don't write in areas for which there is no data for the current file, --config "GDAL_CACHEMAX=500" set the cache memory at 500MB ( set this close to the maximum input file size), -wm=5000 set the warp memory to 5000MB , -co "TILED=YES" create a tiled tiff as output, */*.tif, use all of the tiffs in all of the subdirectories as input files ( in this case there was one directory for each of the 3 utm zones) , /biggis/albers/nc_naip2008.tif, the output file name and location.</tt><br>
<br>
<br>
Hmm, I may have to do this again, I didn't include the -rcs option.<br>
<br>
Doug<br>
<br>
<br>
Doug Newcomb <br>
USFWS<br>
Raleigh, NC<br>
919-856-4520 ext. 14 doug_newcomb@fws.gov<br>
---------------------------------------------------------------------------------------------------------<br>
The opinions I express are my own and are not representative of the official policy of the U.S.Fish and Wildlife Service or Dept. of the Interior. Life is too short for undocumented, proprietary data formats.<br>
<img width="16" height="16" src="cid:1__=0ABBFCE0DFD44F698f9e8a93df938690@fws.gov" border="0" alt="Inactive hide details for Jukka Rahkonen <jukka.rahkonen@mmmtike.fi>">Jukka Rahkonen <jukka.rahkonen@mmmtike.fi><br>
<br>
<br>
<table width="100%" border="0" cellspacing="0" cellpadding="0">
<tr valign="top"><td style="background-image:url(cid:2__=0ABBFCE0DFD44F698f9e8a93df938690@fws.gov); background-repeat: no-repeat; " width="40%">
<ul>
<ul>
<ul>
<ul><b><font size="2">Jukka Rahkonen <jukka.rahkonen@mmmtike.fi></font></b><font size="2"> </font><br>
<font size="2">Sent by: gdal-dev-bounces@lists.osgeo.org</font>
<p><font size="2">11/19/2009 03:08 AM</font></ul>
</ul>
</ul>
</ul>
</td><td width="60%">
<table width="100%" border="0" cellspacing="0" cellpadding="0">
<tr valign="top"><td width="1%"><img width="58" height="1" src="cid:3__=0ABBFCE0DFD44F698f9e8a93df938690@fws.gov" border="0" alt=""><br>
<div align="right"><font size="2">To</font></div></td><td width="100%"><img width="1" height="1" src="cid:3__=0ABBFCE0DFD44F698f9e8a93df938690@fws.gov" border="0" alt=""><br>
<font size="2">gdal-dev@lists.osgeo.org</font></td></tr>
<tr valign="top"><td width="1%"><img width="58" height="1" src="cid:3__=0ABBFCE0DFD44F698f9e8a93df938690@fws.gov" border="0" alt=""><br>
<div align="right"><font size="2">cc</font></div></td><td width="100%"><img width="1" height="1" src="cid:3__=0ABBFCE0DFD44F698f9e8a93df938690@fws.gov" border="0" alt=""><br>
</td></tr>
<tr valign="top"><td width="1%"><img width="58" height="1" src="cid:3__=0ABBFCE0DFD44F698f9e8a93df938690@fws.gov" border="0" alt=""><br>
<div align="right"><font size="2">Subject</font></div></td><td width="100%"><img width="1" height="1" src="cid:3__=0ABBFCE0DFD44F698f9e8a93df938690@fws.gov" border="0" alt=""><br>
<font size="2">[gdal-dev] Re: CUDA PyCUDA and GDAL</font></td></tr>
</table>
<table border="0" cellspacing="0" cellpadding="0">
<tr valign="top"><td width="58"><img width="1" height="1" src="cid:3__=0ABBFCE0DFD44F698f9e8a93df938690@fws.gov" border="0" alt=""></td><td width="336"><img width="1" height="1" src="cid:3__=0ABBFCE0DFD44F698f9e8a93df938690@fws.gov" border="0" alt=""></td></tr>
</table>
</td></tr>
</table>
<br>
<tt>Frank Warmerdam <warmerdam <at> pobox.com> writes:<br>
<br>
<br>
<br>
_______________________________________________<br>
gdal-dev mailing list<br>
gdal-dev@lists.osgeo.org<br>
</tt><tt><a href="http://lists.osgeo.org/mailman/listinfo/gdal-dev">http://lists.osgeo.org/mailman/listinfo/gdal-dev</a></tt><tt><br>
</tt><br>
</body></html>