<br><tt><font size=3>>>Jordan,<br>
>>I've dealt with ERDAS Imagine files larger than 10 GB on a regular
basis. I have occasionally tried to >>reproject and merge all
of the 1 m NAIP imagery tiles for North Carolina into 1 BigTIFF >
500GB with gdal. >> Any parallelizaion work for open source
geospatial tools would be welcome :-).</font></tt>
<p><font size=3>>So you "tried" to do that? Does that mean
you failed or is the system still processing it? :-P I kid, but that is
a very large file... it's bigger than my current desktop's hard drive.
</font>
<p><font size=3>Jordan,</font>
<p><font size=3>It would be a shame to leave those multicore 64 bit
processors with multi-terabyte hard drives with nothing to challange them.
Just think of me as part of the hardware entertainment committee.
:-) </font>
<p><font size=3>The process ran overnight and finished, I just have not
gotten to phase 2 of that particular project, chopping the resulting image
into overlapping DOQQ - size images. I was going to go back and change
the projection method slightly, hopefully to make it more accurate. If
you're looking for big images to play with, go to </font><a href=http://datagateway.nrcs.usda.gov/><font size=3>http://datagateway.nrcs.usda.gov/
and select a naip county mosaic of imagery. The mosaic comes
as a MrSid format file, but once you uncompress it ( I suggest using gdal's
nearblack utility ) to ERDAS Imagine format, the resulting image will probably
be in the multi-gigbyte range per county.</font></a>
<p>
<p><font size=3>Doug</font>
<p><font size=3> </font>
<p>
<br><font size=2 face="sans-serif">Doug Newcomb
<br>
USFWS<br>
Raleigh, NC<br>
919-856-4520 ext. 14 doug_newcomb@fws.gov<br>
---------------------------------------------------------------------------------------------------------<br>
The opinions I express are my own and are not representative of the official
policy of the U.S.Fish and Wildlife Service or Dept. of the Interior.
Life is too short for undocumented, proprietary data formats.</font>
<br>
<br>
<br>
<table width=100%>
<tr valign=top>
<td width=40%><font size=1 face="sans-serif"><b>Jordan Neumeyer <jordan.neumeyer@mines.sdsmt.edu></b>
</font>
<br><font size=1 face="sans-serif">Sent by: grass-dev-bounces@lists.osgeo.org</font>
<p><font size=1 face="sans-serif">04/08/2010 01:09 AM</font>
<td width=59%>
<table width=100%>
<tr valign=top>
<td>
<div align=right><font size=1 face="sans-serif">To</font></div>
<td><font size=1 face="sans-serif">Doug_Newcomb@fws.gov</font>
<tr valign=top>
<td>
<div align=right><font size=1 face="sans-serif">cc</font></div>
<td><font size=1 face="sans-serif">GRASS developers list <grass-dev@lists.osgeo.org></font>
<tr valign=top>
<td>
<div align=right><font size=1 face="sans-serif">Subject</font></div>
<td><font size=1 face="sans-serif">Re: [GRASS-dev] [SoC] Parallelization
of Raster and Vector modules</font></table>
<br>
<table>
<tr valign=top>
<td>
<td></table>
<br></table>
<br>
<br>
<br><font size=3>Thanks guys for putting that into perspective.<br>
</font>
<br><font size=3>On Mon, Apr 5, 2010 at 6:38 PM, <</font><a href=mailto:Doug_Newcomb@fws.gov><font size=3 color=blue><u>Doug_Newcomb@fws.gov</u></font></a><font size=3>>
wrote:</font>
<br><tt><font size=3><br>
Doug</font></tt><font size=3><br>
</font><tt><font size=3><br>
Doug Newcomb<br>
USFWS<br>
Raleigh, NC<br>
919-856-4520 ext. 14 </font></tt><a href=mailto:doug_newcomb@fws.gov target=_blank><tt><font size=3 color=blue><u>doug_newcomb@fws.gov</u></font></tt></a><tt><font size=3><br>
---------------------------------------------------------------------------------------------------------<br>
The opinions I express are my own and are not representative of the official
policy of the U.S.Fish and Wildlife Service or Dept. of the Interior. Life
is too short for undocumented, proprietary data formats.</font></tt><font size=3><br>
</font><tt><font size=3><br>
-----</font></tt><a href="mailto:grass-dev-bounces@lists.osgeo.org" target=_blank><tt><font size=3 color=blue><u>grass-dev-bounces@lists.osgeo.org</u></font></tt></a><tt><font size=3>
wrote: -----</font></tt><font size=3><br>
</font><tt><font size=3><br>
To: Jordan Neumeyer <</font></tt><a href=mailto:jordan.neumeyer@mines.sdsmt.edu target=_blank><tt><font size=3 color=blue><u>jordan.neumeyer@mines.sdsmt.edu</u></font></tt></a><tt><font size=3>><br>
From: Markus Neteler <</font></tt><a href=mailto:neteler@osgeo.org target=_blank><tt><font size=3 color=blue><u>neteler@osgeo.org</u></font></tt></a><tt><font size=3>><br>
Sent by: </font></tt><a href="mailto:grass-dev-bounces@lists.osgeo.org" target=_blank><tt><font size=3 color=blue><u>grass-dev-bounces@lists.osgeo.org</u></font></tt></a><tt><font size=3><br>
Date: 04/05/2010 04:06AM<br>
cc: GRASS developers list <</font></tt><a href="mailto:grass-dev@lists.osgeo.org" target=_blank><tt><font size=3 color=blue><u>grass-dev@lists.osgeo.org</u></font></tt></a><tt><font size=3>><br>
Subject: Re: [GRASS-dev] [SoC] Parallelization of Raster and Vector modules</font></tt>
<p><tt><font size=3><br>
On Sun, Apr 4, 2010 at 3:22 AM, Jordan Neumeyer<br>
<</font></tt><a href=mailto:jordan.neumeyer@mines.sdsmt.edu target=_blank><tt><font size=3 color=blue><u>jordan.neumeyer@mines.sdsmt.edu</u></font></tt></a><tt><font size=3>>
wrote:<br>
> I didn't realize how big the data set could be. What's<br>
> biggest map you've seen?</font></tt><font size=3><br>
</font><tt><font size=3><br>
Our provincial DEM is a 3.5GB Geotiff which is of 48800x58000 size.<br>
Another file which I recently had to import was a 4GB Geotiff with<br>
21550 bands. Finally, in remote sensing, you can quickly generate<br>
quickly files in the multi-GB range.</font></tt><font size=3><br>
</font><tt><font size=3><br>
Markus</font></tt>
<br><tt><font size=3>_______________________________________________<br>
grass-dev mailing list</font></tt><tt><font size=3 color=blue><u><br>
</u></font></tt><a href="mailto:grass-dev@lists.osgeo.org" target=_blank><tt><font size=3 color=blue><u>grass-dev@lists.osgeo.org</u></font></tt></a><tt><font size=3 color=blue><u><br>
</u></font></tt><a href="http://lists.osgeo.org/mailman/listinfo/grass-dev" target=_blank><tt><font size=3 color=blue><u>http://lists.osgeo.org/mailman/listinfo/grass-dev</u></font></tt></a>
<br><font size=3><br>
~Jordan </font>
<br><tt><font size=2>_______________________________________________<br>
grass-dev mailing list<br>
grass-dev@lists.osgeo.org<br>
</font></tt><a href="http://lists.osgeo.org/mailman/listinfo/grass-dev"><tt><font size=2>http://lists.osgeo.org/mailman/listinfo/grass-dev</font></tt></a>
<br>