[gdal-dev] tileindex performance
christian.mueller at nvoe.at
christian.mueller at nvoe.at
Thu Oct 14 23:47:55 EDT 2010
Hi guys, I am the developer of the gdal_retile. Using gdal_retile on
very large images only makes sense if you plan to import your tiles
into a jdbc database. Serving images from so many files is not
recommended.
I tested on an AIX Box, tiling an 80 GB Erdas image. The performance
decrease was due to the increasing number of files in the file system.
I had about 1 million of individual files. Deleting or moving this
file set was a reason for drinking a cup of coffee. (15 - 30 minutes).
And we are talking here from an AIX Box having a JFS file system and
fast server disks.
Please check this symptom in your environment, look for the number of
files you have created and the performance.
I am interested if this symptom occurs on your platforms too.
Cheers
Christian
Quoting Elijah Robison <elijah at villagis.com>:
> Hi Nikos,
>
> I also have difficulty tiling large, high res images with gdal_retile.
> I would say our average process--a county-wide, 1-foot resolution
> ECW--takes about a month to run to completion.
>
> At first, tiles are generated with blazing speed. But by the time the
> routine has been running for about 24-hours, it slows to a crawl. Is
> this the symptoms you are experiencing or are you running into
> something else?
>
> I would very much love to get to the bottom of this and find a way to
> maintain the original performance throughout a tiling routine.
>
> Best, Elijah Robison
>
>
> nickos85 wrote:
>> Hi,
>>
>> I have a mapserver and a high resolution image about 4GB when i make the
>> image tiles with a size of 512x512 using gdal_retile I have better result
>> instead of a tile size of 256x256. I think the problem is on how the search
>> algorithm for the location of the tile can be improoved. Any suggestions?
>>
>> --Nikos Hatzopoulos
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/gdal-dev
----------------------------------------------------------------
This message was sent using IMP, the Internet Messaging Program.
More information about the gdal-dev
mailing list