[Qgis-user] Generating GeoTIFF overview ("gdaladdo -r gauss ...") takes days for 2GB file...

[Ziegler Stefan]

Looking at the gdalinfo output: perhaps it is faster when you set other blocksizes with gdal_translate first "-co BLOCKXSIZE=512 -co BLOCKYSIZE=512 -co TILED=YES"

These creation options are also available for overviews themselfes, with different syntax though.

Regards
Stefan

Von meinem iPhone gesendet

> Am 18.10.2014 um 00:19 schrieb Stefan Keller <sfkeller at gmail.com>:
> 
> Jonathan
> 
> Thanks for asking. See below the output of gdalinfo.
> 
> Yours, S.
> 
> 
>> gdalinfo zh.tif
> Driver: GTiff/GeoTIFF
> Files: zh.tif
> Size is 152498, 190232
> Coordinate System is:
> PROJCS["CH1903 / LV03",
>    GEOGCS["CH1903",
>        DATUM["CH1903",
>            SPHEROID["Bessel 1841",6377397.155,299.1528128000009,
>                AUTHORITY["EPSG","7004"]],
>            TOWGS84[674.4,15.1,405.3,0,0,0,0],
>            AUTHORITY["EPSG","6149"]],
>        PRIMEM["Greenwich",0],
>        UNIT["degree",0.0174532925199433],
>        AUTHORITY["EPSG","4149"]],
>    PROJECTION["Hotine_Oblique_Mercator"],
>    PARAMETER["latitude_of_center",46.95240555555556],
>    PARAMETER["longitude_of_center",7.439583333333333],
>    PARAMETER["azimuth",90],
>    PARAMETER["rectified_grid_angle",90],
>    PARAMETER["scale_factor",1],
>    PARAMETER["false_easting",600000],
>    PARAMETER["false_northing",200000],
>    UNIT["metre",1,
>        AUTHORITY["EPSG","9001"]],
>    AUTHORITY["EPSG","21781"]]
> Origin = (669243.920000001790000,283343.191250000090000)
> Pixel Size = (0.312500368857287,-0.312499428329607)
> Metadata:
>  AREA_OR_POINT=Area
> Image Structure Metadata:
>  COMPRESSION=LZW
>  INTERLEAVE=BAND
> Corner Coordinates:
> Upper Left  (  669243.920,  283343.191) (  8d21'43.79"E, 47d41'54.41"N)
> Lower Left  (  669243.920,  223895.800) (  8d21'10.57"E, 47d 9'49.48"N)
> Upper Right (  716899.601,  283343.191) (  8d59'49.11"E, 47d41'30.00"N)
> Lower Right (  716899.601,  223895.800) (  8d58'53.05"E, 47d 9'25.32"N)
> Center      (  693071.761,  253619.496) (  8d40'24.09"E, 47d25'41.40"N)
> Band 1 Block=152498x1 Type=Byte, ColorInterp=Gray
>  Min=1.000 Max=255.000
>  Minimum=1.000, Maximum=255.000, Mean=231.759, StdDev=73.234
>  NoData Value=0
>  Overviews: 76249x95116, 38125x47558, 19063x23779, 9532x11890, 4766x5945, 2383x
> 2973, 1192x1487
>  Metadata:
>    STATISTICS_MAXIMUM=255
>    STATISTICS_MEAN=231.75856617323
>    STATISTICS_MINIMUM=1
>    STATISTICS_STDDEV=73.233598475527
> 
> 
> 
> 2014-10-13 15:05 GMT+02:00 Jonathan Moules <J.Moules at hrwallingford.com>:
>> Hi Stefan,
>> How large is the image? As in, pixel width & height.
>> 
>> Also the GDALinfo would be helpful.
>> 
>> 7 days is a very long time. I've seen times like that myself for images that were 100,000*50,000 or similar dimensions where there was (still is?) an issue with the pyramiding function in GDAL (it was re-reading the data again and again).
>> 
>> Cheers,
>> Jonathan
>> 
>> -----Original Message-----
>> From: qgis-user-bounces at lists.osgeo.org [mailto:qgis-user-bounces at lists.osgeo.org] On Behalf Of Stefan Keller
>> Sent: Sunday, October 12, 2014 1:34 PM
>> To: gdal-dev at lists.osgeo.org; qgis-user
>> Subject: [Qgis-user] Generating GeoTIFF overview ("gdaladdo -r gauss ...") takes days for 2GB file...
>> 
>> Hi,
>> 
>> I have a GeoTIFF file of 2GB size. Now, this question is about gdaladdo and how to optimize loading time of such a large raster file.
>> 
>> According to my observations QGIS has fastest loading times when it's a single GeoTIFF file with overview images.
>> 
>> Q.1: Does anybody have tipps for even faster solutions loading raster files into in QGIS (prepared by OGR or other preprocessors)?
>> 
>> The command "gdaladdo -r gauss C:\SG.tif  2 4 8 16 32 64 128 256"
>> takes actually about 7 days on a Lenovo notebook.
>> 
>> Q2.: Any hint's on how to accelerate this (or to other tools generating overviews/pyramids)?
>> 
>> Yours, S.
>> _______________________________________________
>> Qgis-user mailing list
>> Qgis-user at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/qgis-user
>> 
>> 
>> This message has been scanned for viruses by MailControl - www.mailcontrol.com
>> 
>> 
>> 
>> Click https://www.mailcontrol.com/sr/pdM3aunlCjzGX2PQPOmvUgEBY15Clgt1cLVtYJoNw+TFapmLjYzc0LQlVsaeWay487vQIAp6KUWSPFO0UaI8cQ== to report this email as spam.
>> 
>> ________________________________
>> 
>> HR Wallingford and its subsidiaries uses faxes and emails for confidential and legally privileged business communications. They do not of themselves create legal commitments. Disclosure to parties other than addressees requires our specific consent. We are not liable for unauthorised disclosures nor reliance upon them.
>> If you have received this message in error please advise us immediately and destroy all copies of it.
>> 
>> HR Wallingford Limited
>> Howbery Park, Wallingford, Oxfordshire, OX10 8BA, United Kingdom
>> Registered in England No. 02562099
>> 
>> ________________________________
> _______________________________________________
> Qgis-user mailing list
> Qgis-user at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/qgis-user