[gdal-dev] Filesize too large when writing compressed float's to a Geotiff from Python

Even Rouault even.rouault at spatialys.com
Wed Jun 3 07:02:07 PDT 2015

Le mercredi 03 juin 2015 15:21:07, Rutger a écrit :
> Dear list,
> When i try to write a floating point Geotiff from Python (both 32 or 64
> bit), the resulting file size is significantly larger compared to the
> output of gdal_translate. I wrote a small test script which tests this it
> for various creation options like compression and block-sizes. It seems to
> be the case for any compression method (packbits, lzw, deflate), and other
> creation options don't seem to matter. Uncompressed data, or compressed
> integers work fine, the file size matches gdal_translate very well.
> Here is the notebook i used:
> http://nbviewer.ipython.org/gist/RutgerK/27c4af235035621fb609
> I would first all be interested to know if anyone can replicate this
> behavior? And if there is something i can do to prevent this? I would
> rather avoid having to run gdal_translate after each file written from
> Python.


the issue is that you write data band after band, whereas by default the GTiff 
driver create pixel-interleaved datasets. So some blocks in the GTiff might be 
reread and rewritten several times as the data coming from the various bands 

Several fixes/workarounds :
- if you've sufficient RAM to hold another copy of the uncompressed dataset, 
- or add options = [ 'INTERLEAVE=BAND' ] in the Create() call to create a band 
interleaved dataset
- more involved fix: since there's no dataset WriteArray() in GDAL Python for 
now, you would have to iterate block by block and for each block write the 
corresponding region of each band.
- you could also use Dataset.WriteRaster() if you can get a buffer from the 
numpy array


> I'm running it on Windows 7 64bit. My GDAL version comes from the default
> Conda repository which contains both bindings and utilities (at least for
> version 1.11.1).
> All i could find was this thread from 2010, it seems somewhat similar
> except that there its about Uint16, for which it works for me:
> http://osgeo-org.1560.x6.nabble.com/gdal-dev-RE-Compression-using-the-creat
> e-method-in-python-and-aggregation-methods-td3747703.html
> Regards,
> Rutger
> --
> View this message in context:
> http://osgeo-org.1560.x6.nabble.com/Filesize-too-large-when-writing-compre
> ssed-float-s-to-a-Geotiff-from-Python-tp5208916.html Sent from the GDAL -
> Dev mailing list archive at Nabble.com.
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/gdal-dev

Spatialys - Geospatial professional services

More information about the gdal-dev mailing list