[gdal-dev] Problems generating a COG file

[Javier Jimenez Shaw]

Hi

I am warping a file to EPSG:3857 and later generating a COG with JPEG
compression.
The input tif file has also JPEG compression. (I learned that I need the -
dstalpha to keep it transparent)
I am doing it in Ubuntu 22.04 using conda.

First I tried this, using LZW as output of the warp

GDAL_CACHEMAX=16GB GDAL_NUM_THREADS=ALL_CPUS gdalwarp -t_srs EPSG:3857 -ct
"+proj=pipeline +step +inv +proj=tmerc +lat_0=49 +lon_0=-2 +k=0.9996012717
+x_0=400000 +y_0=-100000 +ellps=airy +step +proj=push +v_3 +step +proj=cart
+ellps=airy +step +proj=helmert +x=446.448 +y=-125.157 +z=542.06 +rx=0.15
+ry=0.247 +rz=0.842 +s=-20.489 +convention=position_vector +step +inv
+proj=cart +ellps=WGS84 +step +proj=pop +v_3 +step +proj=webmerc +lat_0=0
+lon_0=0 +x_0=0 +y_0=0 +ellps=WGS84" -co COMPRESS=LZW -co BIGTIFF=YES -co
TILED=YES -dstalpha orthomosaic.tiff web_mercator.tif

Creating output file that is 677881P x 303664L.
Processing orthomosaic.tiff [1/1] :
0...10...20...30...40...50...60...70...80...90...100 - done in 00:27:04.


then I try to generate the COG
GDAL_CACHEMAX=16GB  GDAL_NUM_THREADS=ALL_CPUS gdal_translate
web_mercator.tif web_mercator_cog.tif -co COMPRESS=JPEG -co BIGTIFF=YES -of
COG
Input file size is 677881, 303664
0ERROR 1: LZWDecode:Not enough data at scanline 0 (short 40448 bytes)
0.                                                   - estimated remaining
time: 00:14:34

and failed

As it is an LZW problem, I tried with DEFLATE:

GDAL_CACHEMAX=16GB GDAL_NUM_THREADS=ALL_CPUS gdalwarp -t_srs EPSG:3857 -ct
"+proj=pipeline +step +inv +proj=tmerc +lat_0=49 +lon_0=-2 +k=0.9996012717
+x_0=400000 +y_0=-100000 +ellps=airy +step +proj=push +v_3 +step +proj=cart
+ellps=airy +step +proj=helmert +x=446.448 +y=-125.157 +z=542.06 +rx=0.15
+ry=0.247 +rz=0.842 +s=-20.489 +convention=position_vector +step +inv
+proj=cart +ellps=WGS84 +step +proj=pop +v_3 +step +proj=webmerc +lat_0=0
+lon_0=0 +x_0=0 +y_0=0 +ellps=WGS84" -co COMPRESS=DEFLATE -co BIGTIFF=YES
-co TILED=YES -dstalpha orthomosaic.tiff web_mercator_d.tif

Creating output file that is 677881P x 303664L.
Processing orthomosaic.tiff [1/1] :
0...10...20...30...40...50...60...70...80...90...100 - done in 00:27:34.


And then the same
GDAL_CACHEMAX=16GB  GDAL_NUM_THREADS=ALL_CPUS gdal_translate
web_mercator_d.tif web_mercator_cog.tif -co COMPRESS=JPEG -co BIGTIFF=YES
-of COG
Input file size is 677881, 303664
0..                                                  - estimated remaining
time: 02:29:49ERROR 1: ZIPDecode:Decoding error at scanline 0
0...10...                                            - estimated remaining
time: 00:42:12

and failed :(

Trying again I got this output at a similar point (but nothing about
ZIPDecode:Decoding
error at scanline 0).
corrupted double-linked list
Aborted (core dumped)

What can it be? Is there any workaround?
The file is big in pixels, but a big part is transparent.
web_mercator_d.tif is "only" 14GB

Thank you.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20250820/cd582089/attachment.htm>