[gdal-dev] tmp files writing to object storage

[Michael Sumner]

When I write a COG to object storage, I see the external overview being
created in CPL_TMPDIR, but there is a .tif.tmp.tif file that then isn't
cleaned up. This is on a custom endpoint. I see

gdalwarp test_me.tif /vsis3/ideatest/sometest6.tif -of COG -co
SPARSE_OK=YES -ts 14400 7200 -overwrite
Creating output file that is 14400P x 7200L.
Using internal nodata values (e.g. -999) for image test_me.tif.
Copying nodata values from source test_me.tif to destination
/vsis3/ideatest/sometest6.tif.tmp.tif.
0...10...20...30...40...50...60...70...80...90...100 - done in 00:00:15.
ERROR 1: Delete of /vsis3/ideatest/sometest6.tif.tmp.tif failed
ERROR 1: Deleting /vsis3/ideatest/sometest6.tif.tmp.tif failed:
Success

In CPL_TMPDIR I see this file transiently listed as expected:

[1] "sometest6_2305026_3.ovr.tmp"


Is there something else I need to do to have that sometest6.tif.tmp.tif
written to CPL_TMPDIR?

To use the custom endpoint I have the following settings:

AWS_ACCESS_KEY_ID=...
AWS_SECRET_ACCESS_KEY=...
AWS_S3_ENDPOINT=https:///...
AWS_VIRTUAL_HOSTING=FALSE
CPL_VSIS3_CREATE_DIR_OBJECT=TRUE
CPL_VSIL_USE_TEMP_FILE_FOR_RANDOM_WRITE=YES
CPL_TMPDIR=$MYSCRATCH/tmp

Thanks, Mike


-- 
Michael Sumner
Research Software Engineer
Australian Antarctic Division
Hobart, Australia
e-mail: mdsumner at gmail.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20250520/ffe98b87/attachment.htm>