[gdal-dev] tmp files writing to object storage

[Even Rouault]

Michael,

I couldn't reproduce your error (the temp file gets deleted for me), but 
the creation of a temporary file on /vsis3/ was certainly a bug. I've 
addressed this per https://github.com/OSGeo/gdal/pull/12421

Even

Le 20/05/2025 à 02:38, Michael Sumner via gdal-dev a écrit :
> When I write a COG to object storage, I see the external overview 
> being created in CPL_TMPDIR, but there is a .tif.tmp.tif file that 
> then isn't cleaned up. This is on a custom endpoint. I see
>
> gdalwarp test_me.tif /vsis3/ideatest/sometest6.tif -of COG -co 
> SPARSE_OK=YES -ts 14400 7200 -overwrite
> Creating output file that is 14400P x 7200L.
> Using internal nodata values (e.g. -999) for image test_me.tif.
> Copying nodata values from source test_me.tif to destination 
> /vsis3/ideatest/sometest6.tif.tmp.tif.
> 0...10...20...30...40...50...60...70...80...90...100 - done in 00:00:15.
> ERROR 1: Delete of /vsis3/ideatest/sometest6.tif.tmp.tif failed
> ERROR 1: Deleting /vsis3/ideatest/sometest6.tif.tmp.tif failed:
> Success
>
> In CPL_TMPDIR I see this file transiently listed as expected:
>
> [1] "sometest6_2305026_3.ovr.tmp"
>
>
> Is there something else I need to do to have that 
> sometest6.tif.tmp.tif written to CPL_TMPDIR?
>
> To use the custom endpoint I have the following settings:
>
> AWS_ACCESS_KEY_ID=...
> AWS_SECRET_ACCESS_KEY=...
> AWS_S3_ENDPOINT=https:///...
> AWS_VIRTUAL_HOSTING=FALSE
> CPL_VSIS3_CREATE_DIR_OBJECT=TRUE
> CPL_VSIL_USE_TEMP_FILE_FOR_RANDOM_WRITE=YES
> CPL_TMPDIR=$MYSCRATCH/tmp
>
> Thanks, Mike
>
>
> -- 
> Michael Sumner
> Research Software Engineer
> Australian Antarctic Division
> Hobart, Australia
> e-mail: mdsumner at gmail.com
>
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev

-- 
http://www.spatialys.com
My software is free, but my time generally not.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20250520/b8053c94/attachment.htm>