<div dir="ltr">Thanks for helping track it down!<br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, 16 Aug 2022 at 14:05, Even Rouault <<a href="mailto:even.rouault@spatialys.com">even.rouault@spatialys.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
  
    
  
  <div>
    <span></span>William,<br>
    <span></span>
    <blockquote type="cite">
      <div dir="ltr">
        <div dir="ltr">
          <blockquote class="gmail_quote">
            <div><span>COG: Generating overviews of the imagery: start<br>
                S3: GetFileSize(<a href="https://my-bucket.s3.amazonaws.com/test_batch_output/test.tif.ovr.tmp)=0" target="_blank">https://my-bucket.s3.amazonaws.com/test_batch_output/test.tif.ovr.tmp)=0</a>
                 response_code=404<br>
                S3: /vsis3/my-bucket/test_batch_output/test.tif.ovr.tmp
                is not a object<br>
                GTiff: File being created as a BigTIFF.<br>
                ERROR 1: Only read-only mode is supported for /vsicurl<br>
                COG: Generating overviews of the imagery: end<br>
                S3: UploadId:
Rok8InTcYwFMoHYA3kVAwlLDycIxreczdLSODBpLA5exAshfS46ZclK.3.2.a_EAAY3vhoJQnc7DsVk9X3pzsRetSAZ.oc39kDwRe755ftroj5rH9BRXLPaNCcnuTGZP<br>
                S3: Etag for part 1 is
                "52647419376831771b40964bad80d86e"<br>
                S3: Etag for part 2 is
                "4bea862d0878bbe1dbe717aa8cea48c8"<br>
                S3: Etag for part 3 is
                "5ba3c9e4ea924f06cdc2ee614e5627c0"<br>
                S3: Etag for part 4 is
                "07e53a2e07a2575d1b2d89cf8040ebe8"<br>
                GDAL:
                GDALClose(/vsis3/my-bucket/test_batch_output/test.tif.warped.tif.tmp,
                this=0x55a288913060)<br>
                S3: GetFileSize(<a href="https://my-bucket.s3.amazonaws.com/test_batch_output/test.tif.warped.tif.tmp)=207439264" target="_blank">https://my-bucket.s3.amazonaws.com/test_batch_output/test.tif.warped.tif.tmp)=207439264</a>
                 response_code=206<br>
                GDAL: GDALClose(/vsis3/my-bucket/dtm/test.tif,
                this=0x55a2882e8570)<br>
                GDAL: In GDALDestroy - unloading GDAL shared library.</span><br>
            </div>
          </blockquote>
          <div><br>
          </div>
          <div> It looks to me like gdal attempted to write a lot of the
            tmp files to s3, rather than locally? the command I used is:</div>
        </div>
      </div>
    </blockquote>
    <p>Yes exactly this is an issue with the temporary file created when
      computing overviews, before integrating them to the final COG
      file. I've tracked this issue at
      <a href="https://github.com/OSGeo/gdal/issues/6205" target="_blank">https://github.com/OSGeo/gdal/issues/6205</a> . I should be able to
      look at fixing that soon</p>
    <p>Even</p>
    <br>
    <pre cols="72">-- 
<a href="http://www.spatialys.com" target="_blank">http://www.spatialys.com</a>
My software is free, but my time generally not.</pre>
  </div>

</blockquote></div>