<div dir="auto">I also see that you have a tiledb driver registration happening only on your conda version, exactly at the time of your lag. you should also try to remove/rename your gdal_tiledb.so plugin file to check the issue isn't coming from there.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Le ven. 13 sept. 2024, 18:22, thomas bonfort <<a href="mailto:thomas.bonfort@gmail.com">thomas.bonfort@gmail.com</a>> a écrit :<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="auto">Javier,<div dir="auto">3.9 is probably doing parallel reads, which will cause a noticeable lag in requests on a slow connection (the overall processing time should not be slower anyhow). There's a gtiff open option documented that can disable this behavior, that you can try to use to see if it changes your timings. If that is the effective cause, that would mean there is an issue with this parallel implementation.</div><div dir="auto">TB</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">Le ven. 13 sept. 2024, 18:15, Javier Jimenez Shaw via gdal-dev <<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank" rel="noreferrer">gdal-dev@lists.osgeo.org</a>> a écrit :<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Thanks David for the suggestion. Very interesting data.<br></div><div><br></div><div>Unfortunately the issue I have is not reproduced with that file. So it may be due to the authentication (your suggestion does not need authentication).</div><div><br></div><div>Some context: I am opening a COG file from S3 in QGIS, setting the url in the command line. Something like</div><div>qgis /vsis3/blahblabla</div><div><br></div><div>(more on that later)</div><div><br></div><div>If I run it in my Ubuntu 22.04 (that has GDAL 3.4.1), with QGIS 3.38, no problem</div><div>If I run with conda with QGIS 3.38 (that has GDAL 3.9.1), it is noticeable slower.</div><div><br></div><div>So I think it is due to the version of GDAL. If you think that I am wrong and I should ask directly to QGIS, it is ok.</div><div><br></div><div>This is a bit problematic to reproduce because the authorization expires in 12 hours. So I post here the command I produced with a python script. If it is needed, I can share the python script that is getting the authentication. It is about 100 lines of code.</div><div><br></div><div>Enabling the logs I see there a gap of 6 seconds during the opening with conda, that is not there with the QGIS from Ubuntu that uses GDAL 3.4.1</div><div><br></div><div>This is the log from conda</div><div>The gap is between</div><div><span style="font-family:monospace">Fri Sep 13 17:56:26 2024].9370</span></div><div>and<br></div><div><span style="font-family:monospace">[Fri Sep 13 17:56:33 2024].4445</span></div><div><br></div><div><span style="font-family:monospace">CPL_DEBUG=ON CPL_TIMESTAMP=ON python3 pix4d_qgis.py --project-id 1969386 --share-token 09c3eada-1b3b-46eb-b5de-8bd51635a5b9<br>Session expires at 2024-09-14T03:56:22Z<br></span></div><div><span style="font-family:monospace">AWS_ACCESS_KEY_ID=ASIATOCJLBKS2RHGCAHB AWS_SECRET_ACCESS_KEY=nNT8fTH/cGiyn4NVubp5/1LroyZ69johhXYxkCK1 AWS_SESSION_TOKEN=FwoGZXIvYXdzEKn//////////wEaDI1G/49ov88aGibrOCLXAilDbBuFQ/ydJF4AZ50/lYmWYmNDjM9H7XbbioyXiLQzwTqVRN1TLG6T29Anklkw47MKxdKHDF/O85r9gWJmCAqYTKalA38VM1qbixsjSXAzR7W5p1v1pgRUKtN4J03NrZOH2S6gbo4OKv+UUkPe/Xq4s8w0vEVNJLhvVx6dvpJMv7Jp9UxvLA5a+nrBKUqJujujqJnRXAKKfnpJbTDvhCuIeTxaFFt50e5UpLjSwqXS/a/AaEMJXRSsSLbKFTW/ALSCHfPv3HCStnue5CFpzVk4OhQbQ+dZyXUQp5wxQTtpr0hIh0IyB20gsoZNa0lGvFuXnzqDCH2X2mXwzDcyZk2IOX34nq+Wtnk8qYdjJxEAG0tnlYsMjmmXECnbOxl6gtNJ5hoehgak6cSfs7/rMi4jOI838tzsWWyDJeACj9qfQyfGtpk23x8Zt6KuqUjNZ1/z+/T8LwoopsGRtwYyKQbJS8pn8IGKPLtHDVxRx09yBRuqgYVFzSqpnr3T1vwWYHXiEF0sVJBx GDAL_DISABLE_READDIR_ON_OPEN=EMPTY_DIR /home/jshaw/anaconda3/envs/qgis_stable/bin/qgis /vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff<br>[Fri Sep 13 17:56:26 2024].3948, 0.0000: HTTP: libcurl/8.9.0 OpenSSL/3.3.1 zlib/1.3.1 zstd/1.5.6 libssh2/1.11.0 nghttp2/1.58.0<br>[Fri Sep 13 17:56:26 2024].7731, 0.3783: S3: Switching to endpoint <a href="http://s3.eu-central-1.amazonaws.com" rel="noreferrer noreferrer" target="_blank">s3.eu-central-1.amazonaws.com</a><br>[Fri Sep 13 17:56:26 2024].8415, 0.4467: S3: Switching to region eu-central-1<br>[Fri Sep 13 17:56:26 2024].9230, 0.5282: S3: GetFileSize(<a href="https://prod-pix4d-cloud-eu-central-1.s3.eu-central-1.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)=66132291" rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.eu-central-1.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)=66132291</a> response_code=206<br>[Fri Sep 13 17:56:26 2024].9235, 0.5288: GDAL: GDALOpen(/vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff, this=0x556e6bb915a0) succeeds as GTiff.<br>[Fri Sep 13 17:56:26 2024].9240, 0.5292: GTiff: ScanDirectories()<br>[Fri Sep 13 17:56:26 2024].9243, 0.5296: GTiff: Opened band mask.<br>[Fri Sep 13 17:56:26 2024].9246, 0.5298: GTiff: Opened 8929x7207 overview.<br>[Fri Sep 13 17:56:26 2024].9249, 0.5301: GTiff: Opened 4464x3603 overview.<br>[Fri Sep 13 17:56:26 2024].9251, 0.5304: GTiff: Opened 2232x1801 overview.<br>[Fri Sep 13 17:56:26 2024].9254, 0.5306: GTiff: Opened 1116x900 overview.<br>[Fri Sep 13 17:56:26 2024].9257, 0.5309: GTiff: Opened 558x450 overview.<br>[Fri Sep 13 17:56:26 2024].9259, 0.5311: GTiff: Opened 279x225 overview.<br>[Fri Sep 13 17:56:26 2024].9262, 0.5314: GTiff: Opened band mask for 8929x7207 overview.<br>[Fri Sep 13 17:56:26 2024].9264, 0.5316: GTiff: Opened band mask for 4464x3603 overview.<br>[Fri Sep 13 17:56:26 2024].9267, 0.5319: GTiff: Opened band mask for 2232x1801 overview.<br>[Fri Sep 13 17:56:26 2024].9269, 0.5321: GTiff: Opened band mask for 1116x900 overview.<br>[Fri Sep 13 17:56:26 2024].9272, 0.5324: GTiff: Opened band mask for 558x450 overview.<br>[Fri Sep 13 17:56:26 2024].9274, 0.5326: GTiff: Opened band mask for 279x225 overview.<br>[Fri Sep 13 17:56:26 2024].9277, 0.5329: GDAL: GDALClose(/vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff, this=0x556e6bb915a0)<br>ERROR: Status 2: File /vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff could not be found<br>[Fri Sep 13 17:56:26 2024].9370, 0.5422: GDAL: On-demand registering /home/jshaw/anaconda3/envs/qgis_stable/lib/gdalplugins/gdal_TileDB.so using GDALRegister_TileDB.<br>[Fri Sep 13 17:56:33 2024].4445, 7.0498: S3: GetFileSize(<a href="https://prod-pix4d-cloud-eu-central-1.s3.eu-central-1.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)=66132291" rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.eu-central-1.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)=66132291</a> response_code=206<br>[Fri Sep 13 17:56:33 2024].4449, 7.0501: GDAL: GDALOpen(/vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff, this=0x556e6b807d00) succeeds as GTiff.<br>GDAL ERROR 0: [Fri Sep 13 17:56:33 2024].4666, 7.0718: OGRCT: Using WebMercator to WGS84 optimization<br>GDAL ERROR 0: [Fri Sep 13 17:56:33 2024].4667, 7.0719: GDAL: Computing area of interest: 6.62976, 46.6391, 6.63534, 46.6422<br>[Fri Sep 13 17:56:33 2024].4667, 7.0719: GTiff: ScanDirectories()<br>[Fri Sep 13 17:56:33 2024].4669, 7.0721: GTiff: Opened band mask.<br>[Fri Sep 13 17:56:33 2024].4670, 7.0722: GTiff: Opened 8929x7207 overview.<br>[Fri Sep 13 17:56:33 2024].4671, 7.0723: GTiff: Opened 4464x3603 overview.<br>[Fri Sep 13 17:56:33 2024].4672, 7.0724: GTiff: Opened 2232x1801 overview.<br>[Fri Sep 13 17:56:33 2024].4673, 7.0725: GTiff: Opened 1116x900 overview.<br>[Fri Sep 13 17:56:33 2024].4674, 7.0726: GTiff: Opened 558x450 overview.<br>[Fri Sep 13 17:56:33 2024].4675, 7.0727: GTiff: Opened 279x225 overview.<br>[Fri Sep 13 17:56:33 2024].4676, 7.0728: GTiff: Opened band mask for 8929x7207 overview.<br>[Fri Sep 13 17:56:33 2024].4677, 7.0729: GTiff: Opened band mask for 4464x3603 overview.<br>[Fri Sep 13 17:56:33 2024].4677, 7.0730: GTiff: Opened band mask for 2232x1801 overview.<br>[Fri Sep 13 17:56:33 2024].4678, 7.0731: GTiff: Opened band mask for 1116x900 overview.<br>[Fri Sep 13 17:56:33 2024].4679, 7.0732: GTiff: Opened band mask for 558x450 overview.<br>[Fri Sep 13 17:56:33 2024].4680, 7.0733: GTiff: Opened band mask for 279x225 overview.<br>[Fri Sep 13 17:56:33 2024].5178, 7.1230: GDAL: GDALOpen(/vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff, this=0x7f830c08d490) succeeds as GTiff.<br>[Fri Sep 13 17:56:33 2024].5180, 7.1232: S3: Downloading 59179008-59244543 (<a href="https://prod-pix4d-cloud-eu-central-1.s3.eu-central-1.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)." rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.eu-central-1.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff).</a>..<br>GDAL ERROR 0: [Fri Sep 13 17:56:33 2024].5244, 7.1296: GDAL: Computing area of interest: 6.62976, 46.6391, 6.63534, 46.6422<br>[Fri Sep 13 17:56:33 2024].5245, 7.1297: GTiff: ScanDirectories()<br>[Fri Sep 13 17:56:33 2024].5246, 7.1298: GTiff: Opened band mask.<br>[Fri Sep 13 17:56:33 2024].5247, 7.1299: GTiff: Opened 8929x7207 overview.<br>[Fri Sep 13 17:56:33 2024].5247, 7.1300: GTiff: Opened 4464x3603 overview.<br>[Fri Sep 13 17:56:33 2024].5248, 7.1300: GTiff: Opened 2232x1801 overview.<br>[Fri Sep 13 17:56:33 2024].5249, 7.1301: GTiff: Opened 1116x900 overview.<br>[Fri Sep 13 17:56:33 2024].5249, 7.1302: GTiff: Opened 558x450 overview.<br>[Fri Sep 13 17:56:33 2024].5250, 7.1302: GTiff: Opened 279x225 overview.<br>[Fri Sep 13 17:56:33 2024].5251, 7.1303: GTiff: Opened band mask for 8929x7207 overview.<br>[Fri Sep 13 17:56:33 2024].5251, 7.1304: GTiff: Opened band mask for 4464x3603 overview.<br>[Fri Sep 13 17:56:33 2024].5252, 7.1304: GTiff: Opened band mask for 2232x1801 overview.<br>[Fri Sep 13 17:56:33 2024].5253, 7.1305: GTiff: Opened band mask for 1116x900 overview.<br>[Fri Sep 13 17:56:33 2024].5253, 7.1306: GTiff: Opened band mask for 558x450 overview.<br>[Fri Sep 13 17:56:33 2024].5254, 7.1306: GTiff: Opened band mask for 279x225 overview.<br>[Fri Sep 13 17:56:33 2024].5255, 7.1307: GDAL: Selecting overview 1116 x 900<br>[Fri Sep 13 17:56:33 2024].5255, 7.1307: S3: Downloading 16384-32767 (<a href="https://prod-pix4d-cloud-eu-central-1.s3.eu-central-1.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)." rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.eu-central-1.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff).</a>..<br>[Fri Sep 13 17:56:33 2024].6116, 7.2168: S3: Got response_code=206<br>[Fri Sep 13 17:56:33 2024].6118, 7.2171: S3: Downloading 180224-589823 (<a href="https://prod-pix4d-cloud-eu-central-1.s3.eu-central-1.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)." rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.eu-central-1.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff).</a>..<br>[Fri Sep 13 17:56:33 2024].6955, 7.3008: S3: Got response_code=206<br>[Fri Sep 13 17:56:33 2024].6960, 7.3012: GDAL: GDAL_CACHEMAX = 1591 MB<br>[Fri Sep 13 17:56:33 2024].6977, 7.3029: S3: Got response_code=206</span></div><div><br></div><div><br></div><div>This is the equivalent code with QGIS 3.38 in Ubuntu and GDAL 3.4.1</div><div><br></div><div><span style="font-family:monospace">CPL_DEBUG=ON CPL_TIMESTAMP=ON python3 pix4d_qgis.py --project-id 1969386 --share-token 09c3eada-1b3b-46eb-b5de-8bd51635a5b9<br>Session expires at 2024-09-14T04:00:10Z<br>AWS_ACCESS_KEY_ID=ASIATOCJLBKSRCEUBKE6 AWS_SECRET_ACCESS_KEY=h6NhBf9VwBZoVj5Zd/8H2BnzXQu0l6bFUUv2D8E7 AWS_SESSION_TOKEN=FwoGZXIvYXdzEKn//////////wEaDF1xO50XL6GBe/358CLXAn3JR/uteJtarwJ/ryn6i4+lcMFEQZ/KV0FZQdKsD1PwAcqoYFY+0GKYSV+FTk81ZszsVzy8N7d2GwByvP9S/L1XOo1FrqJfDpGw3a5eQR7AoeU68EPlD/WTYnM7XBzXimHywDCyue3SOi8oZaSdbMgjBQ1N6j+qQ+EDN7RjD/Zu2CGMTzN9g/Z0FhZsuyt2HRhnOYpsvpUMZ+WQr7pbjdVdwt3PdFHsJ95fhueapJspgQ7OSgmj5VtSR8NTecohLsd2eeGkSpiqVWuBwuAu2cW6LcqmAZGnF0DZIjPWiMIDf/OLczMRCw5MJGeYpsSkkiuM+t9Miv8aN4iCo8vjl6wumOCgPqTgBBWlQdAs2mLxwpF1Bb1UjJ6eiccp17+yJF3ffn8tvxx/+1V3Q++E5Xk+jiB1keJnFcizr7qD6EY+EdDES5sQrWAhM2uR78JjNc0f+hVZEmAoisORtwYyKb0po07ytiiBv+X3j+Y6BsCHR0Es3C3xVvsgkfn1zb1Z2flFWUzwqJUD GDAL_DISABLE_READDIR_ON_OPEN=EMPTY_DIR /usr/bin/qgis /vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff<br>[Fri Sep 13 18:00:14 2024].7665, 0.0000: HTTP: libcurl/7.81.0 OpenSSL/3.0.2 zlib/1.2.11 brotli/1.0.9 zstd/1.4.8 libidn2/2.3.2 libpsl/0.21.0 (+libidn2/2.3.2) libssh/0.9.6/openssl/zlib nghttp2/1.43.0 librtmp/2.3 OpenLDAP/2.5.18<br>[Fri Sep 13 18:00:14 2024].7666, 0.0001: S3: Downloading 0-16383 (<a href="https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)." rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff).</a>..<br>[Fri Sep 13 18:00:14 2024].8897, 0.1231: S3: Got response_code=400<br>[Fri Sep 13 18:00:14 2024].8898, 0.1232: S3: Switching to region eu-central-1<br>[Fri Sep 13 18:00:14 2024].8899, 0.1234: S3: Downloading 0-16383 (<a href="https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)." rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff).</a>..<br>[Fri Sep 13 18:00:15 2024].0287, 0.2621: S3: Got response_code=206<br>[Fri Sep 13 18:00:15 2024].0288, 0.2622: S3: GetFileSize(<a href="https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)=66132291" rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)=66132291</a> response_code=206<br>[Fri Sep 13 18:00:15 2024].0292, 0.2627: GDAL: GDALOpen(/vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff, this=0x560e4cd84920) succeeds as GTiff.<br>[Fri Sep 13 18:00:15 2024].0298, 0.2632: GTiff: ScanDirectories()<br>[Fri Sep 13 18:00:15 2024].0301, 0.2635: GTiff: Opened band mask.<br>[Fri Sep 13 18:00:15 2024].0304, 0.2638: GTiff: Opened 8929x7207 overview.<br>[Fri Sep 13 18:00:15 2024].0306, 0.2641: GTiff: Opened 4464x3603 overview.<br>[Fri Sep 13 18:00:15 2024].0309, 0.2643: GTiff: Opened 2232x1801 overview.<br>[Fri Sep 13 18:00:15 2024].0311, 0.2646: GTiff: Opened 1116x900 overview.<br>[Fri Sep 13 18:00:15 2024].0314, 0.2648: GTiff: Opened 558x450 overview.<br>[Fri Sep 13 18:00:15 2024].0316, 0.2651: GTiff: Opened 279x225 overview.<br>[Fri Sep 13 18:00:15 2024].0319, 0.2654: GTiff: Opened band mask for 8929x7207 overview.<br>[Fri Sep 13 18:00:15 2024].0322, 0.2656: GTiff: Opened band mask for 4464x3603 overview.<br>[Fri Sep 13 18:00:15 2024].0324, 0.2658: GTiff: Opened band mask for 2232x1801 overview.<br>[Fri Sep 13 18:00:15 2024].0326, 0.2661: GTiff: Opened band mask for 1116x900 overview.<br>[Fri Sep 13 18:00:15 2024].0329, 0.2663: GTiff: Opened band mask for 558x450 overview.<br>[Fri Sep 13 18:00:15 2024].0331, 0.2665: GTiff: Opened band mask for 279x225 overview.<br>[Fri Sep 13 18:00:15 2024].0334, 0.2669: GDAL: GDALClose(/vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff, this=0x560e4cd84920)<br>ERROR: Status 2: File /vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff could not be found<br>[Fri Sep 13 18:00:15 2024].0357, 0.2691: S3: Downloading 0-16383 (<a href="https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)." rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff).</a>..<br>[Fri Sep 13 18:00:15 2024].0762, 0.3096: S3: Got response_code=206<br>[Fri Sep 13 18:00:15 2024].0762, 0.3097: S3: GetFileSize(<a href="https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)=66132291" rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)=66132291</a> response_code=206<br>[Fri Sep 13 18:00:15 2024].0765, 0.3099: GDAL: GDALOpen(/vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff, this=0x560e4d0afb70) succeeds as GTiff.<br>GDAL ERROR 0: [Fri Sep 13 18:00:15 2024].0956, 0.3291: GDAL: Computing area of interest: 6.62976, 46.6391, 6.63534, 46.6422<br>[Fri Sep 13 18:00:15 2024].0958, 0.3293: GTiff: ScanDirectories()<br>[Fri Sep 13 18:00:15 2024].0959, 0.3294: GTiff: Opened band mask.<br>[Fri Sep 13 18:00:15 2024].0961, 0.3295: GTiff: Opened 8929x7207 overview.<br>[Fri Sep 13 18:00:15 2024].0962, 0.3296: GTiff: Opened 4464x3603 overview.<br>[Fri Sep 13 18:00:15 2024].0962, 0.3297: GTiff: Opened 2232x1801 overview.<br>[Fri Sep 13 18:00:15 2024].0963, 0.3298: GTiff: Opened 1116x900 overview.<br>[Fri Sep 13 18:00:15 2024].0964, 0.3299: GTiff: Opened 558x450 overview.<br>[Fri Sep 13 18:00:15 2024].0965, 0.3300: GTiff: Opened 279x225 overview.<br>[Fri Sep 13 18:00:15 2024].0966, 0.3301: GTiff: Opened band mask for 8929x7207 overview.<br>[Fri Sep 13 18:00:15 2024].0967, 0.3302: GTiff: Opened band mask for 4464x3603 overview.<br>[Fri Sep 13 18:00:15 2024].0968, 0.3303: GTiff: Opened band mask for 2232x1801 overview.<br>[Fri Sep 13 18:00:15 2024].0969, 0.3303: GTiff: Opened band mask for 1116x900 overview.<br>[Fri Sep 13 18:00:15 2024].0970, 0.3304: GTiff: Opened band mask for 558x450 overview.<br>[Fri Sep 13 18:00:15 2024].0971, 0.3305: GTiff: Opened band mask for 279x225 overview.<br>[Fri Sep 13 18:00:15 2024].2011, 0.4346: GDAL: GDALOpen(/vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff, this=0x7f0dfc08dfd0) succeeds as GTiff.<br>GDAL ERROR 0: [Fri Sep 13 18:00:15 2024].2120, 0.4454: GDAL: Computing area of interest: 6.62976, 46.6391, 6.63534, 46.6422<br>[Fri Sep 13 18:00:15 2024].2121, 0.4456: GTiff: ScanDirectories()<br>[Fri Sep 13 18:00:15 2024].2122, 0.4457: GTiff: Opened band mask.<br>[Fri Sep 13 18:00:15 2024].2123, 0.4457: GTiff: Opened 8929x7207 overview.<br>[Fri Sep 13 18:00:15 2024].2123, 0.4458: GTiff: Opened 4464x3603 overview.<br>[Fri Sep 13 18:00:15 2024].2124, 0.4459: GTiff: Opened 2232x1801 overview.<br>[Fri Sep 13 18:00:15 2024].2125, 0.4459: GTiff: Opened 1116x900 overview.<br>[Fri Sep 13 18:00:15 2024].2125, 0.4460: GTiff: Opened 558x450 overview.<br>[Fri Sep 13 18:00:15 2024].2126, 0.4460: GTiff: Opened 279x225 overview.<br>[Fri Sep 13 18:00:15 2024].2126, 0.4461: GTiff: Opened band mask for 8929x7207 overview.<br>[Fri Sep 13 18:00:15 2024].2127, 0.4462: GTiff: Opened band mask for 4464x3603 overview.<br>[Fri Sep 13 18:00:15 2024].2128, 0.4462: GTiff: Opened band mask for 2232x1801 overview.<br>[Fri Sep 13 18:00:15 2024].2128, 0.4463: GTiff: Opened band mask for 1116x900 overview.<br>[Fri Sep 13 18:00:15 2024].2129, 0.4463: GTiff: Opened band mask for 558x450 overview.<br>[Fri Sep 13 18:00:15 2024].2129, 0.4464: GTiff: Opened band mask for 279x225 overview.<br>[Fri Sep 13 18:00:15 2024].2130, 0.4465: S3: Downloading 16384-32767 (<a href="https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)." rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff).</a>..<br>[Fri Sep 13 18:00:15 2024].3454, 0.5789: S3: Got response_code=206<br>[Fri Sep 13 18:00:15 2024].3456, 0.5791: S3: Downloading 180224-589823 (<a href="https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff)." rel="noreferrer noreferrer" target="_blank">https://prod-pix4d-cloud-eu-central-1.s3.amazonaws.com/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff).</a>..<br>[Fri Sep 13 18:00:15 2024].4272, 0.6606: S3: Got response_code=206<br>[Fri Sep 13 18:00:15 2024].4276, 0.6610: GDAL: GDAL_CACHEMAX = 1591 MB</span><br></div><div><br></div><div>What can it be?<br></div><div><br></div><div>BTW, in both cases it says</div><div><span style="font-family:monospace">ERROR: Status 2: File
/vsis3/prod-pix4d-cloud-eu-central-1/user-5b21721a-90d0-49c9-9d1c-d2a0c5929be5/project-1969386/ortho_display.tiff
could not be found</span></div><div>And later it opens it. I don't know why.</div><div><br></div><div>Thank you very much</div><div>Javier.<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, 9 Sept 2024 at 23:49, Mayer, David P <<a href="mailto:dpmayer@usgs.gov" rel="noreferrer noreferrer" target="_blank">dpmayer@usgs.gov</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div>
<div dir="ltr">
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Would ~200 GB be large enough?</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Here is a mosaic of a section of Mars at 6 meters/pixel in a public S3 bucket:<br>
s3://asc-pds-services/mosaic/Mars/Mars_MRO_CTX_Equi_Mosaics_Robbins/6mpp/MC16_6mpp.16bit.tif</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Cheers,<br>
David</div>
<div style="font-family:Calibri,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div id="m_-2052332246590358472m_144624916223307152m_2197975624438736361Signature">
<div style="font-family:"Courier New",monospace;font-size:12pt;color:rgb(0,0,0)">
-----------<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<span style="font-family:"Courier New",monospace">David Mayer</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<span style="font-family:"Courier New",monospace">Geographer</span><br>
</div>
<div style="font-size:12pt;color:rgb(0,0,0)"><span style="font-family:"Courier New",monospace">Astrogeology Science Center</span><span style="font-family:Calibri,Arial,Helvetica,sans-serif"><br>
</span></div>
<div style="font-size:12pt;color:rgb(0,0,0)"><span style="font-family:"Courier New",monospace">US Geological Survey</span><span style="font-family:Calibri,Arial,Helvetica,sans-serif"><br>
</span></div>
<span style="font-family:"Courier New",monospace;font-size:12pt;color:rgb(0,0,0)"><a href="mailto:dpmayer@usgs.gov" rel="noreferrer noreferrer" target="_blank">dpmayer@usgs.gov</a></span><span style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)"><br>
</span></div>
<div id="m_-2052332246590358472m_144624916223307152m_2197975624438736361appendonsend"></div>
<hr style="display:inline-block;width:98%">
<div id="m_-2052332246590358472m_144624916223307152m_2197975624438736361divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> gdal-dev <<a href="mailto:gdal-dev-bounces@lists.osgeo.org" rel="noreferrer noreferrer" target="_blank">gdal-dev-bounces@lists.osgeo.org</a>> on behalf of Javier Jimenez Shaw via gdal-dev <<a href="mailto:gdal-dev@lists.osgeo.org" rel="noreferrer noreferrer" target="_blank">gdal-dev@lists.osgeo.org</a>><br>
<b>Sent:</b> Monday, September 9, 2024 13:55<br>
<b>To:</b> gdal dev <<a href="mailto:gdal-dev@lists.osgeo.org" rel="noreferrer noreferrer" target="_blank">gdal-dev@lists.osgeo.org</a>><br>
<b>Subject:</b> [EXTERNAL] [gdal-dev] s3 request example</font>
<div> </div>
</div>
<div>
<p> </p>
<div>
<table border="2" cellspacing="4" cellpadding="0" style="border-color:black;background-color:yellow;margin-left:auto;margin-right:auto">
<tbody>
<tr>
<td>
<p style="text-align:center"><strong> This email has been received from outside of DOI - Use caution before clicking on links, opening attachments, or responding. </strong></p>
</td>
</tr>
</tbody>
</table>
</div>
<p><br>
<br>
</p>
<div>
<div dir="auto">
<div dir="ltr">
<div>Hi</div>
<div><br>
</div>
<div>I am experiencing a much slower load of a remote COG using vsis3 with the QGIS from conda than the QGIS in my Ubuntu (that uses GDAL 3.4.1).</div>
<div><br>
</div>
<div>Because both are QGIS 3.38, I think the problem is in the version of GDAL.</div>
<div>I would like to research it more.<br>
</div>
<div><br>
</div>
<div>Is there any example of a (big) COG file in Amazon S3 I can use to compare them? Unfortunately the credentials for the files I am using expire after a few hours, so they are useless to report anything.<br>
</div>
<div><br>
</div>
<div>Best regards,</div>
<div>Javier<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div></blockquote></div>
_______________________________________________<br>
gdal-dev mailing list<br>
<a href="mailto:gdal-dev@lists.osgeo.org" rel="noreferrer noreferrer" target="_blank">gdal-dev@lists.osgeo.org</a><br>
<a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer noreferrer noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
</blockquote></div>
</blockquote></div>