[gdal-dev] Why does an old Python code using /vsicurl?[options] syntax yield HTTP 404 now?

[Rahkonen Jukka]

Hi,

I tried first only with gdalinfo. Now I tried Python (v. 3.9 with GDAL 3.4.1  from OSGeo4W) and for me the script stops into another error

ERROR 4: `/vsicurl?max_retry=3&retry_delay=1&list_dir=no&url=https://files.isric.org/soilgrids/latest/data/ocs\./ocs_0-30cm_mean/tileSG-016-043/tileSG-016-043_2-4.tif' not recognized as a supported file format.

I suppose that I get further than the original poster and my GDAL reads the vrt. Then there happens something with reading a tiff that is referred in the vrt but I do not know what. The link to the ...2-4.tif works with a browser and the downloaded TIFF file is good. I tend to have problems with our proxy server but because the .vrt and .tif are coming from the same base URL I do not believe in that issue this time.

-Jukka-



Lähettäjä: Daniel Evans <daniel.fred.evans at gmail.com>
Lähetetty: maanantai 10. lokakuuta 2022 11.02
Vastaanottaja: Rahkonen Jukka <jukka.rahkonen at maanmittauslaitos.fi>
Kopio: 'gdal-dev at lists.osgeo.org' (gdal-dev at lists.osgeo.org) <gdal-dev at lists.osgeo.org>
Aihe: Re: [gdal-dev] Why does an old Python code using /vsicurl?[options] syntax yield HTTP 404 now?

Hi Jukka,

Can you, or the original poster, give some more information on what Python and GDAL versions you're using that cause trouble? I've not immediately hit 404 errors on trying - with CPL_DEBUG=ON, I can see GDAL successfully opening tiles (HTTP 206).

With something like 13,000 tiles in a single VRT, and a flakey academic data server (according to a reply on the linked post), I'm not yet convinced that the problem is definitively GDAL-specific.

Regards,
Daniel

On Mon, 10 Oct 2022 at 07:47, Rahkonen Jukka <jukka.rahkonen at maanmittauslaitos.fi<mailto:jukka.rahkonen at maanmittauslaitos.fi>> wrote:
Hi,

See this question https://gis.stackexchange.com/questions/442512/python3-download-soilgrid-http-error<https://eur06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgis.stackexchange.com%2Fquestions%2F442512%2Fpython3-download-soilgrid-http-error&data=05%7C01%7Cjukka.rahkonen%40maanmittauslaitos.fi%7Cb1ad9d76010046407f4208daaa95c4ea%7Cc4f8a63255804a1c92371d5a571b71fa%7C0%7C0%7C638009857471277550%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=2hp08NNZKDGRY63Zt7tw6WtQlDG8D8%2B7Bogh%2BSUaxBA%3D&reserved=0> where the user is obviously trying to use the code from https://git.wur.nl/isric/soilgrids/soilgrids.notebooks/-/blob/master/markdown/webdav_from_Python.md<https://eur06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgit.wur.nl%2Fisric%2Fsoilgrids%2Fsoilgrids.notebooks%2F-%2Fblob%2Fmaster%2Fmarkdown%2Fwebdav_from_Python.md&data=05%7C01%7Cjukka.rahkonen%40maanmittauslaitos.fi%7Cb1ad9d76010046407f4208daaa95c4ea%7Cc4f8a63255804a1c92371d5a571b71fa%7C0%7C0%7C638009857471277550%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=%2F7RYPfGI42SwDbdd2KRWe2L%2F5fnlsYDz0uaDh%2B5Wtp4%3D&reserved=0>. The tutorial is well written and I believe that it has been working 2 years ago but now it yields a HTTP 404 Not found response from the server. The URL to the data is OK and gdalinfo can access the data.

-Jukka Rahkonen-

_______________________________________________
gdal-dev mailing list
gdal-dev at lists.osgeo.org<mailto:gdal-dev at lists.osgeo.org>
https://lists.osgeo.org/mailman/listinfo/gdal-dev<https://eur06.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fgdal-dev&data=05%7C01%7Cjukka.rahkonen%40maanmittauslaitos.fi%7Cb1ad9d76010046407f4208daaa95c4ea%7Cc4f8a63255804a1c92371d5a571b71fa%7C0%7C0%7C638009857471433799%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=zlFF1ZzLymmSIkk8atPv8mQ390%2BNYO4%2FI1%2Brj%2FtXMok%3D&reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20221010/2b722ffb/attachment.htm>