[gdal-dev] STAC Geoparquet required fields - Inspecting one feature due to missing metadata items

[Michael Smith]

Looking at some stac geoparquet datasets I created from a VRT, I see this in the gdal debug output:

GDAL: GDALOpen(/Users/rdcrlmds/Downloads/test1.gti.parquet, this=0x1580079d0) succeeds as Parquet.
GTI: Using assets.data.href as location field
GTI: Inspecting one feature due to missing metadata items

I see that it's getting the file size with
 VSICURL: Using effective URL https://maxar-opendata.s3.us-west-2.amazonaws.com/events/Kahramanmaras-turkey-earthquake-23/ard/36/120022103200/2022-10-17/104001007E564300-visual.tif temporarily
VSICURL: GetFileSize(https://mds-grid-web.rsgiscx.net/mdsgrid/api/file/stream/2315541.tif)=6350041  response_code=200

I do have file.size as the file extension size specified. But maybe it's not in the correct location:

"assets": {"data": {"href": "https://mds-grid-web.rsgiscx.net/mdsgrid/api/file/stream/2315541.tif", "type": "image/tiff; application=geotiff", "title": "data", "file:size": 6350041},
                  "raster:bands": [{"sampling": "area", "spatial_resolution": 0.30517578125, "unit": "meter"}]}}}

I also see that its getting overviews and mask bands and I do have the raster bands extension added but haven't seen an extension that does overview sizes and band masks. 

VSICURL: Effective URL: https://maxar-opendata.s3.us-west-2.amazonaws.com/events/Kahramanmaras-turkey-earthquake-23/ard/36/120022103200/2022-10-17/104001007E564300-visual.tif
GTiff: Opened band mask.
GTiff: Opened 8704x8704 overview.
GTiff: Opened 4352x4352 overview.
GTiff: Opened 2176x2176 overview.
GTiff: Opened 1088x1088 overview.
GTiff: Opened 544x544 overview.
GTiff: Opened 272x272 overview.
GTiff: Opened band mask for 8704x8704 overview.
GTiff: Opened band mask for 4352x4352 overview.
GTiff: Opened band mask for 2176x2176 overview.
GTiff: Opened band mask for 1088x1088 overview.
GTiff: Opened band mask for 544x544 overview.
GTiff: Opened band mask for 272x272 overview.
GDAL: Computing area of interest: 35.2452, 36.9774, 35.3063, 37.0264
GDAL: GDALDriver::Create(VRT,,19761,15849,3,Byte,0x60000256c840)
WARP: Copying metadata from first source to destination dataset

Mike


-- 

Michael Smith 
RSGIS Center – ERDC CRREL NH 
US Army Corps 






---- full output
CPL_DEBUG=on gdalinfo ~/Downloads/test1.gti.parquet
GDAL: On-demand registering /Users/rdcrlmds/mambaforge/envs/gdalmaster/lib/gdalplugins/ogr_Parquet.dylib using RegisterOGRParquet.
PARQUET: geo = {"version":"1.1.0","primary_column":"geometry","columns":{"geometry":{"encoding":"WKB","bbox":[35.243924719620402,36.9300944160942,35.4186648392336,37.026356161812899],"covering":{"bbox":{"xmin":["geometry_bbox","xmin"],"ymin":["geometry_bbox","ymin"],"xmax":["geometry_bbox","xmax"],"ymax":["geometry_bbox","ymax"]}},"orientation":"counterclockwise","geometry_types":["Polygon"]}}}
PARQUET: Bounding box column 'geometry_bbox' detected for geometry column 'geometry'
PARQUET: Compression (of first column): snappy
GDAL: GDALOpen(/Users/rdcrlmds/Downloads/test1.gti.parquet, this=0x1580079d0) succeeds as Parquet.
GTI: Using assets.data.href as location field
GTI: Inspecting one feature due to missing metadata items
HTTP: libcurl/8.13.0 OpenSSL/3.5.0 (SecureTransport) zlib/1.3.1 zstd/1.5.7 libssh2/1.11.1 nghttp2/1.64.0
VSICURL: Using effective URL https://maxar-opendata.s3.us-west-2.amazonaws.com/events/Kahramanmaras-turkey-earthquake-23/ard/36/120022103200/2022-10-17/104001007E564300-visual.tif temporarily
VSICURL: GetFileSize(https://mds-grid-web.rsgiscx.net/mdsgrid/api/file/stream/xxx/2315541.tif)=6350041  response_code=200
VSICURL: Downloading 0-16383 (https://mds-grid-web.rsgiscx.net/mdsgrid/api/file/stream/xxx/2315541.tif)...
VSICURL: Got response_code=206
VSICURL: Effective URL: https://maxar-opendata.s3.us-west-2.amazonaws.com/events/Kahramanmaras-turkey-earthquake-23/ard/36/120022103200/2022-10-17/104001007E564300-visual.tif
GDAL: GDALOpen(/vsicurl/https://mds-grid-web.rsgiscx.net/mdsgrid/api/file/stream/xxx/2315541.tif, this=0x13a00aa00) succeeds as GTiff.
GTiff: ScanDirectories()
VSICURL: Downloading 4292608-4308991 (https://mds-grid-web.rsgiscx.net/mdsgrid/api/file/stream/xxx/2315541.tif)...
VSICURL: Got response_code=206
VSICURL: Effective URL: https://maxar-opendata.s3.us-west-2.amazonaws.com/events/Kahramanmaras-turkey-earthquake-23/ard/36/120022103200/2022-10-17/104001007E564300-visual.tif
VSICURL: Downloading 4308992-4341759 (https://mds-grid-web.rsgiscx.net/mdsgrid/api/file/stream/xxx/2315541.tif)...
VSICURL: Got response_code=206
VSICURL: Effective URL: https://maxar-opendata.s3.us-west-2.amazonaws.com/events/Kahramanmaras-turkey-earthquake-23/ard/36/120022103200/2022-10-17/104001007E564300-visual.tif
GTiff: Opened band mask.
GTiff: Opened 8704x8704 overview.
GTiff: Opened 4352x4352 overview.
GTiff: Opened 2176x2176 overview.
GTiff: Opened 1088x1088 overview.
GTiff: Opened 544x544 overview.
GTiff: Opened 272x272 overview.
GTiff: Opened band mask for 8704x8704 overview.
GTiff: Opened band mask for 4352x4352 overview.
GTiff: Opened band mask for 2176x2176 overview.
GTiff: Opened band mask for 1088x1088 overview.
GTiff: Opened band mask for 544x544 overview.
GTiff: Opened band mask for 272x272 overview.
GDAL: Computing area of interest: 35.2452, 36.9774, 35.3063, 37.0264
GDAL: GDALDriver::Create(VRT,,19761,15849,3,Byte,0x60000256c840)
WARP: Copying metadata from first source to destination dataset
GDAL: GDALClose(/vsicurl/https://mds-grid-web.rsgiscx.net/mdsgrid/api/file/stream/xxx/2315541.tif, this=0x13a00aa00)
GDAL: GDALOpen(/Users/rdcrlmds/Downloads/test1.gti.parquet, this=0x14f615fe0) succeeds as GTI.
Driver: GTI/GDAL Raster Tile Index
GDAL: GDALDefaultOverviews::OverviewScan()
Files: /Users/rdcrlmds/Downloads/test1.gti.parquet