[gdal-dev] Directories and Parquet

[Paul Ramsey]

I am playing with accessing the Overture data dump, which is multiple
files in each S3 bucket. The doco says that as of 3.6 (check!), with
the libarrow_dataset build (check) I should be able to read directory
collections as layers, but no luck thus far:

AWS_REGION=us-west-2 AWS_NO_SIGN_REQUEST=YES ./ogrinfo
/vsis3/overturemaps-us-west-2/release/2023-07-26-alpha.0/theme=admins/type=administrativeBoundary/
AWS_REGION=us-west-2 AWS_NO_SIGN_REQUEST=YES ./ogrinfo
/vsis3/overturemaps-us-west-2/release/2023-07-26-alpha.0/theme=admins/type=administrativeBoundary/

ogrinfo failed - unable to open
'/vsis3/overturemaps-us-west-2/release/2023-07-26-alpha.0/theme=admins/type=administrativeBoundary/'.

If I pick one of the constituent files in that directory, ogr can open
it up just fine, and we just have the array/map/list type issue that
Scott has raised in another thread. Is this expected, a result of the
access being via S3 rather than an actual filesystem directory?
Something else?

Thx,
P