[gdal-dev] Using ADBC to read geometries

Michael Smith michael.smith.erdc at gmail.com
Sat Dec 21 12:39:33 PST 2024


Using gdal-master conda packages, trying to use the new ADBC driver for libduckdb integration, I’m able to connect to a parquet dataset (only if it has the parquet extension) but the geometry is not being recognized.
Seems to take a long time to load compared with duckdb. So, I must be doing something wrong.
Note private s3 bucket.


CPL_DEBUG=on ogrinfo ADBC:"s3://private-bucket/overture-base/overture-places.parquet" -oo ADBC_DRIVER=libduckdb -oo PRELUDE_STATEMENTS="INSTALL httpfs" -oo PRELUDE_STATEMENTS="load httpfs" -oo PRELUDE_STATEMENTS="INSTALL parquet" -oo PRELUDE_STATEMENTS="load parquet" -oo PRELUDE_STATEMENTS="install aws" -oo PRELUDE_STATEMENTS="load aws" -oo PRELUDE_STATEMENTS="CREATE SECRET ( TYPE S3,PROVIDER CREDENTIAL_CHAIN)"
GDAL: On-demand registering /Users/rdcrlmds/mambaforge/envs/gdalmaster/lib/gdalplugins/ogr_ADBC.dylib using RegisterOGRADBC.
GDAL: GDALOpen(ADBC:s3://private-bucket/overture-base/overture-places.parquet, this=0x13a70a000) succeeds as ADBC.
INFO: Open of `ADBC:s3://private-bucket/overture-base/overture-places.parquet'
      using driver `ADBC' successful.
OGR: GetLayerCount() = 1

1: overture-places (None)
GDAL: GDALClose(ADBC:s3://private-bucket/overture-base/overture-places.parquet, this=0x13a70a000)
GDAL: In GDALDestroy - unloading GDAL shared library.


time CPL_DEBUG=on ogrinfo ADBC:"s3://private-bucket/overture-base/overture-places.parquet" -oo ADBC_DRIVER=libduckdb  -oo PRELUDE_STATEMENTS="INSTALL spatial" -oo PRELUDE_STATEMENTS="load spatial" -oo PRELUDE_STATEMENTS="INSTALL httpfs" -oo PRELUDE_STATEMENTS="load httpfs" -oo PRELUDE_STATEMENTS="INSTALL parquet" -oo PRELUDE_STATEMENTS="load parquet" -oo PRELUDE_STATEMENTS="install aws" -oo PRELUDE_STATEMENTS="load aws" -oo PRELUDE_STATEMENTS="CREATE SECRET ( TYPE S3,PROVIDER CREDENTIAL_CHAIN)"
GDAL: On-demand registering /Users/rdcrlmds/mambaforge/envs/gdalmaster/lib/gdalplugins/ogr_ADBC.dylib using RegisterOGRADBC.
GDAL: GDALOpen(ADBC:s3://private-bucket/overture-base/overture-places.parquet, this=0x129e15350) succeeds as ADBC.
INFO: Open of `ADBC:s3://private-bucket/overture-base/overture-places.parquet'
      using driver `ADBC' successful.
OGR: GetLayerCount() = 1

1: overture-places (None)
GDAL: GDALClose(ADBC:s3://private-bucket/overture-base/overture-places.parquet, this=0x129e15350)
GDAL: In GDALDestroy - unloading GDAL shared library.
CPL_DEBUG=on ogrinfo  -oo ADBC_DRIVER=libduckdb -oo  -oo  -oo  -oo  -oo  -oo 
90.25s user 22.43s system 41% cpu 4:29.75 total


-- 

Michael Smith 
Remote Sensing/GIS Center 
US Army Corps of Engineers 








More information about the gdal-dev mailing list