[gdal-dev] Parquet and nest structures (JSON)

[Paul Ramsey]

You are playing with Overture data, yes? I am also poking around
there. That error message seems to be on the Parquet read side rather
than the GeoPKG write.

AWS_REGION=us-west-2 AWS_NO_SIGN_REQUEST=YES ./ogrinfo
/vsis3/overturemaps-us-west-2/release/2023-07-26-alpha.0/theme=admins/type=administrativeBoundary/20230725_211237_00132_5p54t_6194f239-f53a-4f7a-a18d-844d65743ec5
Warning 1: Field names of unhandled type map<string,
list<array_element: map<string, string ('array_element')>> ('names')>
ignored
Warning 1: Field sources of unhandled type list<array_element:
map<string, string ('array_element')>> ignored
INFO: Open of `/vsis3/overturemaps-us-west-2/release/2023-07-26-alpha.0/theme=admins/type=administrativeBoundary/20230725_211237_00132_5p54t_6194f239-f53a-4f7a-a18d-844d65743ec5'
      using driver `Parquet' successful.
1: 20230725_211237_00132_5p54t_6194f239-f53a-4f7a-a18d-844d65743ec5

OGR does have StringList and IntegerList types, so we could probably
get some of those fields through to output formats that support it
(like Postgres). It doesn't look like SQLite supports a varchar[] or
integer[] type.

P

On Thu, Jul 27, 2023 at 2:51 PM Scott <public at postholer.com> wrote:
>
> ogr2ogr'ing parquet data to GeoPackage I'm getting the following warnings:
>
> Warning 1: Field names of unhandled type map<string, list<array_element:
> map<string, string ('array_element')>> ('names')> ignored
> Warning 1: Field sources of unhandled type list<array_element:
> map<string, string ('array_element')>> ignored
>
> ...using command:
> ogr2ogr -limit 10 -where "adminlevel = 2 and theme = 'admins'" -nln
> admin -overwrite admin.gpkg
> /vsis3/overturemaps-us-west-2/release/2023-07-26-alpha.0
>
> It would be nice to save these JSON structures in the .gpkg, but I'm not
> sure how to go about it.
>
> Any help would be greatly appreciated!
> Scott
>
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev