[gdal-dev] Parquet and nest structures (JSON)

[Scott]

Thanks for the response Paul!

Yes, it's overture. I never considered the sqlite data types. Thanks for 
the tip, I'll keep poking around.


On 7/28/23 14:46, Paul Ramsey wrote:
> You are playing with Overture data, yes? I am also poking around
> there. That error message seems to be on the Parquet read side rather
> than the GeoPKG write.
> 
> AWS_REGION=us-west-2 AWS_NO_SIGN_REQUEST=YES ./ogrinfo
> /vsis3/overturemaps-us-west-2/release/2023-07-26-alpha.0/theme=admins/type=administrativeBoundary/20230725_211237_00132_5p54t_6194f239-f53a-4f7a-a18d-844d65743ec5
> Warning 1: Field names of unhandled type map<string,
> list<array_element: map<string, string ('array_element')>> ('names')>
> ignored
> Warning 1: Field sources of unhandled type list<array_element:
> map<string, string ('array_element')>> ignored
> INFO: Open of `/vsis3/overturemaps-us-west-2/release/2023-07-26-alpha.0/theme=admins/type=administrativeBoundary/20230725_211237_00132_5p54t_6194f239-f53a-4f7a-a18d-844d65743ec5'
>        using driver `Parquet' successful.
> 1: 20230725_211237_00132_5p54t_6194f239-f53a-4f7a-a18d-844d65743ec5
> 
> OGR does have StringList and IntegerList types, so we could probably
> get some of those fields through to output formats that support it
> (like Postgres). It doesn't look like SQLite supports a varchar[] or
> integer[] type.
> 
> P
> 
> On Thu, Jul 27, 2023 at 2:51 PM Scott <public at postholer.com> wrote:
>>
>> ogr2ogr'ing parquet data to GeoPackage I'm getting the following warnings:
>>
>> Warning 1: Field names of unhandled type map<string, list<array_element:
>> map<string, string ('array_element')>> ('names')> ignored
>> Warning 1: Field sources of unhandled type list<array_element:
>> map<string, string ('array_element')>> ignored
>>
>> ...using command:
>> ogr2ogr -limit 10 -where "adminlevel = 2 and theme = 'admins'" -nln
>> admin -overwrite admin.gpkg
>> /vsis3/overturemaps-us-west-2/release/2023-07-26-alpha.0
>>
>> It would be nice to save these JSON structures in the .gpkg, but I'm not
>> sure how to go about it.
>>
>> Any help would be greatly appreciated!
>> Scott
>>
>> _______________________________________________
>> gdal-dev mailing list
>> gdal-dev at lists.osgeo.org
>> https://lists.osgeo.org/mailman/listinfo/gdal-dev