[OSGeoJapan-discuss] Integration of Japanese GIS formats into mainline GDAL ?
Ko Nagase
nagase ＠ georepublic.co.jp
2015年 7月 20日 (月) 07:44:54 PDT
Hi Even,
Thanks for quick response and creating the ticket.
I made a mistake in list No.3 item name (not "FGD driver", but "FGD
ogr driver"),
so I fixed it on the ticket.
https://trac.osgeo.org/gdal/ticket/6046#comment:2
Regards,
Ko
2015-07-20 23:23 GMT+09:00 Even Rouault <even.rouault ＠ spatialys.com>:
> Ko-san,
>
> Thanks a lot for bringing some light on this.
>
> I've created https://trac.osgeo.org/gdal/ticket/6046 to capture all findings up
> to now and trace tasks that I've in mind that should be completed for
> integretation into upstream GDAL.
>
> Best regards,
>
> Even
>
>> Hi Even,
>> CC: Hiroo-san, Yamate-san, list
>>
>> Excuse me for cutting in this topic.
>>
>> I am neither the developer nor the player, but I tried mext_gdal
>> test version (gdal110_test.zip) at last weekend and probably I understood
>> some data related part, so I mention some of your question about datas.
>> (But, if someone find my mistake, please point it out here...)
>>
>> 2015-05-01 18:59 GMT+09:00 Even Rouault <even.rouault ＠ spatialys.com>:
>> > I tried the FGD ogr driver on the file
>> > https://github.com/msherry/PyXB-1.1.4/blob/master/examples/unicode_jp/dat
>> > a/shift_jis/FG- GML-13-RailCL25000-20080331-0001.xml
>> > (found by googling FG-GML)
>> >
>> > It is not recognized by the driver. Looking more closely, the driver
>> > seems to expect a <GI> element that isn't found in that file. It appears
>> > that there are several versions of FGD GML, right ? The above file is
>> > apparently v3 (since there's a v3 schema next to it). Perhaps the driver
>> > is v4 (or a previous version) ? I tried to remove the test for the
>> > presence of <GI> but it crashes later during parsing of dates,
>> > apparently not liking the <gml:timePosition> element within <lfSpanFr>
>>
>> There are 2 format types (DLD / GML), 2 recent versions(v3 / v4)
>> and 2 (or more) data types (5/10m mesh DEM / General vector data .etc)
>> in FGD data,
>> and current mext_gdal test version seems to support the following pair.
>>
>> =====
>> 1. FGD driver: DLD v3 (5/10m mesh DEM)
>> 2. FG-GML driver: GML v3 (5/10m mesh DEM)
>> 3. FGD driver: DLD v3 (General vector data)
>> =====
>>
>> Above link which you found use GML v3, but it is not 5/10m mesh DEM,
>> so you couldn't convert it.
>>
>> > I found this project :
>> > http://mizutuu.github.io/jpgisgmlv4togml-converter/ /
>> > https://github.com/mizutuu/jpgisgmlv4togml-converter
>> > It includes the schema for FG-GML v4 and I can't see any reference to the
>> > <GI> element in it either.
>> > With some trickery related to encoding conversion, I managed to use that
>> > project to produce a standard GML file that the OGR GML driver handles
>> > well :
>> >
>> > cat FG-GML-13-RailCL25000-20080331-0001.xml | iconv --from-code=shift-jis
>> > -- to-code=utf-8 | sed "s/Shift_JIS/UTF-8/" | python jpgisgml2gml.py >
>> > out.gml
>>
>> And above GML v4 is not supported (both of 5/10m mesh DEM and
>> General vector data) by current mext_gdal for now.
>>
>> > I've also found this site http://nlftp.mlit.go.jp/ksj-e/ and downloaded a
>> > few datasets. Those I tried are not handled by the OGR FGD driver. Some
>> > of them look like GML with a particular application schema. They are
>> > unfortunately not standard enough for the OGR GML driver to understand
>> > them out of the box, although I believe it could be tweaked to parse
>> > them. Their header look like:
>> >
>> > <ksj:Dataset gml:id="A09Dataset"
>> > xmlns:ksj="http://nlftp.mlit.go.jp/ksj/schemas/ksj-app"
>> > xmlns:gml="http://www.opengis.net/gml/3.2"
>> > xmlns:xlink="http://www.w3.org/1999/xlink" xm
>> > lns:xsi="http://www.w3.org/2001/XMLSchema-instance"
>> > xsi:schemaLocation="http://nlftp.mlit.go.jp/ksj/schemas/ksj-app
>> > KsjAppSchema- A09-v3_1.xsd">
>> >
>> > There's a shapefile next to them, with apparently same content.
>>
>> And about above MLIT NLNI(National Land Numerical Information) data,
>> it is not FGD data...
>>
>> > So it appears there's a variety of GML-like formats ;-)
>>
>> Yes, sure...
>>
>> If you want to use mext_gdal test data, I just uploaded example dummy data
>> to the following repository. So, please try to use those files.
>> https://github.com/sanak/dev-notes/tree/master/datas/fgd
>> (The dummy data location is near by Japan Wakayama prefecture,
>> but on the pacific ocean.)
>>
>> Regards,
>>
>> >> Hi Even,
>> >>
>> >> I talk to Yamate-san who has been working on those three drivers. He
>> >> explained that each driver has little bit different copy right
>> >> background he need to resolve before he can merge them to the main.
>> >>
>> >> The first one, FGD driver, which he wrote for a project and he does not
>> >> have control on its copy right. So, he would like to leave it at this
>> >> moment.
>> >>
>> >> For the second one, FG-GML driver, he wrote it and he owns its copy
>> >> right at this moment. But he said he can release with the licence you
>> >> suggested.
>> >>
>> >> The last one, FGD ogr driver, which he also wrote and it is highly
>> >> possible he can release it under the MIT licence. But he need to make
>> >> sure his client can agree on this. So, he said he will contact to his
>> >> client.
>> >>
>> >> So, the last two drivers can be merge into the main GDAL driver. It is
>> >> little bit confusing background but I am sure we can sort these out.
>> >>
>> >> I will let you know when he is ready to work with you.
>> >>
>> >> Thanks!
>> >>
>> >> Hiroo
>> >>
>> >> On Thu, Apr 30, 2015 at 2:26 PM, Hiroo Imaki <hiroo ＠ angeli.org> wrote:
>> >> > Hi Even,
>> >> >
>> >> > I am not the developer but he and I working at a same company. If he
>> >> > can agree on the license and release his efforts, that would be
>> >> > wonderful for all Japanese data uses.
>> >> >
>> >> > He hesitates writing his message in English. So, I can be a translator
>> >> > between you guys. I hope no lost in translation!
>> >> >
>> >> > I will get back to you once I hear from him.
>> >> >
>> >> > Hiroo
>> >> >
>> >> > On Thu, Apr 30, 2015 at 10:45 AM, Even Rouault
>> >> > <even.rouault ＠ spatialys.com
>> >> >
>> >> > > wrote:
>> >> >> Hi,
>> >> >>
>> >> >> Sorry for writing in English, but I don't unfortunately speak
>> >> >> Japanese.
>> >> >>
>> >> >> I'm one of the GDAL developers.
>> >> >>
>> >> >> I've noticed that there are "un-official" versions of GDAL floating
>> >> >> around, with
>> >> >> a few drivers for new Japanese-specific formats. I was wondering if
>> >> >> there was a
>> >> >> reason to keep them outside of the official GDAL tree ? Integrating
>> >> >> them into
>> >> >> mainline GDAL would probably make life of Japanese users easier. GDAL
>> >> >> has already support for a lof of national specific formats, mainly in
>> >> >> Europe and
>> >> >> North America. Would be cool for Asia to join in ;-)
>> >> >>
>> >> >> In a recent discussion thread, the following link is mentionned:
>> >> >> https://www.dropbox.com/s/4oyhncknavdk2if/gdal110_test.zip
>> >> >>
>> >> >> I can see that it contains 2 new GDAL drivers ( FGD: Japanese
>> >> >> Fundamental Geographic Data (.xml) & FG-GML : Japanese Fundamental
>> >> >> Geographic Data GML(.xml) ) and one OGR driver (FGD).
>> >> >> Unfortunatelly there's no author or copyright information in the
>> >> >> header of the
>> >> >> corresponding source files. Would their author(s) be willing to
>> >> >> release them
>> >> >> under the X/MIT license and contribute them to the mainline GDAL
>> >> >> project ? Perhaps some test files to write minimalistic regressions
>> >> >> tests would be useful.
>> >> >>
>> >> >> Let me know if I can be useful for anything. I can also help for
>> >> >> writing new
>> >> >> drivers if needed.
>> >> >>
>> >> >> Best regards,
>> >> >>
>> >> >> Even
>> >> >>
>> >> >> --
>> >> >> Spatialys - Geospatial professional services
>> >> >> http://www.spatialys.com
>> >> >> _______________________________________________
>> >> >> OSGeoJapan-discuss mailing list
>> >> >> OSGeoJapan-discuss ＠ lists.osgeo.org
>> >> >> http://lists.osgeo.org/mailman/listinfo/osgeojapan-discuss
>> >> >
>> >> > --
>> >> > Hiroo Imaki
>> >> > Pacific Spatial Solutions, LLC
>> >> > 1523 Chatham Colony Ct.
>> >> > Reston, VA 20190
>> >> > hiroo.imaki ＠ pacificspatial.com
>> >> > http://www.pacificspatial.com
>> >> > http://www.geopacific.org (GIS info site)
>> >> > hiroo ＠ angeli.org (private)
>> >
>> > --
>> > Spatialys - Geospatial professional services
>> > http://www.spatialys.com
>> > _______________________________________________
>> > OSGeoJapan-discuss mailing list
>> > OSGeoJapan-discuss ＠ lists.osgeo.org
>> > http://lists.osgeo.org/mailman/listinfo/osgeojapan-discuss
>
> --
> Spatialys - Geospatial professional services
> http://www.spatialys.com
--
Ko Nagase (長瀬 興)
Georepublic Japan
mail: nagase ＠ georepublic.co.jp
web: http://georepublic.co.jp
OSGeoJapan-discuss メーリングリストの案内