[pgrouting-users] osm_relations table does not get populated

Imre Samu pella.samu at gmail.com
Mon Jun 5 03:45:26 PDT 2023 

> 1. It seems that by default osm2pgrouting will only store those
osm_relations that are related to routes and that contain "highway"-tagged
ways, is this correct?

In my opinion, yes. (But please note that I'm just a user.)

> 2. Is it possible to edit mapconfig.xml to include other, non-highway
relations?

check the
https://github.com/pgRouting/osm2pgrouting/blob/main/mapconfig_for_bicycles.xml
- cycleway
- cycleway:right
- cycleway:left
- tracktype
- highway

If you want to include non-route related data, such as Points of Interest
(POIs), borders, and so on, I recommend using https://osm2pgsql.org/.
This tool can also be a useful way to verify the functioning of the
osm2pgrouting program.

If you're finding that a route is present in the osm2pgsql tables but not
in the osm2pgrouting ones, it's likely that you need to adjust the
configuration.
There can be a wide variety of 'highway=' values, as OSM editors can use
any key-value pair.
You can see a list of these values at
https://taginfo.openstreetmap.org/keys/highway#values.

Sometimes, an extract might not contain all parts of an extremely long
relation, which means it won't be imported.
In such cases, osm2pgsql also won't import it. This situation can help you
identify potential data issues.

Be aware that there's a known issue with osm2pgrouting ;
If you're using it, consider increasing the value of the "--chunk"
parameter.   ( --chunk 10000000 )
https://github.com/pgRouting/osm2pgrouting/issues/296

Regards,
  Imre


Tokura Gou <tokura.gou at gmail.com> ezt írta (időpont: 2023. jún. 5., H,
11:20):

> Hello Imre,
>
> Thanks for your comment.
>
> I will test with another data set.
>
> Meanwhile, may I ask:
>
> 1. It seems that by default osm2pgrouting will only store those
> osm_relations that are related to routes and that contain "highway"-tagged
> ways, is this correct?
> 2. Is it possible to edit mapconfig.xml to include other, non-highway
> relations?
>
>
> Thank you.
>
> On Sun, Jun 4, 2023 at 4:21 PM Imre Samu <pella.samu at gmail.com> wrote:
>
>> Hello,
>>
>> In the data file you've provided, named
>> 'haywards-heath-uk-small-extract.txt',
>> there are 8 OpenStreetMap (OSM) relation objects [2]
>> that are marked as either 'boundary=*' or 'landuse=residential'.
>> It appears that none of these are related to routes or are included in
>> the 'mapconfig.xml' [1] file.
>>
>> Could you please specify which OSM relation you're missing from your
>> table?
>>
>> Could you also test it with another input data set?  Specifically, one
>> that includes a 'highway=*' osm relation in the extract.
>>
>> [1] https://github.com/pgRouting/osm2pgrouting/blob/main/mapconfig.xml
>> [2] osmium cat haywards-heath-uk-small-extract.osm.xml -t relation  -f
>> opl | cut -d' ' -f8
>> [3] https://taginfo.openstreetmap.org/keys/highway#overview
>>
>> Regards,
>>   Imre
>>
>>
>> Tokura Gou <tokura.gou at gmail.com> ezt írta (időpont: 2023. jún. 3., Szo,
>> 19:11):
>>
>>> Hello Vicky and thanks for your response,
>>>
>>> Maybe due to formatting issues the data and the command were not visible.
>>>
>>>
>>> 1. Data:
>>> https://github.com/pgRouting/osm2pgrouting/files/11598959/haywards-heath-uk-small-extract.txt
>>> 2. Exact command: osm2pgrouting -f home/map.osm -c
>>> "/usr/local/share/osm2pgrouting/mapconfig.xml" -d city_routing -U
>>> [username] -W [password] --clean --tags --addnodes
>>>
>>>
>>> On Fri, Jun 2, 2023 at 6:25 PM Vicky Vergara <vicky at erosion.dev> wrote:
>>>
>>>> Hello,
>>>> I can not reproduce your problem:
>>>> What is needed:
>>>> 1) The exact data that has been used, can be in the form of a link to a
>>>> shared file, the wget command to download from osm.
>>>> 2) the exact command that is been used (use mylogin and mypass instead
>>>> of the real ones when posting the command)
>>>>
>>>> Regards
>>>> Vicky
>>>>
>>>>
>>>> On Fri, Jun 2, 2023 at 3:52 AM Tokura Gou <tokura.gou at gmail.com> wrote:
>>>>
>>>>> *Problem*
>>>>>
>>>>> When running osm2pgrouting on a typical .osm file with the --addnodes
>>>>> option, osm_relations table stays empty.
>>>>>
>>>>> *To Reproduce*
>>>>>
>>>>> osm2pgrouting -f home/map.osm -c "/usr/local/share/osm2pgrouting/mapconfig.xml" -d city_routing -U [username] -W [password] --clean --tags --addnodes
>>>>>
>>>>> *Expectation*
>>>>>
>>>>> I use the --addnodes flag as per the documentation and I can see that
>>>>> osm_nodes and osm_ways tables do get populated. However, osm_relations
>>>>>  has 0 records after running osm2pgrouting and "Final osm_relations:"
>>>>> is never mentioned in the output:
>>>>>
>>>>> Creating tables...
>>>>> TABLE: ways_vertices_pgr created ... OK.
>>>>> TABLE: ways created ... OK.
>>>>> TABLE: pointsofinterest created ... OK.
>>>>> TABLE: configuration created ... OK.
>>>>> TABLE: osm_nodes created ... OK.
>>>>> TABLE: osm_ways created ... OK.
>>>>> TABLE: osm_relations created ... OK.
>>>>> Opening configuration file: /usr/local/share/osm2pgrouting/mapconfig.xml
>>>>>     Parsing configuration
>>>>>
>>>>> Exporting configuration ...
>>>>>   - Done
>>>>> Counting lines ...
>>>>>   - Done
>>>>> Opening data file: home/map.osm  total lines: 175957
>>>>>     Parsing data
>>>>>
>>>>> Current osm_nodes:      48000
>>>>> Final osm_nodes:        48375
>>>>> Current osm_ways:       6000
>>>>> Final osm_ways:         6320
>>>>>
>>>>> ...
>>>>>
>>>>> End Of file
>>>>>
>>>>>
>>>>>     Finish Parsing data
>>>>>
>>>>> Adding auxiliary tables to database...
>>>>>
>>>>> Export Ways ...
>>>>>
>>>>> ...
>>>>>
>>>>> Creating indexes ...
>>>>>
>>>>> Processing Points of Interest ...
>>>>>
>>>>> Adding functions for processing Points of Interest ...
>>>>>
>>>>> To process pointsOfInterest table:
>>>>> osm2pgr_pois_update(radius default 200, within default 50)
>>>>>
>>>>>   - Using areas of (radius)mts on POIS
>>>>>   - Using edges that are at least (within) mts of each POI
>>>>> POIS that do not have a closest edge is considered as too far
>>>>> #########################
>>>>> size of streets: 6320
>>>>> Execution started at: Tue May 30 10:07:09 2023
>>>>> Execution ended at:   Tue May 30 10:07:21 2023
>>>>> Elapsed time: 11.767 Seconds.
>>>>> User CPU time: -> 1.12268 seconds
>>>>>
>>>>> *Sample Data*
>>>>>
>>>>> A sample .osm file is attached (please rename from txt to osm if
>>>>> needed), however I have tried other .osm exports that contain osm relations
>>>>> with the same result.
>>>>>
>>>>> haywards-heath-uk-small-extract.txt
>>>>> <https://github.com/pgRouting/osm2pgrouting/files/11598959/haywards-heath-uk-small-extract.txt>
>>>>>
>>>>> *Platform/versions*
>>>>>
>>>>> SELECT version();
>>>>>
>>>>> PostgreSQL 15.3 (Debian 15.3-1.pgdg110+1) on x86_64-pc-linux-gnu, compiled by gcc (Debian 10.2.1-6) 10.2.1 20210110, 64-bit
>>>>>
>>>>>
>>>>> SELECT postgis_full_version();
>>>>>
>>>>> POSTGIS="3.3.2 4975da8" [EXTENSION] PGSQL="150" GEOS="3.9.0-CAPI-1.16.2" PROJ="7.2.1" LIBXML="2.9.10" LIBJSON="0.15" LIBPROTOBUF="1.3.3" WAGYU="0.5.0 (Internal)"
>>>>>
>>>>>
>>>>> SELECT pgr_version();
>>>>>
>>>>>
>>>>> 3.4.1
>>>>>
>>>>> _______________________________________________
>>>>> Pgrouting-users mailing list
>>>>> Pgrouting-users at lists.osgeo.org
>>>>> https://lists.osgeo.org/mailman/listinfo/pgrouting-users
>>>>>
>>>> _______________________________________________
>>>> Pgrouting-users mailing list
>>>> Pgrouting-users at lists.osgeo.org
>>>> https://lists.osgeo.org/mailman/listinfo/pgrouting-users
>>>>
>>> _______________________________________________
>>> Pgrouting-users mailing list
>>> Pgrouting-users at lists.osgeo.org
>>> https://lists.osgeo.org/mailman/listinfo/pgrouting-users
>>>
>> _______________________________________________
>> Pgrouting-users mailing list
>> Pgrouting-users at lists.osgeo.org
>> https://lists.osgeo.org/mailman/listinfo/pgrouting-users
>>
> _______________________________________________
> Pgrouting-users mailing list
> Pgrouting-users at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/pgrouting-users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/pgrouting-users/attachments/20230605/7415e9fe/attachment-0001.htm>

More information about the Pgrouting-users mailing list