[pgrouting-users] osm2pgrouting import problem

Stephen Woodbridge woodbri at swoodbridge.com
Tue Jul 14 17:05:19 EDT 2009 

Kai Behncke wrote:
> Hi Stephen,
> 
> 
>> In case it is not obvious, since you are patch source files you will 
>> need to rebuild the executables and install them in some appropriate
>> place.
> 
> 
> I`m not sure if I understand, you mean, I need to rebuild osm2pgrouting?
> 
> I tried now:
> 
> 1.)Checking out osm2pgrouting 
> from: svn checkout http://pgrouting.postlbs.org/svn/pgrouting/tools/osm2pgrouting/trunk osm2pgrouting
> 
> 2.) make
> 
> (I think, osm2pgrouting doesn`t need a make install ?)

So what make does is compile the source files into an executable

> 3.) patch -p0 -i db.patch in  /home/work/osm2pgrouting

This modifies the source files, but not the executable that you built 
above, so when you run it below are you running the patch code or the 
original code?

> ...should be the steps, no?

Probably not, you need to run make after you patch the files so you are 
compiling the modified source files other wise you are running the 
executable built on the original files and not using the patched files.

-Steve

> Then I started:
> ./osm2pgrouting -file your-OSM-XML-File.osm -conf mapconfig.xml -dbname routing -user postgres
> 
> ...but memory and also swap (after 30 minutes) are increasing extremely high (Memory 98% of 2GB RAM, Swap so far 33% of 7,5 GB).......
> 
> 
> hm.....well, I will wait and see what happens....
> 
> Best regards, Kai
> 
> 
> 
> 
> 
> 
>> make
>> make install
>>
>> might work.
>>
>> -Steve W
>>
>> Kai Behncke wrote:
>>> Hi Anton, 
>>>
>>> thank you one more time :-)
>>>
>>>
>>> With that I got:
>>>
>>> patching file src/OSMDocument.h
>>> patching file src/Export2DB.cpp
>>> patching file src/Export2DB.h
>>> patching file src/osm2pgrouting.cpp
>>> patching file src/OSMDocumentParserCallback.cpp
>>> Hunk #2 FAILED at 46.
>>> Hunk #3 succeeded at 81 (offset -5 lines).
>>> patch: **** malformed patch at line 515: @@ -150,7 +149,7 @@
>>>
>>>
>>> I`m not sure if that malformed patch has any consequences?
>>> I will try to get the germany.data to the routingdb......
>>>
>>> Best regards, Kai
>>>
>>>
>>> -------- Original-Nachricht --------
>>>> Datum: Tue, 14 Jul 2009 18:37:25 +0900
>>>> Von: Anton Patrushev <anton at orkney.co.jp>
>>>> An: pgrouting-users at lists.postlbs.org
>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>>>> Kai,
>>>>
>>>> Try to execute patch -p0 -i db.patch in your  /home/work/osm2pgrouting
>>>>
>>>> Anton.
>>>>
>>>> On Tue, Jul 14, 2009 at 6:27 PM, Kai Behncke<Kai-Behncke at gmx.de> wrote:
>>>>> Hi Anton,
>>>>>
>>>>>
>>>>> thank you very much.
>>>>> This patch-thing is really very new to me, I made a couple of tests
>> but
>>>> without success so far.
>>>>> I have the directory /home/work/osm2pgrouting where I also copied
>>>>> the file db.patch in.
>>>>>
>>>>> Then I tried e.g. "patch /home/work/osm2pgrouting/db.patch"
>>>>>
>>>>> (but after that I only get a blinking cursor and osm2pgrouting works
>>>> still "the old way").
>>>>> Can anybody bring some light into it, please?
>>>>>
>>>>> Thank you again, Kai
>>>>>
>>>>>
>>>>>
>>>>> -------- Original-Nachricht --------
>>>>>> Datum: Tue, 14 Jul 2009 15:36:44 +0900
>>>>>> Von: Anton Patrushev <anton at orkney.co.jp>
>>>>>> An: pgrouting-users at lists.postlbs.org
>>>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>>>>>> Hi Kai,
>>>>>>
>>>>>> No, you need to use patch command.
>>>>>> Here is brief tutorial on how to make and apply patches in Linux.
>>>>>>
>>>>>> http://www.linuxforums.org/articles/using-diff-and-patch_80.html
>>>>>>
>>>>>> Anton.
>>>>>>
>>>>>>
>>>>>> On Tue, Jul 14, 2009 at 3:10 PM, Kai Behncke<Kai-Behncke at gmx.de>
>> wrote:
>>>>>>> Dear Vladislav,
>>>>>>>
>>>>>>>
>>>>>>> thank you very much for that :-)
>>>>>>>
>>>>>>>> fell free to ask any questions,
>>>>>>> My question is: How do I integrate that patch?
>>>>>>> I just rename that file to "OSMDocument.h" and copy it into
>> /core/src
>>>> ?
>>>>>>> And after that I run make, correct?
>>>>>>>
>>>>>>> Thank you very much, Kai
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> -------- Original-Nachricht --------
>>>>>>>> Datum: Tue, 14 Jul 2009 00:02:56 +0400
>>>>>>>> Von: Vladislav Shikhov <vladshikhov at gmail.com>
>>>>>>>> An: Kai Behncke <Kai-Behncke at gmx.de>,
>>>> pgrouting-users at lists.postlbs.org
>>>>>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>>>>>>>> Hello, all.
>>>>>>>>
>>>>>>>> Fist of all I'd like to admit that this patch doesn't solve all the
>>>>>>>> osm2pgroute problems. Please, take it as is.
>>>>>>>> The main idea was to store nodes not in the memory, but in the DB
>>>> and
>>>>>>>> select them on demand.
>>>>>>>> It makes "-clean" arg unusable, but I introduce a new arg "-stage"
>>>>>>>> with values starting from 0 (default). Now you can interrupt
>>>>>>>> osm2pgroute after the message "Split ways" and rerun it again with
>>>>>>>> "-stage 2", it will reuse previously imported nodes.
>>>>>>>>
>>>>>>>> regards,
>>>>>>>> Vladislav Shikhov
>>>>>>>>
>>>>>>>> On Mon, Jul 13, 2009 at 3:24 PM, Kai Behncke<Kai-Behncke at gmx.de>
>>>> wrote:
>>>>>>>>> Hi Vladislav,
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> would you please post your patch via the list, please?
>>>>>>>>> That would be very helpful for us all. :-)
>>>>>>>>>
>>>>>>>>> Thank you very much, Kai
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> -------- Original-Nachricht --------
>>>>>>>>>> Datum: Sun, 12 Jul 2009 21:51:32 +0400
>>>>>>>>>> Von: Vladislav Shikhov <vladshikhov at gmail.com>
>>>>>>>>>> An: Kai Behncke <Kai-Behncke at gmx.de>,
>>>>>> pgrouting-users at lists.postlbs.org
>>>>>>>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>>>>>>>>>> I've made some trivial patches for osm2pgrouting, so now it takes
>>>>>>>>>> about 4 hours to import whole Russia in to DB on 2 cores 2.3 Ghz
>>>>>>>>>> Athlon &1 Gb memory. Switch on you brain, it rather simple.
>>>>>>>>>>
>>>>>>>>>> On Sun, Jul 12, 2009 at 3:59 PM, Kai Behncke<Kai-Behncke at gmx.de>
>>>>>> wrote:
>>>>>>>>>>> Dear users,
>>>>>>>>>>>
>>>>>>>>>>> I tried it as well with the Germany-osm-data (600 MB) on a pc
>>>> with
>>>>>>>>>>> 4 processors, 4 GB RAM and 7GB Swap), but it failed after 14
>>>>>> hours.
>>>>>>>>>>> I trief then to load in single counties (Bundesländer). Always
>>>>>> the
>>>>>>>>>> first one works
>>>>>>>>>>> but after that (e.g. first one is "Hamburg", second one
>>>> "Bremen")
>>>>>>>> only
>>>>>>>>>> nodes are inserted (and no ways). Is this a known error/issue.
>>>>>>>>>>> What would you recommend to get All the data of one country in
>>>> a
>>>>>>>>>> database?
>>>>>>>>>>> Thank you very much, Kai
>>>>>>>>>>> -------- Original-Nachricht --------
>>>>>>>>>>>> Datum: Mon, 29 Jun 2009 09:35:45 +0900
>>>>>>>>>>>> Von: Daniel Kastl <kastl at orkney.co.jp>
>>>>>>>>>>>> An: pgrouting-users at lists.postlbs.org
>>>>>>>>>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>>>>>>>>>>>> Hi Eike,
>>>>>>>>>>>>
>>>>>>>>>>>> You probably run into this issue:
>>>>>>>>>> http://pgrouting.postlbs.org/ticket/140
>>>>>>>>>>>> If you can try it with a smaller dataset for testing and it
>>>>>> worked,
>>>>>>>>>> then
>>>>>>>>>>>> this is the case. If it still doesn't work then please let us
>>>>>> know.
>>>>>>>>>>>> The original author of osm2pgrouting said he's currently
>>>> working
>>>>>> on
>>>>>>>>>> this
>>>>>>>>>>>> issue as time allows.
>>>>>>>>>>>>
>>>>>>>>>>>> Daniel
>>>>>>>>>>>>
>>>>>>>>>>>> PS: Once I tried a little larger dataset I just increased my
>>>> SWAP
>>>>>>>>>>>> partition and it worked then, but I don't know how large the
>>>>>> German
>>>>>>>>>> data
>>>>>>>>>>>> is. It's not a nice solution anyway.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Eike Lüders schrieb:
>>>>>>>>>>>>> Hello everybody!
>>>>>>>>>>>>>
>>>>>>>>>>>>> I've got a problem with osm2pgrouting.
>>>>>>>>>>>>> I downloaded the osm file for germany from here:
>>>>>>>>>>>>> http://download.geofabrik.de/osm/europe/germany.osm.bz2
>>>>>>>>>>>>> If I try to run osm2pgrouting on it now by typing
>>>>>>>>>>>>>
>>>>>>>>>>>>> ./osm2pgrouting -file germany.osm -conf mapconfig.xml
>>>> -dbname
>>>>>>>> routing
>>>>>>>>>>>>> -user postgres -passwd postgres -clean
>>>>>>>>>>>>>
>>>>>>>>>>>>> into the shell it gives me the following information, but
>>>>>> nothing
>>>>>>>>>>>>> happes (the db information above are correct!).
>>>>>>>>>>>>>
>>>>>>>>>>>>> There is no error message or something like that.
>>>>>>>>>>>>>
>>>>>>>>>>>>> I hope anybody know how to solve this problem.
>>>>>>>>>>>>>
>>>>>>>>>>>>> host=127.0.0.1 user=postgres dbname=routing port=5432
>>>>>>>>>> password=postgres
>>>>>>>>>>>>> connection success
>>>>>>>>>>>>> Trying to load config file mapconfig.xml
>>>>>>>>>>>>> Trying to parse config
>>>>>>>>>>>>> SE for <configuration>
>>>>>>>>>>>>> SE for <type>
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = motorway
>>>>>>>>>>>>> class id = 101
>>>>>>>>>>>>> class id = 101 name = motorway added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = motorway_link
>>>>>>>>>>>>> class id = 102
>>>>>>>>>>>>> class id = 102 name = motorway_link added to type
>>>> name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = motorway_junction
>>>>>>>>>>>>> class id = 103
>>>>>>>>>>>>> class id = 103 name = motorway_junction added to type
>>>>>> name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = trunk
>>>>>>>>>>>>> class id = 104
>>>>>>>>>>>>> class id = 104 name = trunk added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = trunk_link
>>>>>>>>>>>>> class id = 105
>>>>>>>>>>>>> class id = 105 name = trunk_link added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = primary
>>>>>>>>>>>>> class id = 106
>>>>>>>>>>>>> class id = 106 name = primary added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = primary_link
>>>>>>>>>>>>> class id = 107
>>>>>>>>>>>>> class id = 107 name = primary_link added to type
>>>> name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = secondary
>>>>>>>>>>>>> class id = 106
>>>>>>>>>>>>> class id = 106 name = secondary added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = tertiary
>>>>>>>>>>>>> class id = 107
>>>>>>>>>>>>> class id = 107 name = tertiary added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = residential
>>>>>>>>>>>>> class id = 107
>>>>>>>>>>>>> class id = 107 name = residential added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = living_street
>>>>>>>>>>>>> class id = 108
>>>>>>>>>>>>> class id = 108 name = living_street added to type
>>>> name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = service
>>>>>>>>>>>>> class id = 109
>>>>>>>>>>>>> class id = 109 name = service added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = track
>>>>>>>>>>>>> class id = 110
>>>>>>>>>>>>> class id = 110 name = track added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = pedestrian
>>>>>>>>>>>>> class id = 111
>>>>>>>>>>>>> class id = 111 name = pedestrian added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = services
>>>>>>>>>>>>> class id = 112
>>>>>>>>>>>>> class id = 112 name = services added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = bus_guideway
>>>>>>>>>>>>> class id = 113
>>>>>>>>>>>>> class id = 113 name = bus_guideway added to type
>>>> name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = path
>>>>>>>>>>>>> class id = 114
>>>>>>>>>>>>> class id = 114 name = path added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = cicleway
>>>>>>>>>>>>> class id = 115
>>>>>>>>>>>>> class id = 115 name = cicleway added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = footway
>>>>>>>>>>>>> class id = 116
>>>>>>>>>>>>> class id = 116 name = footway added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = bridleway
>>>>>>>>>>>>> class id = 117
>>>>>>>>>>>>> class id = 117 name = bridleway added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = byway
>>>>>>>>>>>>> class id = 118
>>>>>>>>>>>>> class id = 118 name = byway added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = steps
>>>>>>>>>>>>> class id = 119
>>>>>>>>>>>>> class id = 119 name = steps added to type name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = unclassified
>>>>>>>>>>>>> class id = 100
>>>>>>>>>>>>> class id = 100 name = unclassified added to type
>>>> name=highway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = road
>>>>>>>>>>>>> class id = 100
>>>>>>>>>>>>> class id = 100 name = road added to type name=highway
>>>>>>>>>>>>> SE for <type>
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = lane
>>>>>>>>>>>>> class id = 201
>>>>>>>>>>>>> class id = 201 name = lane added to type name=cycleway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = track
>>>>>>>>>>>>> class id = 202
>>>>>>>>>>>>> class id = 202 name = track added to type name=cycleway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = opposite_lane
>>>>>>>>>>>>> class id = 203
>>>>>>>>>>>>> class id = 203 name = opposite_lane added to type
>>>> name=cycleway
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = opposite
>>>>>>>>>>>>> class id = 204
>>>>>>>>>>>>> class id = 204 name = opposite added to type name=cycleway
>>>>>>>>>>>>> SE for <type>
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = grade1
>>>>>>>>>>>>> class id = 301
>>>>>>>>>>>>> class id = 301 name = grade1 added to type name=tracktype
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = grade2
>>>>>>>>>>>>> class id = 302
>>>>>>>>>>>>> class id = 302 name = grade2 added to type name=tracktype
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = grade3
>>>>>>>>>>>>> class id = 303
>>>>>>>>>>>>> class id = 303 name = grade3 added to type name=tracktype
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = grade4
>>>>>>>>>>>>> class id = 304
>>>>>>>>>>>>> class id = 304 name = grade4 added to type name=tracktype
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = grade5
>>>>>>>>>>>>> class id = 305
>>>>>>>>>>>>> class id = 305 name = grade5 added to type name=tracktype
>>>>>>>>>>>>> SE for <type>
>>>>>>>>>>>>> SE for <class>
>>>>>>>>>>>>> class name = roundabout
>>>>>>>>>>>>> class id = 401
>>>>>>>>>>>>> class id = 401 name = roundabout added to type name=junction
>>>>>>>>>>>>> Trying to load data
>>>>>>>>>>>>> Trying to parse data
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Kind regards
>>>>>>>>>>>>> Eike Lüders
>>>>>>>>>>>>>
>> ------------------------------------------------------------------------
>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>> Pgrouting-users mailing list
>>>>>>>>>>>>> Pgrouting-users at lists.postlbs.org
>>>>>>>>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>>>>>>>>>>>>>
>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>> Pgrouting-users mailing list
>>>>>>>>>>>> Pgrouting-users at lists.postlbs.org
>>>>>>>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>>>>>>>>>>> --
>>>>>>>>>>> Neu: GMX Doppel-FLAT mit Internet-Flatrate + Telefon-Flatrate
>>>>>>>>>>> für nur 19,99 Euro/mtl.!* http://portal.gmx.net/de/go/dsl02
>>>>>>>>>>> _______________________________________________
>>>>>>>>>>> Pgrouting-users mailing list
>>>>>>>>>>> Pgrouting-users at lists.postlbs.org
>>>>>>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>>>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
>>>>>>>>> Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
>>>>>>>>>
>>>>>>> --
>>>>>>> GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
>>>>>>> Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
>>>>>>> _______________________________________________
>>>>>>> Pgrouting-users mailing list
>>>>>>> Pgrouting-users at lists.postlbs.org
>>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>>>>>>>
>>>>>> _______________________________________________
>>>>>> Pgrouting-users mailing list
>>>>>> Pgrouting-users at lists.postlbs.org
>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>>>>> --
>>>>> GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
>>>>> Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
>>>>>
>>>> _______________________________________________
>>>> Pgrouting-users mailing list
>>>> Pgrouting-users at lists.postlbs.org
>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>

More information about the Pgrouting-users mailing list