[pgrouting-users] osm2pgrouting import problem

Vladislav Shikhov vladshikhov at gmail.com
Wed Jul 15 01:23:22 EDT 2009


Hi Kai,

you should:

1. svn checkout -r 334
http://pgrouting.postlbs.org/svn/pgrouting/tools/osm2pgrouting/trunk
osm2pgrouting
2. copy someway a patch from this email into osm2pgrouting just created
3. cd into osm2pgrouting
4. patch -p0 -i db.patch
5. make

On Tue, Jul 14, 2009 at 9:26 PM, Kai Behncke<Kai-Behncke at gmx.de> wrote:
> Hi Stephen,
>
>
>>
>> In case it is not obvious, since you are patch source files you will
>> need to rebuild the executables and install them in some appropriate
>> place.
>
>
> I`m not sure if I understand, you mean, I need to rebuild osm2pgrouting?
>
> I tried now:
>
> 1.)Checking out osm2pgrouting
> from: svn checkout http://pgrouting.postlbs.org/svn/pgrouting/tools/osm2pgrouting/trunk osm2pgrouting
>
> 2.) make
>
> (I think, osm2pgrouting doesn`t need a make install ?)
>
> 3.) patch -p0 -i db.patch in  /home/work/osm2pgrouting
>
> ...should be the steps, no?
>
> Then I started:
> ./osm2pgrouting -file your-OSM-XML-File.osm -conf mapconfig.xml -dbname routing -user postgres
>
> ...but memory and also swap (after 30 minutes) are increasing extremely high (Memory 98% of 2GB RAM, Swap so far 33% of 7,5 GB).......
>
>
> hm.....well, I will wait and see what happens....
>
> Best regards, Kai
>
>
>
>
>
>
>>
>> make
>> make install
>>
>> might work.
>>
>> -Steve W
>>
>> Kai Behncke wrote:
>> > Hi Anton,
>> >
>> > thank you one more time :-)
>> >
>> >
>> > With that I got:
>> >
>> > patching file src/OSMDocument.h
>> > patching file src/Export2DB.cpp
>> > patching file src/Export2DB.h
>> > patching file src/osm2pgrouting.cpp
>> > patching file src/OSMDocumentParserCallback.cpp
>> > Hunk #2 FAILED at 46.
>> > Hunk #3 succeeded at 81 (offset -5 lines).
>> > patch: **** malformed patch at line 515: @@ -150,7 +149,7 @@
>> >
>> >
>> > I`m not sure if that malformed patch has any consequences?
>> > I will try to get the germany.data to the routingdb......
>> >
>> > Best regards, Kai
>> >
>> >
>> > -------- Original-Nachricht --------
>> >> Datum: Tue, 14 Jul 2009 18:37:25 +0900
>> >> Von: Anton Patrushev <anton at orkney.co.jp>
>> >> An: pgrouting-users at lists.postlbs.org
>> >> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>> >
>> >> Kai,
>> >>
>> >> Try to execute patch -p0 -i db.patch in your  /home/work/osm2pgrouting
>> >>
>> >> Anton.
>> >>
>> >> On Tue, Jul 14, 2009 at 6:27 PM, Kai Behncke<Kai-Behncke at gmx.de> wrote:
>> >>> Hi Anton,
>> >>>
>> >>>
>> >>> thank you very much.
>> >>> This patch-thing is really very new to me, I made a couple of tests
>> but
>> >> without success so far.
>> >>>
>> >>> I have the directory /home/work/osm2pgrouting where I also copied
>> >>> the file db.patch in.
>> >>>
>> >>> Then I tried e.g. "patch /home/work/osm2pgrouting/db.patch"
>> >>>
>> >>> (but after that I only get a blinking cursor and osm2pgrouting works
>> >> still "the old way").
>> >>> Can anybody bring some light into it, please?
>> >>>
>> >>> Thank you again, Kai
>> >>>
>> >>>
>> >>>
>> >>> -------- Original-Nachricht --------
>> >>>> Datum: Tue, 14 Jul 2009 15:36:44 +0900
>> >>>> Von: Anton Patrushev <anton at orkney.co.jp>
>> >>>> An: pgrouting-users at lists.postlbs.org
>> >>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>> >>>> Hi Kai,
>> >>>>
>> >>>> No, you need to use patch command.
>> >>>> Here is brief tutorial on how to make and apply patches in Linux.
>> >>>>
>> >>>> http://www.linuxforums.org/articles/using-diff-and-patch_80.html
>> >>>>
>> >>>> Anton.
>> >>>>
>> >>>>
>> >>>> On Tue, Jul 14, 2009 at 3:10 PM, Kai Behncke<Kai-Behncke at gmx.de>
>> wrote:
>> >>>>> Dear Vladislav,
>> >>>>>
>> >>>>>
>> >>>>> thank you very much for that :-)
>> >>>>>
>> >>>>>> fell free to ask any questions,
>> >>>>> My question is: How do I integrate that patch?
>> >>>>> I just rename that file to "OSMDocument.h" and copy it into
>> /core/src
>> >> ?
>> >>>>> And after that I run make, correct?
>> >>>>>
>> >>>>> Thank you very much, Kai
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>>
>> >>>>> -------- Original-Nachricht --------
>> >>>>>> Datum: Tue, 14 Jul 2009 00:02:56 +0400
>> >>>>>> Von: Vladislav Shikhov <vladshikhov at gmail.com>
>> >>>>>> An: Kai Behncke <Kai-Behncke at gmx.de>,
>> >> pgrouting-users at lists.postlbs.org
>> >>>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>> >>>>>> Hello, all.
>> >>>>>>
>> >>>>>> Fist of all I'd like to admit that this patch doesn't solve all the
>> >>>>>> osm2pgroute problems. Please, take it as is.
>> >>>>>> The main idea was to store nodes not in the memory, but in the DB
>> >> and
>> >>>>>> select them on demand.
>> >>>>>> It makes "-clean" arg unusable, but I introduce a new arg "-stage"
>> >>>>>> with values starting from 0 (default). Now you can interrupt
>> >>>>>> osm2pgroute after the message "Split ways" and rerun it again with
>> >>>>>> "-stage 2", it will reuse previously imported nodes.
>> >>>>>>
>> >>>>>> regards,
>> >>>>>> Vladislav Shikhov
>> >>>>>>
>> >>>>>> On Mon, Jul 13, 2009 at 3:24 PM, Kai Behncke<Kai-Behncke at gmx.de>
>> >> wrote:
>> >>>>>>> Hi Vladislav,
>> >>>>>>>
>> >>>>>>>
>> >>>>>>> would you please post your patch via the list, please?
>> >>>>>>> That would be very helpful for us all. :-)
>> >>>>>>>
>> >>>>>>> Thank you very much, Kai
>> >>>>>>>
>> >>>>>>>
>> >>>>>>> -------- Original-Nachricht --------
>> >>>>>>>> Datum: Sun, 12 Jul 2009 21:51:32 +0400
>> >>>>>>>> Von: Vladislav Shikhov <vladshikhov at gmail.com>
>> >>>>>>>> An: Kai Behncke <Kai-Behncke at gmx.de>,
>> >>>> pgrouting-users at lists.postlbs.org
>> >>>>>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>> >>>>>>>> I've made some trivial patches for osm2pgrouting, so now it takes
>> >>>>>>>> about 4 hours to import whole Russia in to DB on 2 cores 2.3 Ghz
>> >>>>>>>> Athlon &1 Gb memory. Switch on you brain, it rather simple.
>> >>>>>>>>
>> >>>>>>>> On Sun, Jul 12, 2009 at 3:59 PM, Kai Behncke<Kai-Behncke at gmx.de>
>> >>>> wrote:
>> >>>>>>>>> Dear users,
>> >>>>>>>>>
>> >>>>>>>>> I tried it as well with the Germany-osm-data (600 MB) on a pc
>> >> with
>> >>>>>>>>> 4 processors, 4 GB RAM and 7GB Swap), but it failed after 14
>> >>>> hours.
>> >>>>>>>>>
>> >>>>>>>>> I trief then to load in single counties (Bundesländer). Always
>> >>>> the
>> >>>>>>>> first one works
>> >>>>>>>>> but after that (e.g. first one is "Hamburg", second one
>> >> "Bremen")
>> >>>>>> only
>> >>>>>>>> nodes are inserted (and no ways). Is this a known error/issue.
>> >>>>>>>>>
>> >>>>>>>>> What would you recommend to get All the data of one country in
>> >> a
>> >>>>>>>> database?
>> >>>>>>>>> Thank you very much, Kai
>> >>>>>>>>> -------- Original-Nachricht --------
>> >>>>>>>>>> Datum: Mon, 29 Jun 2009 09:35:45 +0900
>> >>>>>>>>>> Von: Daniel Kastl <kastl at orkney.co.jp>
>> >>>>>>>>>> An: pgrouting-users at lists.postlbs.org
>> >>>>>>>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>> >>>>>>>>>> Hi Eike,
>> >>>>>>>>>>
>> >>>>>>>>>> You probably run into this issue:
>> >>>>>>>> http://pgrouting.postlbs.org/ticket/140
>> >>>>>>>>>> If you can try it with a smaller dataset for testing and it
>> >>>> worked,
>> >>>>>>>> then
>> >>>>>>>>>> this is the case. If it still doesn't work then please let us
>> >>>> know.
>> >>>>>>>>>> The original author of osm2pgrouting said he's currently
>> >> working
>> >>>> on
>> >>>>>>>> this
>> >>>>>>>>>> issue as time allows.
>> >>>>>>>>>>
>> >>>>>>>>>> Daniel
>> >>>>>>>>>>
>> >>>>>>>>>> PS: Once I tried a little larger dataset I just increased my
>> >> SWAP
>> >>>>>>>>>> partition and it worked then, but I don't know how large the
>> >>>> German
>> >>>>>>>> data
>> >>>>>>>>>> is. It's not a nice solution anyway.
>> >>>>>>>>>>
>> >>>>>>>>>>
>> >>>>>>>>>>
>> >>>>>>>>>> Eike Lüders schrieb:
>> >>>>>>>>>>> Hello everybody!
>> >>>>>>>>>>>
>> >>>>>>>>>>> I've got a problem with osm2pgrouting.
>> >>>>>>>>>>> I downloaded the osm file for germany from here:
>> >>>>>>>>>>> http://download.geofabrik.de/osm/europe/germany.osm.bz2
>> >>>>>>>>>>> If I try to run osm2pgrouting on it now by typing
>> >>>>>>>>>>>
>> >>>>>>>>>>> ./osm2pgrouting -file germany.osm -conf mapconfig.xml
>> >> -dbname
>> >>>>>> routing
>> >>>>>>>>>>> -user postgres -passwd postgres -clean
>> >>>>>>>>>>>
>> >>>>>>>>>>> into the shell it gives me the following information, but
>> >>>> nothing
>> >>>>>>>>>>> happes (the db information above are correct!).
>> >>>>>>>>>>>
>> >>>>>>>>>>> There is no error message or something like that.
>> >>>>>>>>>>>
>> >>>>>>>>>>> I hope anybody know how to solve this problem.
>> >>>>>>>>>>>
>> >>>>>>>>>>> host=127.0.0.1 user=postgres dbname=routing port=5432
>> >>>>>>>> password=postgres
>> >>>>>>>>>>> connection success
>> >>>>>>>>>>> Trying to load config file mapconfig.xml
>> >>>>>>>>>>> Trying to parse config
>> >>>>>>>>>>> SE for <configuration>
>> >>>>>>>>>>> SE for <type>
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = motorway
>> >>>>>>>>>>> class id = 101
>> >>>>>>>>>>> class id = 101 name = motorway added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = motorway_link
>> >>>>>>>>>>> class id = 102
>> >>>>>>>>>>> class id = 102 name = motorway_link added to type
>> >> name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = motorway_junction
>> >>>>>>>>>>> class id = 103
>> >>>>>>>>>>> class id = 103 name = motorway_junction added to type
>> >>>> name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = trunk
>> >>>>>>>>>>> class id = 104
>> >>>>>>>>>>> class id = 104 name = trunk added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = trunk_link
>> >>>>>>>>>>> class id = 105
>> >>>>>>>>>>> class id = 105 name = trunk_link added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = primary
>> >>>>>>>>>>> class id = 106
>> >>>>>>>>>>> class id = 106 name = primary added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = primary_link
>> >>>>>>>>>>> class id = 107
>> >>>>>>>>>>> class id = 107 name = primary_link added to type
>> >> name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = secondary
>> >>>>>>>>>>> class id = 106
>> >>>>>>>>>>> class id = 106 name = secondary added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = tertiary
>> >>>>>>>>>>> class id = 107
>> >>>>>>>>>>> class id = 107 name = tertiary added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = residential
>> >>>>>>>>>>> class id = 107
>> >>>>>>>>>>> class id = 107 name = residential added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = living_street
>> >>>>>>>>>>> class id = 108
>> >>>>>>>>>>> class id = 108 name = living_street added to type
>> >> name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = service
>> >>>>>>>>>>> class id = 109
>> >>>>>>>>>>> class id = 109 name = service added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = track
>> >>>>>>>>>>> class id = 110
>> >>>>>>>>>>> class id = 110 name = track added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = pedestrian
>> >>>>>>>>>>> class id = 111
>> >>>>>>>>>>> class id = 111 name = pedestrian added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = services
>> >>>>>>>>>>> class id = 112
>> >>>>>>>>>>> class id = 112 name = services added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = bus_guideway
>> >>>>>>>>>>> class id = 113
>> >>>>>>>>>>> class id = 113 name = bus_guideway added to type
>> >> name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = path
>> >>>>>>>>>>> class id = 114
>> >>>>>>>>>>> class id = 114 name = path added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = cicleway
>> >>>>>>>>>>> class id = 115
>> >>>>>>>>>>> class id = 115 name = cicleway added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = footway
>> >>>>>>>>>>> class id = 116
>> >>>>>>>>>>> class id = 116 name = footway added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = bridleway
>> >>>>>>>>>>> class id = 117
>> >>>>>>>>>>> class id = 117 name = bridleway added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = byway
>> >>>>>>>>>>> class id = 118
>> >>>>>>>>>>> class id = 118 name = byway added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = steps
>> >>>>>>>>>>> class id = 119
>> >>>>>>>>>>> class id = 119 name = steps added to type name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = unclassified
>> >>>>>>>>>>> class id = 100
>> >>>>>>>>>>> class id = 100 name = unclassified added to type
>> >> name=highway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = road
>> >>>>>>>>>>> class id = 100
>> >>>>>>>>>>> class id = 100 name = road added to type name=highway
>> >>>>>>>>>>> SE for <type>
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = lane
>> >>>>>>>>>>> class id = 201
>> >>>>>>>>>>> class id = 201 name = lane added to type name=cycleway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = track
>> >>>>>>>>>>> class id = 202
>> >>>>>>>>>>> class id = 202 name = track added to type name=cycleway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = opposite_lane
>> >>>>>>>>>>> class id = 203
>> >>>>>>>>>>> class id = 203 name = opposite_lane added to type
>> >> name=cycleway
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = opposite
>> >>>>>>>>>>> class id = 204
>> >>>>>>>>>>> class id = 204 name = opposite added to type name=cycleway
>> >>>>>>>>>>> SE for <type>
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = grade1
>> >>>>>>>>>>> class id = 301
>> >>>>>>>>>>> class id = 301 name = grade1 added to type name=tracktype
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = grade2
>> >>>>>>>>>>> class id = 302
>> >>>>>>>>>>> class id = 302 name = grade2 added to type name=tracktype
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = grade3
>> >>>>>>>>>>> class id = 303
>> >>>>>>>>>>> class id = 303 name = grade3 added to type name=tracktype
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = grade4
>> >>>>>>>>>>> class id = 304
>> >>>>>>>>>>> class id = 304 name = grade4 added to type name=tracktype
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = grade5
>> >>>>>>>>>>> class id = 305
>> >>>>>>>>>>> class id = 305 name = grade5 added to type name=tracktype
>> >>>>>>>>>>> SE for <type>
>> >>>>>>>>>>> SE for <class>
>> >>>>>>>>>>> class name = roundabout
>> >>>>>>>>>>> class id = 401
>> >>>>>>>>>>> class id = 401 name = roundabout added to type name=junction
>> >>>>>>>>>>> Trying to load data
>> >>>>>>>>>>> Trying to parse data
>> >>>>>>>>>>>
>> >>>>>>>>>>>
>> >>>>>>>>>>> Kind regards
>> >>>>>>>>>>> Eike Lüders
>> >>>>>>>>>>>
>> >>
>> ------------------------------------------------------------------------
>> >>>>>>>>>>> _______________________________________________
>> >>>>>>>>>>> Pgrouting-users mailing list
>> >>>>>>>>>>> Pgrouting-users at lists.postlbs.org
>> >>>>>>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>> >>>>>>>>>>>
>> >>>>>>>>>> _______________________________________________
>> >>>>>>>>>> Pgrouting-users mailing list
>> >>>>>>>>>> Pgrouting-users at lists.postlbs.org
>> >>>>>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>> >>>>>>>>> --
>> >>>>>>>>> Neu: GMX Doppel-FLAT mit Internet-Flatrate + Telefon-Flatrate
>> >>>>>>>>> für nur 19,99 Euro/mtl.!* http://portal.gmx.net/de/go/dsl02
>> >>>>>>>>> _______________________________________________
>> >>>>>>>>> Pgrouting-users mailing list
>> >>>>>>>>> Pgrouting-users at lists.postlbs.org
>> >>>>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>> >>>>>>>>>
>> >>>>>>> --
>> >>>>>>> GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
>> >>>>>>> Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
>> >>>>>>>
>> >>>>> --
>> >>>>> GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
>> >>>>> Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
>> >>>>> _______________________________________________
>> >>>>> Pgrouting-users mailing list
>> >>>>> Pgrouting-users at lists.postlbs.org
>> >>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>> >>>>>
>> >>>> _______________________________________________
>> >>>> Pgrouting-users mailing list
>> >>>> Pgrouting-users at lists.postlbs.org
>> >>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>> >>> --
>> >>> GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
>> >>> Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
>> >>>
>> >> _______________________________________________
>> >> Pgrouting-users mailing list
>> >> Pgrouting-users at lists.postlbs.org
>> >> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>> >
>
> --
> Jetzt kostenlos herunterladen: Internet Explorer 8 und Mozilla Firefox 3 -
> sicherer, schneller und einfacher! http://portal.gmx.net/de/go/chbrowser
> _______________________________________________
> Pgrouting-users mailing list
> Pgrouting-users at lists.postlbs.org
> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: db.patch
Type: text/x-patch
Size: 18270 bytes
Desc: not available
Url : http://lists.osgeo.org/pipermail/pgrouting-users/attachments/20090715/f3c5f082/db.bin


More information about the Pgrouting-users mailing list