[pgrouting-users] osm2pgrouting import problem

Kai Behncke Kai-Behncke at gmx.de
Tue Jul 14 13:26:38 EDT 2009 

Hi Stephen,


> 
> In case it is not obvious, since you are patch source files you will 
> need to rebuild the executables and install them in some appropriate
> place.


I`m not sure if I understand, you mean, I need to rebuild osm2pgrouting?

I tried now:

1.)Checking out osm2pgrouting 
from: svn checkout http://pgrouting.postlbs.org/svn/pgrouting/tools/osm2pgrouting/trunk osm2pgrouting

2.) make

(I think, osm2pgrouting doesn`t need a make install ?)

3.) patch -p0 -i db.patch in  /home/work/osm2pgrouting

...should be the steps, no?

Then I started:
./osm2pgrouting -file your-OSM-XML-File.osm -conf mapconfig.xml -dbname routing -user postgres

...but memory and also swap (after 30 minutes) are increasing extremely high (Memory 98% of 2GB RAM, Swap so far 33% of 7,5 GB).......


hm.....well, I will wait and see what happens....

Best regards, Kai






> 
> make
> make install
> 
> might work.
> 
> -Steve W
> 
> Kai Behncke wrote:
> > Hi Anton, 
> > 
> > thank you one more time :-)
> > 
> > 
> > With that I got:
> > 
> > patching file src/OSMDocument.h
> > patching file src/Export2DB.cpp
> > patching file src/Export2DB.h
> > patching file src/osm2pgrouting.cpp
> > patching file src/OSMDocumentParserCallback.cpp
> > Hunk #2 FAILED at 46.
> > Hunk #3 succeeded at 81 (offset -5 lines).
> > patch: **** malformed patch at line 515: @@ -150,7 +149,7 @@
> > 
> > 
> > I`m not sure if that malformed patch has any consequences?
> > I will try to get the germany.data to the routingdb......
> > 
> > Best regards, Kai
> > 
> > 
> > -------- Original-Nachricht --------
> >> Datum: Tue, 14 Jul 2009 18:37:25 +0900
> >> Von: Anton Patrushev <anton at orkney.co.jp>
> >> An: pgrouting-users at lists.postlbs.org
> >> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
> > 
> >> Kai,
> >>
> >> Try to execute patch -p0 -i db.patch in your  /home/work/osm2pgrouting
> >>
> >> Anton.
> >>
> >> On Tue, Jul 14, 2009 at 6:27 PM, Kai Behncke<Kai-Behncke at gmx.de> wrote:
> >>> Hi Anton,
> >>>
> >>>
> >>> thank you very much.
> >>> This patch-thing is really very new to me, I made a couple of tests
> but
> >> without success so far.
> >>>
> >>> I have the directory /home/work/osm2pgrouting where I also copied
> >>> the file db.patch in.
> >>>
> >>> Then I tried e.g. "patch /home/work/osm2pgrouting/db.patch"
> >>>
> >>> (but after that I only get a blinking cursor and osm2pgrouting works
> >> still "the old way").
> >>> Can anybody bring some light into it, please?
> >>>
> >>> Thank you again, Kai
> >>>
> >>>
> >>>
> >>> -------- Original-Nachricht --------
> >>>> Datum: Tue, 14 Jul 2009 15:36:44 +0900
> >>>> Von: Anton Patrushev <anton at orkney.co.jp>
> >>>> An: pgrouting-users at lists.postlbs.org
> >>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
> >>>> Hi Kai,
> >>>>
> >>>> No, you need to use patch command.
> >>>> Here is brief tutorial on how to make and apply patches in Linux.
> >>>>
> >>>> http://www.linuxforums.org/articles/using-diff-and-patch_80.html
> >>>>
> >>>> Anton.
> >>>>
> >>>>
> >>>> On Tue, Jul 14, 2009 at 3:10 PM, Kai Behncke<Kai-Behncke at gmx.de>
> wrote:
> >>>>> Dear Vladislav,
> >>>>>
> >>>>>
> >>>>> thank you very much for that :-)
> >>>>>
> >>>>>> fell free to ask any questions,
> >>>>> My question is: How do I integrate that patch?
> >>>>> I just rename that file to "OSMDocument.h" and copy it into
> /core/src
> >> ?
> >>>>> And after that I run make, correct?
> >>>>>
> >>>>> Thank you very much, Kai
> >>>>>
> >>>>>
> >>>>>
> >>>>>
> >>>>> -------- Original-Nachricht --------
> >>>>>> Datum: Tue, 14 Jul 2009 00:02:56 +0400
> >>>>>> Von: Vladislav Shikhov <vladshikhov at gmail.com>
> >>>>>> An: Kai Behncke <Kai-Behncke at gmx.de>,
> >> pgrouting-users at lists.postlbs.org
> >>>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
> >>>>>> Hello, all.
> >>>>>>
> >>>>>> Fist of all I'd like to admit that this patch doesn't solve all the
> >>>>>> osm2pgroute problems. Please, take it as is.
> >>>>>> The main idea was to store nodes not in the memory, but in the DB
> >> and
> >>>>>> select them on demand.
> >>>>>> It makes "-clean" arg unusable, but I introduce a new arg "-stage"
> >>>>>> with values starting from 0 (default). Now you can interrupt
> >>>>>> osm2pgroute after the message "Split ways" and rerun it again with
> >>>>>> "-stage 2", it will reuse previously imported nodes.
> >>>>>>
> >>>>>> regards,
> >>>>>> Vladislav Shikhov
> >>>>>>
> >>>>>> On Mon, Jul 13, 2009 at 3:24 PM, Kai Behncke<Kai-Behncke at gmx.de>
> >> wrote:
> >>>>>>> Hi Vladislav,
> >>>>>>>
> >>>>>>>
> >>>>>>> would you please post your patch via the list, please?
> >>>>>>> That would be very helpful for us all. :-)
> >>>>>>>
> >>>>>>> Thank you very much, Kai
> >>>>>>>
> >>>>>>>
> >>>>>>> -------- Original-Nachricht --------
> >>>>>>>> Datum: Sun, 12 Jul 2009 21:51:32 +0400
> >>>>>>>> Von: Vladislav Shikhov <vladshikhov at gmail.com>
> >>>>>>>> An: Kai Behncke <Kai-Behncke at gmx.de>,
> >>>> pgrouting-users at lists.postlbs.org
> >>>>>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
> >>>>>>>> I've made some trivial patches for osm2pgrouting, so now it takes
> >>>>>>>> about 4 hours to import whole Russia in to DB on 2 cores 2.3 Ghz
> >>>>>>>> Athlon &1 Gb memory. Switch on you brain, it rather simple.
> >>>>>>>>
> >>>>>>>> On Sun, Jul 12, 2009 at 3:59 PM, Kai Behncke<Kai-Behncke at gmx.de>
> >>>> wrote:
> >>>>>>>>> Dear users,
> >>>>>>>>>
> >>>>>>>>> I tried it as well with the Germany-osm-data (600 MB) on a pc
> >> with
> >>>>>>>>> 4 processors, 4 GB RAM and 7GB Swap), but it failed after 14
> >>>> hours.
> >>>>>>>>>
> >>>>>>>>> I trief then to load in single counties (Bundesländer). Always
> >>>> the
> >>>>>>>> first one works
> >>>>>>>>> but after that (e.g. first one is "Hamburg", second one
> >> "Bremen")
> >>>>>> only
> >>>>>>>> nodes are inserted (and no ways). Is this a known error/issue.
> >>>>>>>>>
> >>>>>>>>> What would you recommend to get All the data of one country in
> >> a
> >>>>>>>> database?
> >>>>>>>>> Thank you very much, Kai
> >>>>>>>>> -------- Original-Nachricht --------
> >>>>>>>>>> Datum: Mon, 29 Jun 2009 09:35:45 +0900
> >>>>>>>>>> Von: Daniel Kastl <kastl at orkney.co.jp>
> >>>>>>>>>> An: pgrouting-users at lists.postlbs.org
> >>>>>>>>>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
> >>>>>>>>>> Hi Eike,
> >>>>>>>>>>
> >>>>>>>>>> You probably run into this issue:
> >>>>>>>> http://pgrouting.postlbs.org/ticket/140
> >>>>>>>>>> If you can try it with a smaller dataset for testing and it
> >>>> worked,
> >>>>>>>> then
> >>>>>>>>>> this is the case. If it still doesn't work then please let us
> >>>> know.
> >>>>>>>>>> The original author of osm2pgrouting said he's currently
> >> working
> >>>> on
> >>>>>>>> this
> >>>>>>>>>> issue as time allows.
> >>>>>>>>>>
> >>>>>>>>>> Daniel
> >>>>>>>>>>
> >>>>>>>>>> PS: Once I tried a little larger dataset I just increased my
> >> SWAP
> >>>>>>>>>> partition and it worked then, but I don't know how large the
> >>>> German
> >>>>>>>> data
> >>>>>>>>>> is. It's not a nice solution anyway.
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>>
> >>>>>>>>>> Eike Lüders schrieb:
> >>>>>>>>>>> Hello everybody!
> >>>>>>>>>>>
> >>>>>>>>>>> I've got a problem with osm2pgrouting.
> >>>>>>>>>>> I downloaded the osm file for germany from here:
> >>>>>>>>>>> http://download.geofabrik.de/osm/europe/germany.osm.bz2
> >>>>>>>>>>> If I try to run osm2pgrouting on it now by typing
> >>>>>>>>>>>
> >>>>>>>>>>> ./osm2pgrouting -file germany.osm -conf mapconfig.xml
> >> -dbname
> >>>>>> routing
> >>>>>>>>>>> -user postgres -passwd postgres -clean
> >>>>>>>>>>>
> >>>>>>>>>>> into the shell it gives me the following information, but
> >>>> nothing
> >>>>>>>>>>> happes (the db information above are correct!).
> >>>>>>>>>>>
> >>>>>>>>>>> There is no error message or something like that.
> >>>>>>>>>>>
> >>>>>>>>>>> I hope anybody know how to solve this problem.
> >>>>>>>>>>>
> >>>>>>>>>>> host=127.0.0.1 user=postgres dbname=routing port=5432
> >>>>>>>> password=postgres
> >>>>>>>>>>> connection success
> >>>>>>>>>>> Trying to load config file mapconfig.xml
> >>>>>>>>>>> Trying to parse config
> >>>>>>>>>>> SE for <configuration>
> >>>>>>>>>>> SE for <type>
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = motorway
> >>>>>>>>>>> class id = 101
> >>>>>>>>>>> class id = 101 name = motorway added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = motorway_link
> >>>>>>>>>>> class id = 102
> >>>>>>>>>>> class id = 102 name = motorway_link added to type
> >> name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = motorway_junction
> >>>>>>>>>>> class id = 103
> >>>>>>>>>>> class id = 103 name = motorway_junction added to type
> >>>> name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = trunk
> >>>>>>>>>>> class id = 104
> >>>>>>>>>>> class id = 104 name = trunk added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = trunk_link
> >>>>>>>>>>> class id = 105
> >>>>>>>>>>> class id = 105 name = trunk_link added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = primary
> >>>>>>>>>>> class id = 106
> >>>>>>>>>>> class id = 106 name = primary added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = primary_link
> >>>>>>>>>>> class id = 107
> >>>>>>>>>>> class id = 107 name = primary_link added to type
> >> name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = secondary
> >>>>>>>>>>> class id = 106
> >>>>>>>>>>> class id = 106 name = secondary added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = tertiary
> >>>>>>>>>>> class id = 107
> >>>>>>>>>>> class id = 107 name = tertiary added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = residential
> >>>>>>>>>>> class id = 107
> >>>>>>>>>>> class id = 107 name = residential added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = living_street
> >>>>>>>>>>> class id = 108
> >>>>>>>>>>> class id = 108 name = living_street added to type
> >> name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = service
> >>>>>>>>>>> class id = 109
> >>>>>>>>>>> class id = 109 name = service added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = track
> >>>>>>>>>>> class id = 110
> >>>>>>>>>>> class id = 110 name = track added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = pedestrian
> >>>>>>>>>>> class id = 111
> >>>>>>>>>>> class id = 111 name = pedestrian added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = services
> >>>>>>>>>>> class id = 112
> >>>>>>>>>>> class id = 112 name = services added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = bus_guideway
> >>>>>>>>>>> class id = 113
> >>>>>>>>>>> class id = 113 name = bus_guideway added to type
> >> name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = path
> >>>>>>>>>>> class id = 114
> >>>>>>>>>>> class id = 114 name = path added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = cicleway
> >>>>>>>>>>> class id = 115
> >>>>>>>>>>> class id = 115 name = cicleway added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = footway
> >>>>>>>>>>> class id = 116
> >>>>>>>>>>> class id = 116 name = footway added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = bridleway
> >>>>>>>>>>> class id = 117
> >>>>>>>>>>> class id = 117 name = bridleway added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = byway
> >>>>>>>>>>> class id = 118
> >>>>>>>>>>> class id = 118 name = byway added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = steps
> >>>>>>>>>>> class id = 119
> >>>>>>>>>>> class id = 119 name = steps added to type name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = unclassified
> >>>>>>>>>>> class id = 100
> >>>>>>>>>>> class id = 100 name = unclassified added to type
> >> name=highway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = road
> >>>>>>>>>>> class id = 100
> >>>>>>>>>>> class id = 100 name = road added to type name=highway
> >>>>>>>>>>> SE for <type>
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = lane
> >>>>>>>>>>> class id = 201
> >>>>>>>>>>> class id = 201 name = lane added to type name=cycleway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = track
> >>>>>>>>>>> class id = 202
> >>>>>>>>>>> class id = 202 name = track added to type name=cycleway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = opposite_lane
> >>>>>>>>>>> class id = 203
> >>>>>>>>>>> class id = 203 name = opposite_lane added to type
> >> name=cycleway
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = opposite
> >>>>>>>>>>> class id = 204
> >>>>>>>>>>> class id = 204 name = opposite added to type name=cycleway
> >>>>>>>>>>> SE for <type>
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = grade1
> >>>>>>>>>>> class id = 301
> >>>>>>>>>>> class id = 301 name = grade1 added to type name=tracktype
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = grade2
> >>>>>>>>>>> class id = 302
> >>>>>>>>>>> class id = 302 name = grade2 added to type name=tracktype
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = grade3
> >>>>>>>>>>> class id = 303
> >>>>>>>>>>> class id = 303 name = grade3 added to type name=tracktype
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = grade4
> >>>>>>>>>>> class id = 304
> >>>>>>>>>>> class id = 304 name = grade4 added to type name=tracktype
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = grade5
> >>>>>>>>>>> class id = 305
> >>>>>>>>>>> class id = 305 name = grade5 added to type name=tracktype
> >>>>>>>>>>> SE for <type>
> >>>>>>>>>>> SE for <class>
> >>>>>>>>>>> class name = roundabout
> >>>>>>>>>>> class id = 401
> >>>>>>>>>>> class id = 401 name = roundabout added to type name=junction
> >>>>>>>>>>> Trying to load data
> >>>>>>>>>>> Trying to parse data
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> Kind regards
> >>>>>>>>>>> Eike Lüders
> >>>>>>>>>>>
> >>
> ------------------------------------------------------------------------
> >>>>>>>>>>> _______________________________________________
> >>>>>>>>>>> Pgrouting-users mailing list
> >>>>>>>>>>> Pgrouting-users at lists.postlbs.org
> >>>>>>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
> >>>>>>>>>>>
> >>>>>>>>>> _______________________________________________
> >>>>>>>>>> Pgrouting-users mailing list
> >>>>>>>>>> Pgrouting-users at lists.postlbs.org
> >>>>>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
> >>>>>>>>> --
> >>>>>>>>> Neu: GMX Doppel-FLAT mit Internet-Flatrate + Telefon-Flatrate
> >>>>>>>>> für nur 19,99 Euro/mtl.!* http://portal.gmx.net/de/go/dsl02
> >>>>>>>>> _______________________________________________
> >>>>>>>>> Pgrouting-users mailing list
> >>>>>>>>> Pgrouting-users at lists.postlbs.org
> >>>>>>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
> >>>>>>>>>
> >>>>>>> --
> >>>>>>> GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
> >>>>>>> Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
> >>>>>>>
> >>>>> --
> >>>>> GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
> >>>>> Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
> >>>>> _______________________________________________
> >>>>> Pgrouting-users mailing list
> >>>>> Pgrouting-users at lists.postlbs.org
> >>>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
> >>>>>
> >>>> _______________________________________________
> >>>> Pgrouting-users mailing list
> >>>> Pgrouting-users at lists.postlbs.org
> >>>> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
> >>> --
> >>> GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
> >>> Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
> >>>
> >> _______________________________________________
> >> Pgrouting-users mailing list
> >> Pgrouting-users at lists.postlbs.org
> >> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
> > 

-- 
Jetzt kostenlos herunterladen: Internet Explorer 8 und Mozilla Firefox 3 -
sicherer, schneller und einfacher! http://portal.gmx.net/de/go/chbrowser

More information about the Pgrouting-users mailing list