[pgrouting-users] osm2pgrouting import problem

[Vladislav Shikhov]

Hello, all.

Fist of all I'd like to admit that this patch doesn't solve all the
osm2pgroute problems. Please, take it as is.
The main idea was to store nodes not in the memory, but in the DB and
select them on demand.
It makes "-clean" arg unusable, but I introduce a new arg "-stage"
with values starting from 0 (default). Now you can interrupt
osm2pgroute after the message "Split ways" and rerun it again with
"-stage 2", it will reuse previously imported nodes.

fell free to ask any questions,
regards,
Vladislav Shikhov

On Mon, Jul 13, 2009 at 3:24 PM, Kai Behncke<Kai-Behncke at gmx.de> wrote:
> Hi Vladislav,
>
>
> would you please post your patch via the list, please?
> That would be very helpful for us all. :-)
>
> Thank you very much, Kai
>
>
> -------- Original-Nachricht --------
>> Datum: Sun, 12 Jul 2009 21:51:32 +0400
>> Von: Vladislav Shikhov <vladshikhov at gmail.com>
>> An: Kai Behncke <Kai-Behncke at gmx.de>, pgrouting-users at lists.postlbs.org
>> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>
>> I've made some trivial patches for osm2pgrouting, so now it takes
>> about 4 hours to import whole Russia in to DB on 2 cores 2.3 Ghz
>> Athlon &1 Gb memory. Switch on you brain, it rather simple.
>>
>> On Sun, Jul 12, 2009 at 3:59 PM, Kai Behncke<Kai-Behncke at gmx.de> wrote:
>> > Dear users,
>> >
>> > I tried it as well with the Germany-osm-data (600 MB) on a pc with
>> > 4 processors, 4 GB RAM and 7GB Swap), but it failed after 14 hours.
>> >
>> >
>> > I trief then to load in single counties (Bundesländer). Always the
>> first one works
>> > but after that (e.g. first one is "Hamburg", second one "Bremen") only
>> nodes are inserted (and no ways). Is this a known error/issue.
>> >
>> >
>> > What would you recommend to get All the data of one country in a
>> database?
>> >
>> > Thank you very much, Kai
>> > -------- Original-Nachricht --------
>> >> Datum: Mon, 29 Jun 2009 09:35:45 +0900
>> >> Von: Daniel Kastl <kastl at orkney.co.jp>
>> >> An: pgrouting-users at lists.postlbs.org
>> >> Betreff: Re: [pgrouting-users] osm2pgrouting import problem
>> >
>> >> Hi Eike,
>> >>
>> >> You probably run into this issue:
>> http://pgrouting.postlbs.org/ticket/140
>> >> If you can try it with a smaller dataset for testing and it worked,
>> then
>> >> this is the case. If it still doesn't work then please let us know.
>> >>
>> >> The original author of osm2pgrouting said he's currently working on
>> this
>> >> issue as time allows.
>> >>
>> >> Daniel
>> >>
>> >> PS: Once I tried a little larger dataset I just increased my SWAP
>> >> partition and it worked then, but I don't know how large the German
>> data
>> >> is. It's not a nice solution anyway.
>> >>
>> >>
>> >>
>> >> Eike Lüders schrieb:
>> >> > Hello everybody!
>> >> >
>> >> > I've got a problem with osm2pgrouting.
>> >> > I downloaded the osm file for germany from here:
>> >> > http://download.geofabrik.de/osm/europe/germany.osm.bz2
>> >> > If I try to run osm2pgrouting on it now by typing
>> >> >
>> >> > ./osm2pgrouting -file germany.osm -conf mapconfig.xml -dbname routing
>> >> > -user postgres -passwd postgres -clean
>> >> >
>> >> > into the shell it gives me the following information, but nothing
>> >> > happes (the db information above are correct!).
>> >> >
>> >> > There is no error message or something like that.
>> >> >
>> >> > I hope anybody know how to solve this problem.
>> >> >
>> >> > host=127.0.0.1 user=postgres dbname=routing port=5432
>> password=postgres
>> >> > connection success
>> >> > Trying to load config file mapconfig.xml
>> >> > Trying to parse config
>> >> > SE for <configuration>
>> >> > SE for <type>
>> >> > SE for <class>
>> >> > class name = motorway
>> >> > class id = 101
>> >> > class id = 101 name = motorway added to type name=highway
>> >> > SE for <class>
>> >> > class name = motorway_link
>> >> > class id = 102
>> >> > class id = 102 name = motorway_link added to type name=highway
>> >> > SE for <class>
>> >> > class name = motorway_junction
>> >> > class id = 103
>> >> > class id = 103 name = motorway_junction added to type name=highway
>> >> > SE for <class>
>> >> > class name = trunk
>> >> > class id = 104
>> >> > class id = 104 name = trunk added to type name=highway
>> >> > SE for <class>
>> >> > class name = trunk_link
>> >> > class id = 105
>> >> > class id = 105 name = trunk_link added to type name=highway
>> >> > SE for <class>
>> >> > class name = primary
>> >> > class id = 106
>> >> > class id = 106 name = primary added to type name=highway
>> >> > SE for <class>
>> >> > class name = primary_link
>> >> > class id = 107
>> >> > class id = 107 name = primary_link added to type name=highway
>> >> > SE for <class>
>> >> > class name = secondary
>> >> > class id = 106
>> >> > class id = 106 name = secondary added to type name=highway
>> >> > SE for <class>
>> >> > class name = tertiary
>> >> > class id = 107
>> >> > class id = 107 name = tertiary added to type name=highway
>> >> > SE for <class>
>> >> > class name = residential
>> >> > class id = 107
>> >> > class id = 107 name = residential added to type name=highway
>> >> > SE for <class>
>> >> > class name = living_street
>> >> > class id = 108
>> >> > class id = 108 name = living_street added to type name=highway
>> >> > SE for <class>
>> >> > class name = service
>> >> > class id = 109
>> >> > class id = 109 name = service added to type name=highway
>> >> > SE for <class>
>> >> > class name = track
>> >> > class id = 110
>> >> > class id = 110 name = track added to type name=highway
>> >> > SE for <class>
>> >> > class name = pedestrian
>> >> > class id = 111
>> >> > class id = 111 name = pedestrian added to type name=highway
>> >> > SE for <class>
>> >> > class name = services
>> >> > class id = 112
>> >> > class id = 112 name = services added to type name=highway
>> >> > SE for <class>
>> >> > class name = bus_guideway
>> >> > class id = 113
>> >> > class id = 113 name = bus_guideway added to type name=highway
>> >> > SE for <class>
>> >> > class name = path
>> >> > class id = 114
>> >> > class id = 114 name = path added to type name=highway
>> >> > SE for <class>
>> >> > class name = cicleway
>> >> > class id = 115
>> >> > class id = 115 name = cicleway added to type name=highway
>> >> > SE for <class>
>> >> > class name = footway
>> >> > class id = 116
>> >> > class id = 116 name = footway added to type name=highway
>> >> > SE for <class>
>> >> > class name = bridleway
>> >> > class id = 117
>> >> > class id = 117 name = bridleway added to type name=highway
>> >> > SE for <class>
>> >> > class name = byway
>> >> > class id = 118
>> >> > class id = 118 name = byway added to type name=highway
>> >> > SE for <class>
>> >> > class name = steps
>> >> > class id = 119
>> >> > class id = 119 name = steps added to type name=highway
>> >> > SE for <class>
>> >> > class name = unclassified
>> >> > class id = 100
>> >> > class id = 100 name = unclassified added to type name=highway
>> >> > SE for <class>
>> >> > class name = road
>> >> > class id = 100
>> >> > class id = 100 name = road added to type name=highway
>> >> > SE for <type>
>> >> > SE for <class>
>> >> > class name = lane
>> >> > class id = 201
>> >> > class id = 201 name = lane added to type name=cycleway
>> >> > SE for <class>
>> >> > class name = track
>> >> > class id = 202
>> >> > class id = 202 name = track added to type name=cycleway
>> >> > SE for <class>
>> >> > class name = opposite_lane
>> >> > class id = 203
>> >> > class id = 203 name = opposite_lane added to type name=cycleway
>> >> > SE for <class>
>> >> > class name = opposite
>> >> > class id = 204
>> >> > class id = 204 name = opposite added to type name=cycleway
>> >> > SE for <type>
>> >> > SE for <class>
>> >> > class name = grade1
>> >> > class id = 301
>> >> > class id = 301 name = grade1 added to type name=tracktype
>> >> > SE for <class>
>> >> > class name = grade2
>> >> > class id = 302
>> >> > class id = 302 name = grade2 added to type name=tracktype
>> >> > SE for <class>
>> >> > class name = grade3
>> >> > class id = 303
>> >> > class id = 303 name = grade3 added to type name=tracktype
>> >> > SE for <class>
>> >> > class name = grade4
>> >> > class id = 304
>> >> > class id = 304 name = grade4 added to type name=tracktype
>> >> > SE for <class>
>> >> > class name = grade5
>> >> > class id = 305
>> >> > class id = 305 name = grade5 added to type name=tracktype
>> >> > SE for <type>
>> >> > SE for <class>
>> >> > class name = roundabout
>> >> > class id = 401
>> >> > class id = 401 name = roundabout added to type name=junction
>> >> > Trying to load data
>> >> > Trying to parse data
>> >> >
>> >> >
>> >> > Kind regards
>> >> > Eike Lüders
>> >> >
>> ------------------------------------------------------------------------
>> >> >
>> >> > _______________________________________________
>> >> > Pgrouting-users mailing list
>> >> > Pgrouting-users at lists.postlbs.org
>> >> > http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>> >> >
>> >>
>> >> _______________________________________________
>> >> Pgrouting-users mailing list
>> >> Pgrouting-users at lists.postlbs.org
>> >> http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>> >
>> > --
>> > Neu: GMX Doppel-FLAT mit Internet-Flatrate + Telefon-Flatrate
>> > für nur 19,99 Euro/mtl.!* http://portal.gmx.net/de/go/dsl02
>> > _______________________________________________
>> > Pgrouting-users mailing list
>> > Pgrouting-users at lists.postlbs.org
>> > http://lists.postlbs.org/mailman/listinfo/pgrouting-users
>> >
>
> --
> GRATIS für alle GMX-Mitglieder: Die maxdome Movie-FLAT!
> Jetzt freischalten unter http://portal.gmx.net/de/go/maxdome01
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: db.patch
Type: text/x-patch
Size: 18652 bytes
Desc: not available
Url : http://lists.osgeo.org/pipermail/pgrouting-users/attachments/20090714/a90c5660/db.bin