Re: [OSRM-talk] Updating a map
Merci Julien. je vais essayer. Didier Le dim.12/08/18 à 19:03, Julien Coupey a écrit : > Hi Didier, > > The exclude flag feature introduced a while back in OSRM might explain a > change in RAM requirements for the same OSM file. If you don't need that > feature, you can disable the associated extra work/memory usage by setting an > empty "excludable" list in the profile at: > > https://github.com/Project-OSRM/osrm-backend/blob/master/profiles/car.lua#L122-L126 > > Hope that helps > Julien > > On 10/08/2018 09:34, Didier Doumerc wrote: >> I have only 12 GB of RAM but when I installed the previous file version, it >> was ok with only 4 GB or RAM. >> Is there anyway way to successfully prepare the files ? Perhaps by >> downloading them ready yet ? >> Thanks for your answer. >> Didier >> Le jeu.09/08/18 à 18:15, Sayer, Bryan a écrit : >>> When I had that problem it was due to lack of memory. For the United >>> States, I had to have 64 GB of memory prepare, though I was doing it >>> through a Stata interface, not directly. >>> >>> *From:*Didier Doumerc mailto:doumer...@adimep.com>> >>> *Sent:*Thursday, August 9, 2018 11:53:39 AM >>> *To:*osrm-talk@openstreetmap.org <mailto:osrm-talk@openstreetmap.org> >>> *Subject:*[OSRM-talk] Updating a map >>> Hi, >>> >>> I need help for updating the map file. Here is what I get when I run >>> osrm-prepare france-latest.osrm. It stops at 90% >>> >>> [info] Input file: france-latest.osrm >>> [info] Profile: profile.lua >>> [info] Threads: 8 >>> [info] Loading edge-expanded graph representation >>> [info] Opening france-latest.osrm.ebg >>> [info] Reading 25874228 edges from the edge based graph >>> [info] Done reading edges >>> [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) >>> [STXXL-ERRMSG] Warning: no config file found. >>> [STXXL-ERRMSG] Using default disk configuration. >>> [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O >>> implementation: syscall autogrow delete_on_exit queue=0 devid=0 >>> merged 51783408 edges out of 103496912 >>> contractor finished initalization >>> initializing elimination PQ ...ok >>> preprocessing 13952773 nodes 10% . 20% . 30% . 40% . 50% . 60% . >>> [flush 9336408 nodes] 70% . 80% . 90% . >>> >>> >>> >>> Before, I run osrm-extract france-latest/osm.pbf >>> >>> >>> [info] Input file: france-latest.osm.pbf >>> [info] Profile: profile.lua >>> [info] Threads: 8 >>> [info] Using script profile.lua >>> [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) >>> [STXXL-ERRMSG] Warning: no config file found. >>> [STXXL-ERRMSG] Using default disk configuration. >>> [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O >>> implementation: syscall autogrow delete_on_exit queue=0 devid=0 >>> [info] Parsing in progress.. >>> [info] input file generated by osmium/1.8.0 >>> [info] timestamp: 2018-08-05T20:00:03Z >>> [info] Using turn restrictions >>> [info] Found 3 exceptions to turn restrictions: >>> [info] motorcar >>> [info] motor_vehicle >>> [info] vehicle >>> [info] Parsing finished after 914.304 seconds >>> [info] Raw input contains 387758183 nodes, 57191546 ways, and 521319 >>> relations, and 0 unknown entities >>> [extractor] Sorting used nodes... ok, after 8.97724s >>> [extractor] Erasing duplicate nodes ... ok, after 5.16838s >>> [extractor] Sorting all nodes ... ok, after 270.95s >>> [extractor] Building node id map ... ok, after 146.325s >>> [extractor] setting number of nodes ... ok >>> [extractor] Confirming/Writing used nodes ... ok, after 84.6342s >>> [info] Processed 36442184 nodes >>> [extractor] Sorting edges by start... ok, after 46.7546s >>> [extractor] Setting start coords ... ok, after 188.624s >>> [extractor] Sorting edges by target ... ok, after 47.2029s >>> [extractor] Computing edge weights... ok, after 201.467s >>> [extractor] Sorting edges by renumbered start ... ok, after 47.6069s >>> [extractor] Writing used egdes ... ok, after 33.4863s >>> [extractor] setting number of edges ... ok >>> [info] Processed 37971544 edges >>> [extractor] Sorting used ways ... ok, after 3.42604s >>> [extrac
Re: [OSRM-talk] Updating a map
Hi Didier, The exclude flag feature introduced a while back in OSRM might explain a change in RAM requirements for the same OSM file. If you don't need that feature, you can disable the associated extra work/memory usage by setting an empty "excludable" list in the profile at: https://github.com/Project-OSRM/osrm-backend/blob/master/profiles/car.lua#L122-L126 Hope that helps Julien On 10/08/2018 09:34, Didier Doumerc wrote: I have only 12 GB of RAM but when I installed the previous file version, it was ok with only 4 GB or RAM. Is there anyway way to successfully prepare the files ? Perhaps by downloading them ready yet ? Thanks for your answer. Didier Le jeu.09/08/18 à 18:15, Sayer, Bryan a écrit : When I had that problem it was due to lack of memory. For the United States, I had to have 64 GB of memory prepare, though I was doing it through a Stata interface, not directly. *From:*Didier Doumerc mailto:doumer...@adimep.com>> *Sent:*Thursday, August 9, 2018 11:53:39 AM *To:*osrm-talk@openstreetmap.org <mailto:osrm-talk@openstreetmap.org> *Subject:*[OSRM-talk] Updating a map Hi, I need help for updating the map file. Here is what I get when I run osrm-prepare france-latest.osrm. It stops at 90% [info] Input file: france-latest.osrm [info] Profile: profile.lua [info] Threads: 8 [info] Loading edge-expanded graph representation [info] Opening france-latest.osrm.ebg [info] Reading 25874228 edges from the edge based graph [info] Done reading edges [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk configuration. [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O implementation: syscall autogrow delete_on_exit queue=0 devid=0 merged 51783408 edges out of 103496912 contractor finished initalization initializing elimination PQ ...ok preprocessing 13952773 nodes 10% . 20% . 30% . 40% . 50% . 60% . [flush 9336408 nodes] 70% . 80% . 90% . Before, I run osrm-extract france-latest/osm.pbf [info] Input file: france-latest.osm.pbf [info] Profile: profile.lua [info] Threads: 8 [info] Using script profile.lua [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk configuration. [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O implementation: syscall autogrow delete_on_exit queue=0 devid=0 [info] Parsing in progress.. [info] input file generated by osmium/1.8.0 [info] timestamp: 2018-08-05T20:00:03Z [info] Using turn restrictions [info] Found 3 exceptions to turn restrictions: [info] motorcar [info] motor_vehicle [info] vehicle [info] Parsing finished after 914.304 seconds [info] Raw input contains 387758183 nodes, 57191546 ways, and 521319 relations, and 0 unknown entities [extractor] Sorting used nodes ... ok, after 8.97724s [extractor] Erasing duplicate nodes ... ok, after 5.16838s [extractor] Sorting all nodes ... ok, after 270.95s [extractor] Building node id map ... ok, after 146.325s [extractor] setting number of nodes ... ok [extractor] Confirming/Writing used nodes ... ok, after 84.6342s [info] Processed 36442184 nodes [extractor] Sorting edges by start ... ok, after 46.7546s [extractor] Setting start coords ... ok, after 188.624s [extractor] Sorting edges by target ... ok, after 47.2029s [extractor] Computing edge weights ... ok, after 201.467s [extractor] Sorting edges by renumbered start ... ok, after 47.6069s [extractor] Writing used egdes ... ok, after 33.4863s [extractor] setting number of edges ... ok [info] Processed 37971544 edges [extractor] Sorting used ways ... ok, after 3.42604s [extractor] Sorting 34351 restriction. by from... ok, after 0.078667s [extractor] Fixing restriction starts ... ok, after 1.32651s [extractor] Sorting restrictions. by to ... ok, after 0.048604s [extractor] Fixing restriction ends ... ok, after 1.28459s [info] usable restrictions: 31935 [extractor] writing street name index ... ok, after 0.159635s [info] extraction finished after 2046.13s [info] Generating edge-expanded graph representation [info] - 31935 restrictions. [info] Importing n = 36442184 nodes [info] - 17000 bollard nodes, 41647 traffic lights [info] and 37971544 edges [info] Graph loaded ok and has 37971544 edges . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Node compression ratio: 0.166043 [info] Edge compression ratio: 0.19941 . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Generated 37961020 nodes in edge-expanded graph [info] generating edge-expanded edges . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Generated 37961020 edge based nodes [info] Node-based graph contains 13952773 edges [info] Edge-expanded graph ... [info] contains 25874228 edges [info] skip
Re: [OSRM-talk] Updating a map
It is possible that your problem is something other than memory, but I have no way of knowing. I believe the usual advice is to use a service like Amazon Web Service (AWS) where you can use a machine with more memory for the amount of time it takes to prepare the maps. I imagine it would be pretty reasonable in price. From: Didier Doumerc Sent: Friday, August 10, 2018 3:34:42 AM To: Mailing list to discuss Project OSRM Subject: Re: [OSRM-talk] Updating a map I have only 12 GB of RAM but when I installed the previous file version, it was ok with only 4 GB or RAM. Is there anyway way to successfully prepare the files ? Perhaps by downloading them ready yet ? Thanks for your answer. Didier Le jeu.09/08/18 à 18:15, Sayer, Bryan a écrit : When I had that problem it was due to lack of memory. For the United States, I had to have 64 GB of memory prepare, though I was doing it through a Stata interface, not directly. From: Didier Doumerc mailto:doumer...@adimep.com>> Sent: Thursday, August 9, 2018 11:53:39 AM To: osrm-talk@openstreetmap.org<mailto:osrm-talk@openstreetmap.org> Subject: [OSRM-talk] Updating a map Hi, I need help for updating the map file. Here is what I get when I run osrm-prepare france-latest.osrm. It stops at 90% [info] Input file: france-latest.osrm [info] Profile: profile.lua [info] Threads: 8 [info] Loading edge-expanded graph representation [info] Opening france-latest.osrm.ebg [info] Reading 25874228 edges from the edge based graph [info] Done reading edges [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk configuration. [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O implementation: syscall autogrow delete_on_exit queue=0 devid=0 merged 51783408 edges out of 103496912 contractor finished initalization initializing elimination PQ ...ok preprocessing 13952773 nodes 10% . 20% . 30% . 40% . 50% . 60% . [flush 9336408 nodes] 70% . 80% . 90% . Before, I run osrm-extract france-latest/osm.pbf [info] Input file: france-latest.osm.pbf [info] Profile: profile.lua [info] Threads: 8 [info] Using script profile.lua [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk configuration. [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O implementation: syscall autogrow delete_on_exit queue=0 devid=0 [info] Parsing in progress.. [info] input file generated by osmium/1.8.0 [info] timestamp: 2018-08-05T20:00:03Z [info] Using turn restrictions [info] Found 3 exceptions to turn restrictions: [info] motorcar [info] motor_vehicle [info] vehicle [info] Parsing finished after 914.304 seconds [info] Raw input contains 387758183 nodes, 57191546 ways, and 521319 relations, and 0 unknown entities [extractor] Sorting used nodes... ok, after 8.97724s [extractor] Erasing duplicate nodes ... ok, after 5.16838s [extractor] Sorting all nodes ... ok, after 270.95s [extractor] Building node id map ... ok, after 146.325s [extractor] setting number of nodes ... ok [extractor] Confirming/Writing used nodes ... ok, after 84.6342s [info] Processed 36442184 nodes [extractor] Sorting edges by start... ok, after 46.7546s [extractor] Setting start coords ... ok, after 188.624s [extractor] Sorting edges by target ... ok, after 47.2029s [extractor] Computing edge weights... ok, after 201.467s [extractor] Sorting edges by renumbered start ... ok, after 47.6069s [extractor] Writing used egdes ... ok, after 33.4863s [extractor] setting number of edges ... ok [info] Processed 37971544 edges [extractor] Sorting used ways ... ok, after 3.42604s [extractor] Sorting 34351 restriction. by from... ok, after 0.078667s [extractor] Fixing restriction starts ... ok, after 1.32651s [extractor] Sorting restrictions. by to ... ok, after 0.048604s [extractor] Fixing restriction ends ... ok, after 1.28459s [info] usable restrictions: 31935 [extractor] writing street name index ... ok, after 0.159635s [info] extraction finished after 2046.13s [info] Generating edge-expanded graph representation [info] - 31935 restrictions. [info] Importing n = 36442184 nodes [info] - 17000 bollard nodes, 41647 traffic lights [info] and 37971544 edges [info] Graph loaded ok and has 37971544 edges . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Node compression ratio: 0.166043 [info] Edge compression ratio: 0.19941 . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Generated 37961020 nodes in edge-expanded graph [info] generating edge-expanded edges . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Generated 37961020 edge based nodes [info] Node-based graph contains 13952773 edges [info] Edge-expanded graph ... [info] contains 25874228 edges [info]
Re: [OSRM-talk] Updating a map
I have only 12 GB of RAM but when I installed the previous file version, it was ok with only 4 GB or RAM. Is there anyway way to successfully prepare the files ? Perhaps by downloading them ready yet ? Thanks for your answer. Didier Le jeu.09/08/18 à 18:15, Sayer, Bryan a écrit : > When I had that problem it was due to lack of memory. For the United States, > I had to have 64 GB of memory prepare, though I was doing it through a Stata > interface, not directly. > From: Didier Doumerc > Sent: Thursday, August 9, 2018 11:53:39 AM > To: osrm-talk@openstreetmap.org > Subject: [OSRM-talk] Updating a map > > Hi, > > I need help for updating the map file. Here is what I get when I run > osrm-prepare france-latest.osrm. It stops at 90% > > [info] Input file: france-latest.osrm > [info] Profile: profile.lua > [info] Threads: 8 > [info] Loading edge-expanded graph representation > [info] Opening france-latest.osrm.ebg > [info] Reading 25874228 edges from the edge based graph > [info] Done reading edges > [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) > [STXXL-ERRMSG] Warning: no config file found. > [STXXL-ERRMSG] Using default disk configuration. > [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O > implementation: syscall autogrow delete_on_exit queue=0 devid=0 > merged 51783408 edges out of 103496912 > contractor finished initalization > initializing elimination PQ ...ok > preprocessing 13952773 nodes 10% . 20% . 30% . 40% . 50% . 60% . [flush > 9336408 nodes] 70% . 80% . 90% . > > > > Before, I run osrm-extract france-latest/osm.pbf > > > [info] Input file: france-latest.osm.pbf > [info] Profile: profile.lua > [info] Threads: 8 > [info] Using script profile.lua > [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) > [STXXL-ERRMSG] Warning: no config file found. > [STXXL-ERRMSG] Using default disk configuration. > [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O > implementation: syscall autogrow delete_on_exit queue=0 devid=0 > [info] Parsing in progress.. > [info] input file generated by osmium/1.8.0 > [info] timestamp: 2018-08-05T20:00:03Z > [info] Using turn restrictions > [info] Found 3 exceptions to turn restrictions: > [info] motorcar > [info] motor_vehicle > [info] vehicle > [info] Parsing finished after 914.304 seconds > [info] Raw input contains 387758183 nodes, 57191546 ways, and 521319 > relations, and 0 unknown entities > [extractor] Sorting used nodes... ok, after 8.97724s > [extractor] Erasing duplicate nodes ... ok, after 5.16838s > [extractor] Sorting all nodes ... ok, after 270.95s > [extractor] Building node id map ... ok, after 146.325s > [extractor] setting number of nodes ... ok > [extractor] Confirming/Writing used nodes ... ok, after 84.6342s > [info] Processed 36442184 nodes > [extractor] Sorting edges by start... ok, after 46.7546s > [extractor] Setting start coords ... ok, after 188.624s > [extractor] Sorting edges by target ... ok, after 47.2029s > [extractor] Computing edge weights... ok, after 201.467s > [extractor] Sorting edges by renumbered start ... ok, after 47.6069s > [extractor] Writing used egdes ... ok, after 33.4863s > [extractor] setting number of edges ... ok > [info] Processed 37971544 edges > [extractor] Sorting used ways ... ok, after 3.42604s > [extractor] Sorting 34351 restriction. by from... ok, after 0.078667s > [extractor] Fixing restriction starts ... ok, after 1.32651s > [extractor] Sorting restrictions. by to ... ok, after 0.048604s > [extractor] Fixing restriction ends ... ok, after 1.28459s > [info] usable restrictions: 31935 > [extractor] writing street name index ... ok, after 0.159635s > [info] extraction finished after 2046.13s > [info] Generating edge-expanded graph representation > [info] - 31935 restrictions. > [info] Importing n = 36442184 nodes > [info] - 17000 bollard nodes, 41647 traffic lights > [info] and 37971544 edges > [info] Graph loaded ok and has 37971544 edges > . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% > [info] Node compression ratio: 0.166043 > [info] Edge compression ratio: 0.19941 > . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% > [info] Generated 37961020 nodes in edge-expanded graph > [info] generating edge-expanded edges > . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% > [info] Generated 37961020 edge based nodes > [info] Node-based graph contains 13952773 edges > [info] Edge-expanded graph ... > [info] contains 25874228 edges > [info] skips 26910 turns, defined by 31859 restrictions > [info] skips 11264858 U turns > [info] skips 18504 turns over barr
Re: [OSRM-talk] Updating a map
When I had that problem it was due to lack of memory. For the United States, I had to have 64 GB of memory prepare, though I was doing it through a Stata interface, not directly. From: Didier Doumerc Sent: Thursday, August 9, 2018 11:53:39 AM To: osrm-talk@openstreetmap.org Subject: [OSRM-talk] Updating a map Hi, I need help for updating the map file. Here is what I get when I run osrm-prepare france-latest.osrm. It stops at 90% [info] Input file: france-latest.osrm [info] Profile: profile.lua [info] Threads: 8 [info] Loading edge-expanded graph representation [info] Opening france-latest.osrm.ebg [info] Reading 25874228 edges from the edge based graph [info] Done reading edges [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk configuration. [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O implementation: syscall autogrow delete_on_exit queue=0 devid=0 merged 51783408 edges out of 103496912 contractor finished initalization initializing elimination PQ ...ok preprocessing 13952773 nodes 10% . 20% . 30% . 40% . 50% . 60% . [flush 9336408 nodes] 70% . 80% . 90% . Before, I run osrm-extract france-latest/osm.pbf [info] Input file: france-latest.osm.pbf [info] Profile: profile.lua [info] Threads: 8 [info] Using script profile.lua [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk configuration. [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O implementation: syscall autogrow delete_on_exit queue=0 devid=0 [info] Parsing in progress.. [info] input file generated by osmium/1.8.0 [info] timestamp: 2018-08-05T20:00:03Z [info] Using turn restrictions [info] Found 3 exceptions to turn restrictions: [info] motorcar [info] motor_vehicle [info] vehicle [info] Parsing finished after 914.304 seconds [info] Raw input contains 387758183 nodes, 57191546 ways, and 521319 relations, and 0 unknown entities [extractor] Sorting used nodes... ok, after 8.97724s [extractor] Erasing duplicate nodes ... ok, after 5.16838s [extractor] Sorting all nodes ... ok, after 270.95s [extractor] Building node id map ... ok, after 146.325s [extractor] setting number of nodes ... ok [extractor] Confirming/Writing used nodes ... ok, after 84.6342s [info] Processed 36442184 nodes [extractor] Sorting edges by start... ok, after 46.7546s [extractor] Setting start coords ... ok, after 188.624s [extractor] Sorting edges by target ... ok, after 47.2029s [extractor] Computing edge weights... ok, after 201.467s [extractor] Sorting edges by renumbered start ... ok, after 47.6069s [extractor] Writing used egdes ... ok, after 33.4863s [extractor] setting number of edges ... ok [info] Processed 37971544 edges [extractor] Sorting used ways ... ok, after 3.42604s [extractor] Sorting 34351 restriction. by from... ok, after 0.078667s [extractor] Fixing restriction starts ... ok, after 1.32651s [extractor] Sorting restrictions. by to ... ok, after 0.048604s [extractor] Fixing restriction ends ... ok, after 1.28459s [info] usable restrictions: 31935 [extractor] writing street name index ... ok, after 0.159635s [info] extraction finished after 2046.13s [info] Generating edge-expanded graph representation [info] - 31935 restrictions. [info] Importing n = 36442184 nodes [info] - 17000 bollard nodes, 41647 traffic lights [info] and 37971544 edges [info] Graph loaded ok and has 37971544 edges . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Node compression ratio: 0.166043 [info] Edge compression ratio: 0.19941 . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Generated 37961020 nodes in edge-expanded graph [info] generating edge-expanded edges . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Generated 37961020 edge based nodes [info] Node-based graph contains 13952773 edges [info] Edge-expanded graph ... [info] contains 25874228 edges [info] skips 26910 turns, defined by 31859 restrictions [info] skips 11264858 U turns [info] skips 18504 turns over barriers [info] Timing statistics for edge-expanded graph: [info] Renumbering edges: 0.239598s [info] Generating nodes: 10.5262s [info] Generating edges: 44.5756s [info] building r-tree ... [info] large component [6711]=13836854 [info] SCC run took: 1.89227s [info] constructing r-tree of 37961020 edge elements build on-top of 36442184 coordinates [info] finished r-tree construction in 23.796 seconds [info] writing node map ... [extractor] Writing edge-based-graph egdes ... ok, after 3.98042s [info] Processed 25874228 edges [info] Expansion : 274152 nodes/sec and 104966 edges/sec [info] To prepare the data for routing, run: ./osrm-prepare france-latest.osrm [STXXL-ERRMSG] Removing disk file: /var/tmp/stxxl logout Saving session
[OSRM-talk] Updating a map
Hi, I need help for updating the map file. Here is what I get when I run osrm-prepare france-latest.osrm. It stops at 90% [info] Input file: france-latest.osrm [info] Profile: profile.lua [info] Threads: 8 [info] Loading edge-expanded graph representation [info] Opening france-latest.osrm.ebg [info] Reading 25874228 edges from the edge based graph [info] Done reading edges [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk configuration. [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O implementation: syscall autogrow delete_on_exit queue=0 devid=0 merged 51783408 edges out of 103496912 contractor finished initalization initializing elimination PQ ...ok preprocessing 13952773 nodes 10% . 20% . 30% . 40% . 50% . 60% . [flush 9336408 nodes] 70% . 80% . 90% . Before, I run osrm-extract france-latest/osm.pbf [info] Input file: france-latest.osm.pbf [info] Profile: profile.lua [info] Threads: 8 [info] Using script profile.lua [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk configuration. [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O implementation: syscall autogrow delete_on_exit queue=0 devid=0 [info] Parsing in progress.. [info] input file generated by osmium/1.8.0 [info] timestamp: 2018-08-05T20:00:03Z [info] Using turn restrictions [info] Found 3 exceptions to turn restrictions: [info] motorcar [info] motor_vehicle [info] vehicle [info] Parsing finished after 914.304 seconds [info] Raw input contains 387758183 nodes, 57191546 ways, and 521319 relations, and 0 unknown entities [extractor] Sorting used nodes... ok, after 8.97724s [extractor] Erasing duplicate nodes ... ok, after 5.16838s [extractor] Sorting all nodes ... ok, after 270.95s [extractor] Building node id map ... ok, after 146.325s [extractor] setting number of nodes ... ok [extractor] Confirming/Writing used nodes ... ok, after 84.6342s [info] Processed 36442184 nodes [extractor] Sorting edges by start... ok, after 46.7546s [extractor] Setting start coords ... ok, after 188.624s [extractor] Sorting edges by target ... ok, after 47.2029s [extractor] Computing edge weights... ok, after 201.467s [extractor] Sorting edges by renumbered start ... ok, after 47.6069s [extractor] Writing used egdes ... ok, after 33.4863s [extractor] setting number of edges ... ok [info] Processed 37971544 edges [extractor] Sorting used ways ... ok, after 3.42604s [extractor] Sorting 34351 restriction. by from... ok, after 0.078667s [extractor] Fixing restriction starts ... ok, after 1.32651s [extractor] Sorting restrictions. by to ... ok, after 0.048604s [extractor] Fixing restriction ends ... ok, after 1.28459s [info] usable restrictions: 31935 [extractor] writing street name index ... ok, after 0.159635s [info] extraction finished after 2046.13s [info] Generating edge-expanded graph representation [info] - 31935 restrictions. [info] Importing n = 36442184 nodes [info] - 17000 bollard nodes, 41647 traffic lights [info] and 37971544 edges [info] Graph loaded ok and has 37971544 edges . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Node compression ratio: 0.166043 [info] Edge compression ratio: 0.19941 . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Generated 37961020 nodes in edge-expanded graph [info] generating edge-expanded edges . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Generated 37961020 edge based nodes [info] Node-based graph contains 13952773 edges [info] Edge-expanded graph ... [info] contains 25874228 edges [info] skips 26910 turns, defined by 31859 restrictions [info] skips 11264858 U turns [info] skips 18504 turns over barriers [info] Timing statistics for edge-expanded graph: [info] Renumbering edges: 0.239598s [info] Generating nodes: 10.5262s [info] Generating edges: 44.5756s [info] building r-tree ... [info] large component [6711]=13836854 [info] SCC run took: 1.89227s [info] constructing r-tree of 37961020 edge elements build on-top of 36442184 coordinates [info] finished r-tree construction in 23.796 seconds [info] writing node map ... [extractor] Writing edge-based-graph egdes ... ok, after 3.98042s [info] Processed 25874228 edges [info] Expansion : 274152 nodes/sec and 104966 edges/sec [info] To prepare the data for routing, run: ./osrm-prepare france-latest.osrm [STXXL-ERRMSG] Removing disk file: /var/tmp/stxxl logout Saving session... ...copying shared history... ...saving history...truncating history files... ...completed. Thanks for your help. Kind regards. Didier___ OSRM-talk mailing list OSRM-talk@openstreetmap.org https://lists.openstreetmap.org/listinfo/osrm-talk
