It is possible that your problem is something other than memory, but I have no way of knowing.
I believe the usual advice is to use a service like Amazon Web Service (AWS) where you can use a machine with more memory for the amount of time it takes to prepare the maps. I imagine it would be pretty reasonable in price. ________________________________ From: Didier Doumerc <doumer...@adimep.com> Sent: Friday, August 10, 2018 3:34:42 AM To: Mailing list to discuss Project OSRM Subject: Re: [OSRM-talk] Updating a map I have only 12 GB of RAM but when I installed the previous file version, it was ok with only 4 GB or RAM. Is there anyway way to successfully prepare the files ? Perhaps by downloading them ready yet ? Thanks for your answer. Didier Le jeu.09/08/18 à 18:15, Sayer, Bryan a écrit : When I had that problem it was due to lack of memory. For the United States, I had to have 64 GB of memory prepare, though I was doing it through a Stata interface, not directly. ________________________________ From: Didier Doumerc <doumer...@adimep.com<mailto:doumer...@adimep.com>> Sent: Thursday, August 9, 2018 11:53:39 AM To: osrm-talk@openstreetmap.org<mailto:osrm-talk@openstreetmap.org> Subject: [OSRM-talk] Updating a map Hi, I need help for updating the map file. Here is what I get when I run osrm-prepare france-latest.osrm. It stops at 90% [info] Input file: france-latest.osrm [info] Profile: profile.lua [info] Threads: 8 [info] Loading edge-expanded graph representation [info] Opening france-latest.osrm.ebg [info] Reading 25874228 edges from the edge based graph [info] Done reading edges [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk configuration. [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O implementation: syscall autogrow delete_on_exit queue=0 devid=0 merged 51783408 edges out of 103496912 contractor finished initalization initializing elimination PQ ...ok preprocessing 13952773 nodes .... 10% . 20% . 30% . 40% . 50% . 60% . [flush 9336408 nodes] 70% . 80% . 90% . Before, I run osrm-extract france-latest/osm.pbf [info] Input file: france-latest.osm.pbf [info] Profile: profile.lua [info] Threads: 8 [info] Using script profile.lua [STXXL-MSG] STXXL v1.4.1 (prerelease/Release) [STXXL-ERRMSG] Warning: no config file found. [STXXL-ERRMSG] Using default disk configuration. [STXXL-MSG] Disk '/var/tmp/stxxl' is allocated, space: 1000 MiB, I/O implementation: syscall autogrow delete_on_exit queue=0 devid=0 [info] Parsing in progress.. [info] input file generated by osmium/1.8.0 [info] timestamp: 2018-08-05T20:00:03Z [info] Using turn restrictions [info] Found 3 exceptions to turn restrictions: [info] motorcar [info] motor_vehicle [info] vehicle [info] Parsing finished after 914.304 seconds [info] Raw input contains 387758183 nodes, 57191546 ways, and 521319 relations, and 0 unknown entities [extractor] Sorting used nodes ... ok, after 8.97724s [extractor] Erasing duplicate nodes ... ok, after 5.16838s [extractor] Sorting all nodes ... ok, after 270.95s [extractor] Building node id map ... ok, after 146.325s [extractor] setting number of nodes ... ok [extractor] Confirming/Writing used nodes ... ok, after 84.6342s [info] Processed 36442184 nodes [extractor] Sorting edges by start ... ok, after 46.7546s [extractor] Setting start coords ... ok, after 188.624s [extractor] Sorting edges by target ... ok, after 47.2029s [extractor] Computing edge weights ... ok, after 201.467s [extractor] Sorting edges by renumbered start ... ok, after 47.6069s [extractor] Writing used egdes ... ok, after 33.4863s [extractor] setting number of edges ... ok [info] Processed 37971544 edges [extractor] Sorting used ways ... ok, after 3.42604s [extractor] Sorting 34351 restriction. by from... ok, after 0.078667s [extractor] Fixing restriction starts ... ok, after 1.32651s [extractor] Sorting restrictions. by to ... ok, after 0.048604s [extractor] Fixing restriction ends ... ok, after 1.28459s [info] usable restrictions: 31935 [extractor] writing street name index ... ok, after 0.159635s [info] extraction finished after 2046.13s [info] Generating edge-expanded graph representation [info] - 31935 restrictions. [info] Importing n = 36442184 nodes [info] - 17000 bollard nodes, 41647 traffic lights [info] and 37971544 edges [info] Graph loaded ok and has 37971544 edges . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Node compression ratio: 0.166043 [info] Edge compression ratio: 0.19941 . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Generated 37961020 nodes in edge-expanded graph [info] generating edge-expanded edges . 10% . 20% . 30% . 40% . 50% . 60% . 70% . 80% . 90% . 100% [info] Generated 37961020 edge based nodes [info] Node-based graph contains 13952773 edges [info] Edge-expanded graph ... [info] contains 25874228 edges [info] skips 26910 turns, defined by 31859 restrictions [info] skips 11264858 U turns [info] skips 18504 turns over barriers [info] Timing statistics for edge-expanded graph: [info] Renumbering edges: 0.239598s [info] Generating nodes: 10.5262s [info] Generating edges: 44.5756s [info] building r-tree ... [info] large component [6711]=13836854 [info] SCC run took: 1.89227s [info] constructing r-tree of 37961020 edge elements build on-top of 36442184 coordinates [info] finished r-tree construction in 23.796 seconds [info] writing node map ... [extractor] Writing edge-based-graph egdes ... ok, after 3.98042s [info] Processed 25874228 edges [info] Expansion : 274152 nodes/sec and 104966 edges/sec [info] To prepare the data for routing, run: ./osrm-prepare france-latest.osrm [STXXL-ERRMSG] Removing disk file: /var/tmp/stxxl logout Saving session... ...copying shared history... ...saving history...truncating history files... ...completed. Thanks for your help. Kind regards. Didier ****WARNING**** This information may be confidential. It is intended only for the addressee(s) identified above. If you are not the addressee(s), or an employee or agent of the addressee(s), please note that any dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this information in error, please destroy the information and notify the sender of the error. Thank you. _______________________________________________ OSRM-talk mailing list OSRM-talk@openstreetmap.org<mailto:OSRM-talk@openstreetmap.org> https://lists.openstreetmap.org/listinfo/osrm-talk ****WARNING**** This information may be confidential. It is intended only for the addressee(s) identified above. If you are not the addressee(s), or an employee or agent of the addressee(s), please note that any dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this information in error, please destroy the information and notify the sender of the error. Thank you.
_______________________________________________ OSRM-talk mailing list OSRM-talk@openstreetmap.org https://lists.openstreetmap.org/listinfo/osrm-talk
