Re: [OSRM-talk] Pre-procesing planet.pbf with 128Gb RAM

2018-03-05 Thread Daniel Patterson
Hi Jose, That's correct, the published node binaries aren't built with STXXL support. You can always use swap, but due to the memory access patterns that OSRM uses, it tends to be *incredibly* slow (what takes hours in RAM can take days or weeks with swap, depending on the amount). STXXL is

Re: [OSRM-talk] Pre-procesing planet.pbf with 128Gb RAM

2018-03-05 Thread Jose Florido
Thanks! So that means we cannot use the provided node binaries, right? Do you think that 192 gb of RAM + swap would be enough to be able to do preparation without STXXL enabled? Thanks! Jose On Mon, Mar 5, 2018, 19:09 Daniel Patterson wrote: > Hi Jose, > > 128GB is not

Re: [OSRM-talk] Pre-procesing planet.pbf with 128Gb RAM

2018-03-05 Thread Daniel Patterson
Hi Jose, 128GB is not enough to do *everything* in RAM - over 300GB of data is generated during some phases. You'll probably want to do a custom build of OSRM and enable STXXL with `cmake -DENABLE_STXXL=ON ..`. This will build OSRM with the ability to do optimized data-to-disk swapping

[OSRM-talk] Pre-procesing planet.pbf with 128Gb RAM

2018-03-05 Thread Jose Florido
Hi! Is it possible to pre-process the planet file with OSRM 5.16.2 and only 128Gb ram? We do have a large SSD disk and pre processing doesn’t need to be super fast. Thanks! Jose ___ OSRM-talk mailing list OSRM-talk@openstreetmap.org