Re: [OSRM-talk] osrm-extract taking hours to complete

2016-03-02 Thread Frederik Ramm
Hi, On 03/02/2016 09:03 PM, Bjorn Madsen wrote: > I added a high speed SSD and pointed the .stxxl towards that to deal > with the swap slowdown. That bought me a drop in processing time from 12 > hrs -> 3-4 hrs. > > osrm@mat4:~/osrm-backend$ cat .stxxl >

Re: [OSRM-talk] osrm-extract taking hours to complete

2016-03-02 Thread Bjorn Madsen
Hi Kieran, I added a high speed SSD and pointed the .stxxl towards that to deal with the swap slowdown. That bought me a drop in processing time from 12 hrs -> 3-4 hrs. osrm@mat4:~/osrm-backend$ cat .stxxl *disk=/mnt/tmp/stxxl,40,syscall* osrm@mat4:~/osrm-backend$ lsblk NAMEMAJ:MIN RM

Re: [OSRM-talk] osrm-extract taking hours to complete

2016-03-02 Thread Kieran Caplice
Hi Patrick, Just wanted to ping you off-list. I just had a question about your update processhow often if at all do you update your PBF data, and how do you manage the process? We're thinking of just setting a cron job to download and extract the new PBF every weekend to a temporary

Re: [OSRM-talk] osrm-extract taking hours to complete

2016-03-02 Thread Kieran Caplice
Hi Patrick, That makes sense then. It's obvious the process is just going to take upwards of 8-10 hours for us in that case. Thanks for the help. Kind regards, Kieran Caplice On 02/03/16 17:01, Patrick Niklaus wrote: Hey Kieran, there have been a lot of structural changes (e.g. moving

Re: [OSRM-talk] osrm-extract taking hours to complete

2016-03-02 Thread Patrick Niklaus
Hey Kieran, there have been a lot of structural changes (e.g. moving code from osrm-prepare into osrm-extract) that probably invalidate that numbers. Also we support 64bit OSM ids now, which sadly uses a lot more disk space. I think stxxl need like 200GB. I think on our setup we have a

[OSRM-talk] osrm-extract taking hours to complete

2016-03-02 Thread Kieran Caplice
Hello, I'm currently extracting the planet PBF (~31 GB), and it's been running for hours. I notice in the "Running OSRM" wiki page, it says " On a Core i7 with 8GB RAM and (slow) 5400 RPM Samsung SATA hard disks it took about 65 minutes to do so from a PBF formatted planet", which is making