Re: [OSRM-talk] Current server requirements for planet

2017-07-05 Thread Daniel Hofmann 
For the record: because we're seeing this question pop up every now and
again I just added a disk and memory requirements page to our wiki:

https://github.com/Project-OSRM/osrm-backend/wiki

feel free to adapt and / or add your own findings.

Cheers,
Daniel J H

On Wed, Jul 5, 2017 at 8:30 PM, Daniel Patterson  wrote:

> For preprocessing:
>
> The demoserver uses about 175GB of RAM to preprocess the planet, and
> around 280GB of STXXL disk space (you'll also need 35GB for the planet
> file, and 40-50GB for the generated datafiles).
>
> For the foot profile, the latest number I have is about 248GB of RAM.
> Everything else is proportionally larger.
>
> The profile you choose has a big impact on size - the foot profile
> includes a lot more ways/roads/paths than the car profile, so it needs more
> resources.  The cycling profile sits somewhere in between.
>
> For runtime:
>
> You should be able to route on the planet with 64GB of RAM - we basically
> just load all the files into memory, so whatever the output file size from
> preprocessing - that's roughly how much RAM you'll need (minus the size of
> the `.fileIndex` file, which is `mmap()`-ed and read on-demand).
>
> On Wed, Jul 5, 2017 at 7:45 AM, Artur Bialecki 
> wrote:
>
>> In my case the disk space used is 102 GB and about 64 GB of RAM while
>> running with 30 threads. I run a non-standard profile though that returns
>> additional data. Not sure if that affects the foot prints.
>>
>> Artur...
>>
>> -Original Message-
>> From: Kieran Caplice [mailto:kieran.capl...@temetra.com]
>> Sent: Wednesday, July 05, 2017 7:48 AM
>> To: osrm-talk@openstreetmap.org
>> Subject: [OSRM-talk] Current server requirements for planet
>>
>> Hello,
>>
>> What are the current recommended RAM+disk requirements for running an
>> OSRM planet server?
>>
>> Thanks in advance.
>>
>> Kind regards,
>> Kieran Caplice
>>
>>
>> ___
>> OSRM-talk mailing list
>> OSRM-talk@openstreetmap.org
>> https://lists.openstreetmap.org/listinfo/osrm-talk
>> This e-mail message is confidential, may be privileged and is intended
>> for the exclusive use of the addressee. Any other person is strictly
>> prohibited from disclosing, distributing or reproducing it. If the
>> addressee cannot be reached or is unknown to you, please inform us
>> immediately and delete this e-mail message and destroy all copies. Thank
>> you.
>> ___
>> OSRM-talk mailing list
>> OSRM-talk@openstreetmap.org
>> https://lists.openstreetmap.org/listinfo/osrm-talk
>>
>
>
> ___
> OSRM-talk mailing list
> OSRM-talk@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/osrm-talk
>
>
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

Re: [OSRM-talk] Example of restricted access flags for way_function and turn_function

2017-07-05 Thread Mateusz Loskot 
On 1 July 2017 at 20:00, Michael Krasnyk  wrote:
> Hi Mateusz,
>
> for turn restrictions you can use
> https://wiki.openstreetmap.org/wiki/Relation:restriction  OSM tag.
>
> Here is an example
> https://github.com/Project-OSRM/osrm-backend/blob/e2e279bc852cd024aef1ad445a81bad2884902cd/features/car/restrictions.feature#L11-L34
> that  is similar to yours with nodes mapping w->A, j->B, e->C, w->D.

Michael,

The restrictions.feature sample turned exactly what I was looking for.
Thanks a lot!

Best regards,
-- 
Mateusz Loskot, http://mateusz.loskot.net

___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

Re: [OSRM-talk] Current server requirements for planet

2017-07-05 Thread Daniel Patterson 
For preprocessing:

The demoserver uses about 175GB of RAM to preprocess the planet, and around
280GB of STXXL disk space (you'll also need 35GB for the planet file, and
40-50GB for the generated datafiles).

For the foot profile, the latest number I have is about 248GB of RAM.
Everything else is proportionally larger.

The profile you choose has a big impact on size - the foot profile includes
a lot more ways/roads/paths than the car profile, so it needs more
resources.  The cycling profile sits somewhere in between.

For runtime:

You should be able to route on the planet with 64GB of RAM - we basically
just load all the files into memory, so whatever the output file size from
preprocessing - that's roughly how much RAM you'll need (minus the size of
the `.fileIndex` file, which is `mmap()`-ed and read on-demand).

On Wed, Jul 5, 2017 at 7:45 AM, Artur Bialecki 
wrote:

> In my case the disk space used is 102 GB and about 64 GB of RAM while
> running with 30 threads. I run a non-standard profile though that returns
> additional data. Not sure if that affects the foot prints.
>
> Artur...
>
> -Original Message-
> From: Kieran Caplice [mailto:kieran.capl...@temetra.com]
> Sent: Wednesday, July 05, 2017 7:48 AM
> To: osrm-talk@openstreetmap.org
> Subject: [OSRM-talk] Current server requirements for planet
>
> Hello,
>
> What are the current recommended RAM+disk requirements for running an OSRM
> planet server?
>
> Thanks in advance.
>
> Kind regards,
> Kieran Caplice
>
>
> ___
> OSRM-talk mailing list
> OSRM-talk@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/osrm-talk
> This e-mail message is confidential, may be privileged and is intended for
> the exclusive use of the addressee. Any other person is strictly prohibited
> from disclosing, distributing or reproducing it. If the addressee cannot be
> reached or is unknown to you, please inform us immediately and delete this
> e-mail message and destroy all copies. Thank you.
> ___
> OSRM-talk mailing list
> OSRM-talk@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/osrm-talk
>
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

Re: [OSRM-talk] Current server requirements for planet

2017-07-05 Thread Frederik Ramm 
Hi,

On 07/05/2017 01:48 PM, Kieran Caplice wrote:
> What are the current recommended RAM+disk requirements for running an
> OSRM planet server?

With the latest OSRM, you can run a planet-wide car routing graph in
just under 64 GB, but I guess in half a year or so the OSM data will
have grown to bring you over the 64 GB (not taking into account any
potential changes in the software which might move RAM usage either way).

Bicycle or foot routing graphs take more RAM.

The preparation of the routing graph also takes more RAM than the
serving. Depends on how often you want to update your routing data. If
something like 1x/month is sufficient then you can just fire up a beefy
Amazon machine for a day to generate a new graph and copy that over to
your machine. If you want to compute the routing graph *on* the machine
where you do the routing, you should aim for nothing less than 144 GB of
RAM.

Also if it is important for you to switch to a new data version without
a production interruption of a few minutes, you need enough RAM to hold
the routing graph twice.

Best
Frederik

-- 
Frederik Ramm  ##  eMail frede...@remote.org  ##  N49°00'09" E008°23'33"

___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

Re: [OSRM-talk] Current server requirements for planet

2017-07-05 Thread Artur Bialecki 
In my case the disk space used is 102 GB and about 64 GB of RAM while running 
with 30 threads. I run a non-standard profile though that returns additional 
data. Not sure if that affects the foot prints.

Artur...

-Original Message-
From: Kieran Caplice [mailto:kieran.capl...@temetra.com]
Sent: Wednesday, July 05, 2017 7:48 AM
To: osrm-talk@openstreetmap.org
Subject: [OSRM-talk] Current server requirements for planet

Hello,

What are the current recommended RAM+disk requirements for running an OSRM 
planet server?

Thanks in advance.

Kind regards,
Kieran Caplice


___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk
This e-mail message is confidential, may be privileged and is intended for the 
exclusive use of the addressee. Any other person is strictly prohibited from 
disclosing, distributing or reproducing it. If the addressee cannot be reached 
or is unknown to you, please inform us immediately and delete this e-mail 
message and destroy all copies. Thank you.
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

Re: [OSRM-talk] Current server requirements for planet

2017-07-05 Thread Steven Ottens 

Hey Keiran,

I'm working with OSRM on a 6core (12 threads) 32GB RAM machine and I 
can't import the entire planet.osm.pbf but it has no problems doing all 
the continents individually. As such I would say 32GB RAM is too little. 
I'm also wondering what the specs are other people are using and whether 
or not upgrading to 64GB would be enough to import and run a planet file.


I only have one user (me) so I can't really comment on concurrent 
performance.


Steven


Op 7/5/2017 om 3:07 PM schreef Kieran Caplice:
Thanks. I saw that, but we're not really interested in using 
cloud-based VMs such as AWS or Azure, and the specs might differ 
somewhat between bare metal and VM, so I'm really looking to get 
opinions from people who have a planet server running and what 
hardware they're using.


Kind regards,
Kieran Caplice

On 05/07/17 12:59, Ricardo Pereira wrote:
You can get an idea of requirement and resulting performance by 
checking this: 
https://github.com/Project-OSRM/osrm-backend/wiki/Demo-server, if the 
information is actual.

Cheers

On Wed, 5 Jul 2017 at 13:49 Kieran Caplice 
mailto:kieran.capl...@temetra.com>> wrote:


Hello,

What are the current recommended RAM+disk requirements for running an
OSRM planet server?

Thanks in advance.

Kind regards,
Kieran Caplice


___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org 
https://lists.openstreetmap.org/listinfo/osrm-talk



___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk




___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk


___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

Re: [OSRM-talk] Current server requirements for planet

2017-07-05 Thread Kieran Caplice 
Thanks. I saw that, but we're not really interested in using cloud-based 
VMs such as AWS or Azure, and the specs might differ somewhat between 
bare metal and VM, so I'm really looking to get opinions from people who 
have a planet server running and what hardware they're using.


Kind regards,
Kieran Caplice

On 05/07/17 12:59, Ricardo Pereira wrote:
You can get an idea of requirement and resulting performance by 
checking this: 
https://github.com/Project-OSRM/osrm-backend/wiki/Demo-server, if the 
information is actual.

Cheers

On Wed, 5 Jul 2017 at 13:49 Kieran Caplice > wrote:


Hello,

What are the current recommended RAM+disk requirements for running an
OSRM planet server?

Thanks in advance.

Kind regards,
Kieran Caplice


___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org 
https://lists.openstreetmap.org/listinfo/osrm-talk



___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk


___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

Re: [OSRM-talk] Current server requirements for planet

2017-07-05 Thread Ricardo Pereira 
You can get an idea of requirement and resulting performance by checking
this: https://github.com/Project-OSRM/osrm-backend/wiki/Demo-server, if the
information is actual.
Cheers

On Wed, 5 Jul 2017 at 13:49 Kieran Caplice 
wrote:

> Hello,
>
> What are the current recommended RAM+disk requirements for running an
> OSRM planet server?
>
> Thanks in advance.
>
> Kind regards,
> Kieran Caplice
>
>
> ___
> OSRM-talk mailing list
> OSRM-talk@openstreetmap.org
> https://lists.openstreetmap.org/listinfo/osrm-talk
>
___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk

[OSRM-talk] Current server requirements for planet

2017-07-05 Thread Kieran Caplice 

Hello,

What are the current recommended RAM+disk requirements for running an 
OSRM planet server?


Thanks in advance.

Kind regards,
Kieran Caplice


___
OSRM-talk mailing list
OSRM-talk@openstreetmap.org
https://lists.openstreetmap.org/listinfo/osrm-talk