I did some more testing.
I've taken a smaller area and put everything into a tmpfs but even with
the .pbf as well as the tmp files of osmosis both being stored in ram,
the performance isn't too good. It improved to about 1500 objects/second
but this would still means that all ways (according to
Hi,
the osm2city software should be changed to use an osm2pgsql database
instead of an osmosis database. Not only can a planet be imported in
less than a day with osm2pgsql (if you have SSDs), but also the
osm2pgsql database already has correctly built geometries for all
objects, whereas osm2city
Hi,
Building ways and relations requires fast random access, not sequential
read / write speed. I think it likely your HDD raid is the culprit, as
the 96 RAM won't allow you to process everything in RAM. All of the
recent osm2pgsql benchmarks with high throughput for building ways and
The same problem applies to a 3.4 GB .pbf file.
The nodes were done quickly but as soon as it started processing the
ways, it got super slow.
merspieler:
> I've imported small extracts in the past but I've never actually
> monitored the performance of these as they were done in reasonable time.
>
No, Imposm as it's own schema.
I never used Osmosis to import a complete planet file, but I would find
reasonable to start with a small extract like stated in osm2city documentation.
Yves___
dev mailing list
dev@openstreetmap.org
I've wanted to use osm2pgsql but the schema is a different one.
The software [1] I'm going to use the db with only supports the osmosis one.
As for the hardware:
2x Xeon E5 8 cores/16 threads
96GB ram
5x 4TB HDD in a RAIDZ2
I've done some benchmarking of the raid and osmosis doesn't even reach
Same as Frederic, but also proposing Imposm, also quite fast.
A brief hardware description would allow to exclude some bottlenecks.
Yves ___
dev mailing list
dev@openstreetmap.org
https://lists.openstreetmap.org/listinfo/dev
Hi,
first question: are you absolutely sure you need an Osmosis import -
does your use case not work with an osm2pgsql import?
Best
Frederik
--
Frederik Ramm ## eMail frede...@remote.org ## N49°00'09" E008°23'33"
___
dev mailing list
8 matches
Mail list logo
