Re: [OSM-dev] Slow osmosis import

2019-10-05 Thread Frederik Ramm
Hi, the osm2city software should be changed to use an osm2pgsql database instead of an osmosis database. Not only can a planet be imported in less than a day with osm2pgsql (if you have SSDs), but also the osm2pgsql database already has correctly built geometries for all objects, whereas osm2city

Re: [OSM-dev] Slow osmosis import

2019-10-05 Thread Marco Boeringa
Hi, Building ways and relations requires fast random access, not sequential read / write speed. I think it likely your HDD raid is the culprit, as the 96 RAM won't allow you to process everything in RAM. All of the recent osm2pgsql benchmarks with high throughput for building ways and

Re: [OSM-dev] Slow osmosis import

2019-10-05 Thread merspieler
I did some more testing. I've taken a smaller area and put everything into a tmpfs but even with the .pbf as well as the tmp files of osmosis both being stored in ram, the performance isn't too good. It improved to about 1500 objects/second but this would still means that all ways (according to