Hi, Unfortunately I have never used osmium-extract myself but I was remembering that I had been reading something about doing spatial selection from OSM pbf. I did even find the thread https://lists.openstreetmap.org/pipermail/dev/2018-October/030400.html
-Jukka- koji higuchi wrote > Hi Jukka > > Is osmium-extract available in pyosmium? > i'm using windows; and seems difficult to use osmium in windows > > On Thu, Nov 1, 2018 at 7:13 PM jratike80 < > jukka.rahkonen@ >> wrote: > >> Hi, >> >> That is probably another problem, OSM pbf format does not support >> effective >> selection by region so selecting a subarea from europe-latest.osm.pbf may >> be >> almost as slow as processing the whole dataset. I would try if >> osmium-extract https://docs.osmcode.org/osmium/latest/osmium-extract.html >> could do the clipping faster. >> >> -Jukka Rahkonen- >> >> >> koji higuchi wrote >> > Hi, my source file is too big, around 19gb (europe-latest.osm.pbf) >> > I also tried ogr2ogr for clipping into region as follows. >> > ogr2ogr -f, gpkg, -clipdst, str(ulx), str(lry), str(lrx), str(uly), >> fo, >> > fi >> > but it was also very slow. >> > >> > >> > On Thu, Nov 1, 2018 at 6:55 PM jratike80 < >> >> > jukka.rahkonen@ >> >> >> wrote: >> > >> >> koji higuchi wrote >> >> > Hi, following is the code I used: >> >> > >> >> > Import os, osmium, fiona >> >> > >> >> > fi = 'europe-latest.osm.pbf' >> >> > fo = 'europe-latest.dpkg' >> >> > >> >> > drv = 'DPKG' >> >> >> >> Hi, >> >> >> >> I am not able to evaluate if your code is effective or not. However, I >> >> can >> >> give you some numbers for comparison. >> >> >> >> Test data http://download.geofabrik.de/europe/finland-latest.osm.pbf >> >> - 322 MB as .pbf >> >> - 770725 points >> >> - 1778917 lines >> >> - 3128 multilinestrings >> >> - 2087911 multipolygons >> >> - 6985 other relations >> >> >> >> Command: >> >> ogr2ogr -f gpkg finland.gpkg finland-latest.osm.pbf >> >> >> >> Execution time on Windows laptop: >> >> 2 minutes and 20 seconds >> >> >> >> If you experience some slower performance it is probably not because >> of >> >> SQLite/GeoPackage as a format is slow but because something is not >> done >> >> in >> >> a >> >> way that is not optimal for the format. Could you also define your >> source >> >> data and the performance that you have measured? >> >> >> >> -Jukka Rahkonen- >> >> >> >> >> >> >> >> -- >> Sent from: http://osgeo-org.1560.x6.nabble.com/GDAL-Dev-f3742093.html >> _______________________________________________ >> gdal-dev mailing list >> > [email protected] >> https://lists.osgeo.org/mailman/listinfo/gdal-dev > > _______________________________________________ > gdal-dev mailing list > [email protected] > https://lists.osgeo.org/mailman/listinfo/gdal-dev -- Sent from: http://osgeo-org.1560.x6.nabble.com/GDAL-Dev-f3742093.html _______________________________________________ gdal-dev mailing list [email protected] https://lists.osgeo.org/mailman/listinfo/gdal-dev
