Instead of having tons of different people trying to attempt loading all of these 8 Million buildings, we shoul collectively start an import proposal (OSM wiki, draft a plan, set up tasking managers, pre-process data, host entire dataset, etc...).
The best/easiest solution we (OSM Ottawa) did for importing 1M+ buildings was to convert the data into GeoJSON and then convert them into VectorTiles using Tippecanoe [0] and host them using our own custom server (Micro Data Service [1]) which hosts those vector tiles into OSM & GeoJSON. After all the "hard work" is done.. you can simply add those small chunks of data with JOSM using any Tasking Manager by adding the URL [2] in Extra Instructions. An example of a final OSM tile would look like this [3] which would be ready to import (semi-manually). There's also integration with QA-Tiles [4] to prevent loading any duplicate data (this feature requires continuously loading the most current QA-Tile during the import process). *Summary: *Before anyone attempts to import this data, we need to create a plan first. I'm more than willing to help out, but this would be a large task and would need to be done collectively as a group. [0] https://github.com/mapbox/tippecanoe [1] https://github.com/osmottawa/micro-data-service [2] http://localhost:8111/import?new_layer=true&url=https://data.osmcanada.ca/{z}/{x}/{y}/ottawa-buildings.osm [3] https://data.osmcanada.com/15/9478/21019/ottawa-buildings.osm [4] https://osmlab.github.io/osm-qa-tiles/ *~~~~~~* *Denis Carriere* *GIS Software & Systems Specialist* On Tue, Mar 28, 2017 at 11:00 AM, OSM Volunteer stevea < [email protected]> wrote: > Hi Nathan: > > I've got pretty beefy hardware, but the "Bay Area" shapefile pointed to by > your recent post chokes my JOSM to a gasping strangle: >3.7 million > objects?! These need to be broken up further to smaller files, to either > the county level or even smaller to a sub-county level, in a sane way. You > may as well save them as .osm files (and host them on some other place > besides a Microsoft cloud), as shapefiles still remain a "foreign" (though > importable) format within OSM. > > SteveA > California > > > > On Mar 28, 2017, at 5:00 AM, [email protected] wrote: > > > > https://wiki.openstreetmap.org/wiki/Available_Building_Footprints > > > _______________________________________________ > Talk-us mailing list > [email protected] > https://lists.openstreetmap.org/listinfo/talk-us >
_______________________________________________ Talk-us mailing list [email protected] https://lists.openstreetmap.org/listinfo/talk-us
