Re: [osmosis-dev] pgsnapshot memory options
On 2014-06-19 12:16 PM, Paul Norman wrote: Something else that's come up is that the node store for --wpd is very inefficient. osm2pgsql shows that you can store all the nodes in the planet in ~20GB with its dense/sparse cache, or in ~23GB as a simple flat array (--flat-nodes). Osmosis needed about twice that the last time I checked. Just as a follow-up, at the end of the nodes stage, Osmosis needed 45GB (2^10-based) of RAM, and is entirely CPU-bound during ways. ___ osmosis-dev mailing list osmosis-dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/osmosis-dev
Re: [OSM-dev] places of business listings
I was looking for something similar a while ago for a different project and found nothing free. There are plenty of paid datasets. I do think there should be some kind of open retailer database that lists locations and operating hours of places. It wouldn’t be too difficult to index most major retailer sites to get this information. It really should exist separate from openstreetmap. It’s definitely something I’d be interested in contributing to. On Jun 18, 2014, at 4:10 PM, Sachin Dole sd...@genvega.com wrote: Actually, the intent of my original question was a little different. I like the OSM data as it is and with tools such as the ones suggested here, its fairly easy to add new data over periods of time, however, I was curious, whether there is any open source project or movement to do something like localeze (http://www.neustarlocaleze.biz/directory/index.aspx) or dnb.com or yext.com or publisher.yp.com. For example, for a fee and restricted license, yp.com can give me phone numbers, websites, hours of operation, coupons for a local business. How do we make that available on OSM under odbl? -- Thanks Sachin On Wed, Jun 18, 2014 at 2:57 PM, Sachin Dole sd...@genvega.com wrote: Thank you! OnOsm.org looks promising. I have the same legality question about how Joi has suggested his links. However, I was able to click around on that website and was able to create a single poi in osm based on my personal knowledge. Followed below is the changeset info that Joi's url gave me, further, here is the url of the POI that I just added : http://www.openstreetmap.org/node/2922366101. I think this is pretty cool. Now, I just wonder who owns that site and if they have any licensing requirements for what I would do on their site. Changeset opened: 23012165 POI created: 2922366101 Changeset closed Thanks ahain! On Wed, Jun 18, 2014 at 2:31 PM, Serge Wroclawski emac...@gmail.com wrote: onosm.org run by Ian Dees is a good one. It creates notes, which isn't perfect, but it's the best thing we have at the moment IMHO. - Serge On Wed, Jun 18, 2014 at 2:12 PM, Sachin Dole sd...@genvega.com wrote: Hello, Is there any ongoing project or effort to add places of business to OSM? I am looking for free/open source data such as the type provided by dnb or yellow pages api. I wont be surprised if there is none, but was wondering if there is any work on this. Thank you! Sachin Dole www.trelair.com - this is still a work in progress startup ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev -- President | Genvega Inc. | www.genvega.com | tel: 630.290.2561 -- President | Genvega Inc. | www.genvega.com | tel: 630.290.2561 ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] places of business listings
Am 18.06.2014 21:57, schrieb Sachin Dole: .. cool. Now, I just wonder who owns that site and if they have any licensing requirements for what I would do on their site. Every site targeted at a German audience*, including non-commercial ones, is required to have a so called Impressum stating who operates the site etc.. If you scroll down to the bottom you will find the link that will give you everything you want to know and more. As to the legality, there is just no way POIs from 4sq can be copied into OSM. However I suspect what the operator is simply doing is linking from the OSM POI to the corresponding 4sq meta information which is likely OK from an OSM pov, and maybe it is OK with 4sq too. Simon * don't get me started on the fact that OSM doesn't have it. signature.asc Description: OpenPGP digital signature ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] SOTM EU Imposm presentation: osm2pgsql memory usage with large extracts
Paul Norman wrote 2014-06-18 19:44: The Imposm presentation states that larger extracts in osm2pgsql require comparable resources to a full planet import due to the cache structure used. Having not observed this when importing, I collected the data to test it while performing an import of the Germany Geofabrik extract from June 1st. At a size of 2.2GB (10^9 bytes/GB), this is a large extract. osm2pgsql reports the storage efficiency of the node cache, in this case 51.85%. This is a typical efficiency for extracts. This works out to a minimum memory of 2.7GB to keep all nodes in the memory cache. It is of course possible to import with less, but then osm2pgsql will fetch node locations from the database. I would generally question if a machine with under 4GB of RAM is suitable for rendering such a large area, regardless of OSM to database conversion tools used. OSM data are not only used for rendering. With GDAL I can easily import germany-latest.osm.pbf into PostGIS on a hosted server with only 700 MB of RAM and it is perfectly suitable for serving data out through WFS service. I do use the same machine for rendering into WMS with Mapserver and it works also but honestly, it is not very fast. PostgreSQL+PostGIS runs also on the same tiny server. Importing with osm2pgsql is not possible and if I want to play with osm2pgsql tables I must do import with home computer and transfer the tables with pgdump/restore which is not very handy but with my budget I must tolerate it. -Jukka Rahkonen- ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
