Re: [OSM-dev] Full History Extracts
Hi Am 26.02.2014 11:56, schrieb bibekshres...@gmail.com: May be someone from Geofabrik can help do a regular dump here http://download.geofabrik.de/asia.html that would be big help. I'm trying to do weekly extracts. Just check out http://osm.personalwerk.de/full-history-extracts/. Regards, Peter ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
Am 02.03.2014 07:23, schrieb amrit karmacharya: Thanks for the extract, I just went through http://osm.personalwerk.de/clipbounds/asia/ would like to share that india and pakistan also lie in southern-asia *g thank you. fixed that. Next week's extract will show the repaired directory structure. Regards, Peter On Wed, Feb 26, 2014 at 1:43 PM, Peter Körner osm-li...@mazdermind.de mailto:osm-li...@mazdermind.de wrote: Hi Am 25.02.2014 07:45, schrieb amrit karmacharya: Thank you very much, this is a big help to developers here. Np. If you need other extracts - smaller or bigger - just drop me a line at my private address: o...@mazdermind.de mailto:o...@mazdermind.de I'd be gladfully using the processing resources available to me to help people with thin internet connectivity. Regards, Peter On Mon, Feb 24, 2014 at 5:03 PM, Peter Körner osm-li...@mazdermind.de mailto:osm-li...@mazdermind.de mailto:osm-li...@mazdermind.de mailto:osm-li...@mazdermind.de wrote: Hi Am 14.02.2014 05:56, schrieb amrit karmacharya: Can you make a extract for Nepal? As of now, I need to download the whole asia and extract nepal which covers only 0.3% of asia. There are no other options available. Here you go: http://osm.personalwerk.de/full-history-extracts/latest/asia/southern-asia/ I'll try to update them weekly. Regards, Peter ___ dev mailing list dev@openstreetmap.org mailto:dev@openstreetmap.org mailto:dev@openstreetmap.org mailto:dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
May be someone from Geofabrik can help do a regular dump here http://download.geofabrik.de/asia.html that would be big help. -- Bibek Shrestha bibekshrestha at gmail dot com Twitter: http://twitter.com/bibstha http://www.bibekshrestha.com/ Prove It On Wed, Feb 26, 2014 at 8:58 AM, Peter Körner osm-li...@mazdermind.dewrote: Hi Am 25.02.2014 07:45, schrieb amrit karmacharya: Thank you very much, this is a big help to developers here. Np. If you need other extracts - smaller or bigger - just drop me a line at my private address: o...@mazdermind.de I'd be gladfully using the processing resources available to me to help people with thin internet connectivity. Regards, Peter On Mon, Feb 24, 2014 at 5:03 PM, Peter Körner osm-li...@mazdermind.de mailto:osm-li...@mazdermind.de wrote: Hi Am 14.02.2014 05:56, schrieb amrit karmacharya: Can you make a extract for Nepal? As of now, I need to download the whole asia and extract nepal which covers only 0.3% of asia. There are no other options available. Here you go: http://osm.personalwerk.de/full-history-extracts/latest/asia/southern-asia/ I'll try to update them weekly. Regards, Peter ___ dev mailing list dev@openstreetmap.org mailto:dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
Hi Am 25.02.2014 07:45, schrieb amrit karmacharya: Thank you very much, this is a big help to developers here. Np. If you need other extracts - smaller or bigger - just drop me a line at my private address: o...@mazdermind.de I'd be gladfully using the processing resources available to me to help people with thin internet connectivity. Regards, Peter On Mon, Feb 24, 2014 at 5:03 PM, Peter Körner osm-li...@mazdermind.de mailto:osm-li...@mazdermind.de wrote: Hi Am 14.02.2014 05:56, schrieb amrit karmacharya: Can you make a extract for Nepal? As of now, I need to download the whole asia and extract nepal which covers only 0.3% of asia. There are no other options available. Here you go: http://osm.personalwerk.de/full-history-extracts/latest/asia/southern-asia/ I'll try to update them weekly. Regards, Peter ___ dev mailing list dev@openstreetmap.org mailto:dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
Hi Am 14.02.2014 05:56, schrieb amrit karmacharya: Can you make a extract for Nepal? As of now, I need to download the whole asia and extract nepal which covers only 0.3% of asia. There are no other options available. Here you go: http://osm.personalwerk.de/full-history-extracts/latest/asia/southern-asia/ I'll try to update them weekly. Regards, Peter ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
Thank you very much, this is a big help to developers here. On Mon, Feb 24, 2014 at 5:03 PM, Peter Körner osm-li...@mazdermind.dewrote: Hi Am 14.02.2014 05:56, schrieb amrit karmacharya: Can you make a extract for Nepal? As of now, I need to download the whole asia and extract nepal which covers only 0.3% of asia. There are no other options available. Here you go: http://osm.personalwerk.de/full-history-extracts/latest/asia/southern-asia/ I'll try to update them weekly. Regards, Peter ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
here is the bounding box for nepal. http://lxbarth.com/bbox/#79.716797,26.362689,88.439941,30.449008,7,28.435224077528904,84.5068359374 On Mon, Feb 17, 2014 at 10:01 AM, amrit karmacharya amrit...@gmail.comwrote: This is a poly file, used by most of the OSM processing softwares. I got it from cloudmade. On Fri, Feb 14, 2014 at 9:30 PM, Peter Körner osm-li...@mazdermind.dewrote: Hi Am 14.02.2014 05:56, schrieb amrit karmacharya: Can you make a extract for Nepal? As of now, I need to download the whole asia and extract nepal which covers only 0.3% of asia. There are no other options available. I can add Nepal to the list of extracts, if you supply me with a bbox or an outline of the area you want. I'll take tome time though, because the server's harddisk have an outage an we're preparing a repair atm. While it's in this degraded state I'll not run the extract service. Peter ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
Osmosis doesn't work with history files. You need to use osmium for that. Old version at https://github.com/joto/osmium, new version at osmcode.org. Jochen Thanks very much for this reply. I will give Osmium a try. Sterling ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
Hi Am 14.02.2014 05:56, schrieb amrit karmacharya: Can you make a extract for Nepal? As of now, I need to download the whole asia and extract nepal which covers only 0.3% of asia. There are no other options available. I can add Nepal to the list of extracts, if you supply me with a bbox or an outline of the area you want. I'll take tome time though, because the server's harddisk have an outage an we're preparing a repair atm. While it's in this degraded state I'll not run the extract service. Peter ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
Peter Körner osm-lists at mazdermind.de writes: Hi I made fresh history extracts [1] from the new full-history dumps [2]. If you miss your region or want a small custom tailored area, just drop me a line or follow the instructions at [3] to split the file yourself. Regards, Peter [1| http://osm.personalwerk.de/full-history-extracts/2014/2014-01-06/ [2] http://planet.osm.org/planet/experimental/ [3] https://github.com/MaZderMind/osm-history-renderer/blob/master/TUTORIAL.md Hello Peter. These extracts look very useful for my project which only focuses on some areas in the western hemisphere. I am trying to convert the Central and South American histories (which are relatively small) to .osm XML. I ran the following Osmosis command (which works fine on an osm.pbf non history file): osmosis --read-pbf c:\data\OSMdownloads\central-america.osh.pbf --write-xml c:\data\OSMdownloads\CAmerica.osm This immediately failed and it looks like the crux of the error message is: SEVERE: Thread for task 1-read-pbf failed org.Openstreetmap.osmosis.core.OsmosisRuntimeException: File requires unknown feature: HistoricalInformation I am wondering if this is an issue with the history extract file, or am I going about this task the wrong way? Thanks for any help, Sterling ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
On Do, Feb 13, 2014 at 03:22:44 +, Sterling Quinn wrote: Peter Körner osm-lists at mazdermind.de writes: Hi I made fresh history extracts [1] from the new full-history dumps [2]. If you miss your region or want a small custom tailored area, just drop me a line or follow the instructions at [3] to split the file yourself. Regards, Peter [1| http://osm.personalwerk.de/full-history-extracts/2014/2014-01-06/ [2] http://planet.osm.org/planet/experimental/ [3] https://github.com/MaZderMind/osm-history-renderer/blob/master/TUTORIAL.md Hello Peter. These extracts look very useful for my project which only focuses on some areas in the western hemisphere. I am trying to convert the Central and South American histories (which are relatively small) to .osm XML. I ran the following Osmosis command (which works fine on an osm.pbf non history file): osmosis --read-pbf c:\data\OSMdownloads\central-america.osh.pbf --write-xml c:\data\OSMdownloads\CAmerica.osm This immediately failed and it looks like the crux of the error message is: SEVERE: Thread for task 1-read-pbf failed org.Openstreetmap.osmosis.core.OsmosisRuntimeException: File requires unknown feature: HistoricalInformation I am wondering if this is an issue with the history extract file, or am I going about this task the wrong way? Osmosis doesn't work with history files. You need to use osmium for that. Old version at https://github.com/joto/osmium, new version at osmcode.org. Jochen -- Jochen Topf joc...@remote.org http://www.jochentopf.com/ +49-721-388298 ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full History Extracts
Hi, Can you make a extract for Nepal? As of now, I need to download the whole asia and extract nepal which covers only 0.3% of asia. There are no other options available. On Thu, Feb 13, 2014 at 7:58 PM, Jochen Topf joc...@remote.org wrote: On Do, Feb 13, 2014 at 03:22:44 +, Sterling Quinn wrote: Peter Körner osm-lists at mazdermind.de writes: Hi I made fresh history extracts [1] from the new full-history dumps [2]. If you miss your region or want a small custom tailored area, just drop me a line or follow the instructions at [3] to split the file yourself. Regards, Peter [1| http://osm.personalwerk.de/full-history-extracts/2014/2014-01-06/ [2] http://planet.osm.org/planet/experimental/ [3] https://github.com/MaZderMind/osm-history-renderer/blob/master/TUTORIAL.md Hello Peter. These extracts look very useful for my project which only focuses on some areas in the western hemisphere. I am trying to convert the Central and South American histories (which are relatively small) to .osm XML. I ran the following Osmosis command (which works fine on an osm.pbf non history file): osmosis --read-pbf c:\data\OSMdownloads\central-america.osh.pbf --write-xml c:\data\OSMdownloads\CAmerica.osm This immediately failed and it looks like the crux of the error message is: SEVERE: Thread for task 1-read-pbf failed org.Openstreetmap.osmosis.core.OsmosisRuntimeException: File requires unknown feature: HistoricalInformation I am wondering if this is an issue with the history extract file, or am I going about this task the wrong way? Osmosis doesn't work with history files. You need to use osmium for that. Old version at https://github.com/joto/osmium, new version at osmcode.org. Jochen -- Jochen Topf joc...@remote.org http://www.jochentopf.com/ +49-721-388298 ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Full History Extracts
Hi I made fresh history extracts [1] from the new full-history dumps [2]. If you miss your region or want a small custom tailored area, just drop me a line or follow the instructions at [3] to split the file yourself. Regards, Peter [1| http://osm.personalwerk.de/full-history-extracts/2014/2014-01-06/ [2] http://planet.osm.org/planet/experimental/ [3] https://github.com/MaZderMind/osm-history-renderer/blob/master/TUTORIAL.md ___ dev mailing list dev@openstreetmap.org https://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full history extracts
Hi, On Sat, 24 Dec 2011 13:47:48 +1100 Brett Henderson br...@bretth.com wrote: Osmosis doesn't currently support the full history data format. It only supports the alternative osmChange format. Suppose I were to write a simple Perl script that streams the full history file (which is sorted by type then id then version), and wrap every version 1 entry in create.../create and every other entry in modify.../modify unless it has visible=false in which case I'd choose delete.../delete. Do you think this would then work with Osmosis? Bye Frederik ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full history extracts
On 24/12/2011, at 8:19 PM, Frederik Ramm frede...@remote.org wrote: Hi, On Sat, 24 Dec 2011 13:47:48 +1100 Brett Henderson br...@bretth.com wrote: Osmosis doesn't currently support the full history data format. It only supports the alternative osmChange format. Suppose I were to write a simple Perl script that streams the full history file (which is sorted by type then id then version), and wrap every version 1 entry in create.../create and every other entry in modify.../modify unless it has visible=false in which case I'd choose delete.../delete. Do you think this would then work with Osmosis? Yes it would. But the diff application logic isn't very efficient because it runs a fair few queries per entity to be updated. Several to delete any existing identical items, plus the various history and current inserts. It would take forever to complete the load. I think a better approach would be to create dump files to be loaded in bulk, but not even osm files can be loaded into apidb using osmosis currently. The existing apidb code is a minimal update to previous MySQL code and doesn't take advantage of pgsql bulk loading like the pgsnapshot code does. Just a simple matter of coding ;-) Bye Frederik ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full history extracts
Hi, Suppose I were to write a simple Perl script that streams the full history file (which is sorted by type then id then version), and wrap every version 1 entry in create.../create and every other entry in modify.../modify unless it has visible=false in which case I'd choose delete.../delete. if I got you right, you could use osmconvert to do the trick. Example: Input file a.osh: osm version=0.6 node id=21 version=1 visible=false lat=1 lon=1/ node id=21 version=2 visible=false lat=1 lon=1/ node id=21 version=3 visible=true lat=1 lon=1/ node id=22 version=1 visible=true lat=1 lon=1/ /osm Call: ./osmconvert a.osh -o=a.osc Output file a.osc: ?xml version='1.0' encoding='UTF-8'? osmChange version=0.6 generator=osmconvert 0.5W delete node id=21 version=1/ node id=21 version=2/ /delete modify node id=21 lat=1. lon=1. version=3/ /modify create node id=22 lat=1. lon=1. version=1/ /create /osmChange Regards Markus Original-Nachricht Datum: Sat, 24 Dec 2011 10:19:27 +0100 Von: Frederik Ramm frede...@remote.org An: dev@openstreetmap.org Betreff: Re: [OSM-dev] Full history extracts Hi, On Sat, 24 Dec 2011 13:47:48 +1100 Brett Henderson br...@bretth.com wrote: Osmosis doesn't currently support the full history data format. It only supports the alternative osmChange format. Suppose I were to write a simple Perl script that streams the full history file (which is sorted by type then id then version), and wrap every version 1 entry in create.../create and every other entry in modify.../modify unless it has visible=false in which case I'd choose delete.../delete. Do you think this would then work with Osmosis? Bye Frederik ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full history extracts
Hi SImon This seems very interesting ! Are these full history extracts compatible with the osmosis apidb database structure ? I mean, how can I import them in osmosi apidb, then use the minutely diff to stay up to date ? Thanks anyway ! kimaidou 2011/12/22 Simon Poole si...@poole.ch I've regenerated all statistics on odbl.poole.ch from the most recent full history dump (2011-12-08) and have uploaded most of the extracts to http://odbl.poole.ch/extracts/ . I have more (continents, German states etc) that I can upload on request (uploading from home is simply -very- slow, that is why I just don't dump everything on the server) The extracts were cut with the softcut algorithm and are in XML format. Simon __**_ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.**org/listinfo/devhttp://lists.openstreetmap.org/listinfo/dev ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
Re: [OSM-dev] Full history extracts
On 24 December 2011 00:01, kimaidou kimai...@gmail.com wrote: Hi SImon This seems very interesting ! Are these full history extracts compatible with the osmosis apidb database structure ? I mean, how can I import them in osmosi apidb, then use the minutely diff to stay up to date ? Osmosis doesn't currently support the full history data format. It only supports the alternative osmChange format. As far as I'm aware there isn't a way to populate an apidb database with the full history files. Brett ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
[OSM-dev] Full history extracts
I've regenerated all statistics on odbl.poole.ch from the most recent full history dump (2011-12-08) and have uploaded most of the extracts to http://odbl.poole.ch/extracts/ . I have more (continents, German states etc) that I can upload on request (uploading from home is simply -very- slow, that is why I just don't dump everything on the server) The extracts were cut with the softcut algorithm and are in XML format. Simon ___ dev mailing list dev@openstreetmap.org http://lists.openstreetmap.org/listinfo/dev
