Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-23 Thread VeaaC FDIRCT
Any idea when a final version of the file format will be available? I plan to provide an importer plugin for the binary format in MoNav pretty soon, as reading the XML file takes up most of the preprocessing phase right now. Greetings Christian Vetter

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-23 Thread Ævar Arnfjörð Bjarmason
On Wed, Sep 22, 2010 at 23:50, Frederik Ramm frede...@remote.org wrote: I always viewed the Geofabrik extracts as a service to the community who build interesting things, or try out stuff - and who can also be counted on for a little bit of willingness to adapt to change, or add a little extra

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-23 Thread Anthony
On Thu, Sep 23, 2010 at 1:49 PM, Ævar Arnfjörð Bjarmason ava...@gmail.com wrote: hopefully the resources being freed up on your end by not grinding through gigabytes of XML every day could be spent on something more worthwhile as a result. Definitely. But how are the pbf files going to be

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-23 Thread Frederik Ramm
Hi, Ævar Arnfjörð Bjarmason wrote: I use the geofabrik services and I must say I'm slightly irked at the tone this discussion has taken. That you're providing these services for free *at all* is not a given, and it's great that you continue to do so. Thank you for saying that. - Then again

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-23 Thread Frederik Ramm
Hi, Anthony wrote: Definitely. But how are the pbf files going to be created without grinding through gigabytes of XML? Well once you have a pbf planet, you only have to grind through the .osc files each day (--read-change diff.osc --read-bin planet.pbf --ac --write-bin new-planet.pbf).

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Shaun McDonald
On 22 Sep 2010, at 06:49, Anthony wrote: On Tue, Sep 21, 2010 at 6:20 PM, Frederik Ramm frede...@remote.org wrote: Easy to do - just download the .osm.pbf and run osmosis --read-bin country.osm.pbf --write-xml country.osm Do you have to have java installed to do that? yes Shaun

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread John Smith
On 22 September 2010 17:17, Frederik Ramm frede...@remote.org wrote: mkgmap support the new format, and that anyone with Osmosis+Java installed It might be useful to make a simple C based application that just converts from the new format to OSM XML, that way you could pipe the input to the

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Scott Crosby
On Wed, Sep 22, 2010 at 2:17 AM, Frederik Ramm frede...@remote.org wrote: Hi, Kai Krueger wrote: Easy to do - just download the .osm.pbf and run osmosis --read-bin country.osm.pbf --write-xml country.osm May I suggest it be run on planet.openstreetmap.org then as part of the core

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Frederik Ramm
Hi, Anthony wrote: Mine would be that I don't feel like installing osmosis+java. I'm sure we'll get a pure C/C++ implementation sooner or later; even so, there certainly will be people who don't feel like installing it. Another problem would be if osmosis doesn't support piping the output

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Anthony
On Wed, Sep 22, 2010 at 8:25 AM, Scott Crosby scro...@cs.rice.edu wrote: On Wed, Sep 22, 2010 at 2:17 AM, Frederik Ramm frede...@remote.org wrote: Making the excerpts basically occupies a whole big machine for half a day. It might be possible to do it on a weekly basis on

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Anthony
On Wed, Sep 22, 2010 at 8:34 AM, Frederik Ramm frede...@remote.org wrote: It does support piping the output XML to stdout. That's good to hear. Yes, maybe that was my fault for not making this clear; I am only talking about the files that are now being made available on the geofabrik.de site.

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 22-09-10 14:34, Frederik Ramm schreef: I'm sure we'll get a pure C/C++ implementation sooner or later; even so, there certainly will be people who don't feel like installing it. If noone steps up for the reference implementation before Friday

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Grant Slater
On 21 September 2010 20:38, Kai Krueger kakrue...@gmail.com wrote: Frederik Ramm wrote: (and kick out the .bz2 stuff soon after) Not sure if I am interpreting this right, but are you suggesting to stop offering the daily xml extracts? If yes, then I think someone else needs to step up and

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Peter Körner
Am 22.09.2010 15:23, schrieb Grant Slater: I quite like the .osm.bz2 format. I don't see it being kicked off http://planet.osm.org anytime soon. Parallel distribution is an option. Yes it hast definitive advantages as a primary data source. The biggest one that I can see is, that it is easily

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread John Smith
On 22 September 2010 22:37, Anthony o...@inbox.org wrote: How long does it take to just make a compressed psql binary dump? This is why XML is used, it's database independent, there is apps like navit and mkgmap that use their own format, further more the psql binary dump may not include all the

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread John Smith
On 22 September 2010 23:23, Grant Slater openstreet...@firefishy.com wrote: I quite like the .osm.bz2 format. I don't see it being kicked off http://planet.osm.org anytime soon. Parallel distribution is an option. Considering Scott was able to get the full planet dump under 5G it seems a

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-22 Thread Kai Krueger
Grant Slater wrote: I quite like the .osm.bz2 format. I don't see it being kicked off http://planet.osm.org anytime soon. Parallel distribution is anoption. Well they would first have to be added as the extracts don't currently live on planet.osm.org ;-) Parallel distribution would be ideal

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-21 Thread Frederik Ramm
Hi, Scott Crosby wrote: This has been done. RC2 is in osmosis trunk. Changes are almost exclusively to the underlying osmbin.jar with no format incompatibilities. Changes include: I've been using it for a few days now and it looks promising; I might be able to publish regular .osm.pbf

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-21 Thread Kai Krueger
Frederik Ramm wrote: (and kick out the .bz2 stuff soon after) Not sure if I am interpreting this right, but are you suggesting to stop offering the daily xml extracts? If yes, then I think someone else needs to step up and replace them, as they are quite an important part of using

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-21 Thread Scott Crosby
On Tue, Sep 21, 2010 at 5:30 AM, Frederik Ramm frede...@remote.org wrote: Hi, Scott Crosby wrote: This has been done. RC2 is in osmosis trunk. Changes are almost exclusively to the underlying osmbin.jar with no format incompatibilities. Changes include: I've been using it for a few

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-21 Thread Frederik Ramm
Hi, Kai Krueger wrote: Not sure if I am interpreting this right, but are you suggesting to stop offering the daily xml extracts? Yes. If yes, then I think someone else needs to step up and replace them, Easy to do - just download the .osm.pbf and run osmosis --read-bin country.osm.pbf

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-21 Thread Stefan de Konink
On Wed, 22 Sep 2010, Frederik Ramm wrote: My guess is that 95% of people who use these files process them either with osmosis, or mkgmap, or osm2pgsql. Don't make the same mistake as with disabling the gazetteer. Legacy can be useful, is there currently a plain C implementation with a

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-21 Thread Kai Krueger
Hi, Frederik Ramm wrote: Easy to do - just download the .osm.pbf and run osmosis --read-bin country.osm.pbf --write-xml country.osm May I suggest it be run on planet.openstreetmap.org then as part of the core services alongside the regular full planet dump? Thanks, Kai -- View this

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-12 Thread Scott Crosby
On Sat, Sep 4, 2010 at 10:51 PM, Scott Crosby scro...@cs.rice.edu wrote: The OSM binary interchange fileformat is now part of osmosis trunk and is fully functional. This is the last chance to make potentially incompatible changes. In a week or two, I will add the design doc and command line

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-12 Thread Frederik Ramm
Hi, Scott Crosby wrote: Any better ideas for what to call the format? There's 3 other 'binary formats' floating around? Maybe the protobuf binary format? Or are any of the others using that as well? Bye Frederik -- Frederik Ramm ## eMail frede...@remote.org ## N49°00'09 E008°23'33

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-06 Thread Anthony
On Sat, Sep 4, 2010 at 11:51 PM, Scott Crosby scro...@cs.rice.edu wrote: The OSM binary interchange fileformat is now part of osmosis trunk and is fully functional. What is this going to be used for? Is planet.openstreetmap.org going to start offering binary dumps? Are the XML dumps going to

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-05 Thread Peter Körner
Am 05.09.2010 05:51, schrieb Scott Crosby: This schema is more expressive than the current XML which only includes a 'source' field in thebounds tag. Should I alter my schema to have just one field, 'source'? Or define a mapping between this schema and current XML? If I define a mapping, any

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-05 Thread Scott Crosby
On Sun, Sep 5, 2010 at 7:02 AM, Peter Körner osm-li...@mazdermind.de wrote: Am 05.09.2010 05:51, schrieb Scott Crosby: This schema is more expressive than the current XML which only includes a 'source' field in thebounds  tag. Should I alter my schema to have just one field, 'source'? Or

Re: [OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-05 Thread Scott Crosby
On Sun, Sep 5, 2010 at 11:42 AM, Frederik Ramm frede...@remote.org wrote: Scott, Scott Crosby wrote: message HeaderBlock {  required HeaderBBox bbox = 1;  // Author, name, and version number of the dataset in this file. (to permit  // patches/updates to be incrementally applied)  

[OSM-dev] Release candidate for OSM binary format is in osmosis trunk.

2010-09-04 Thread Scott Crosby
The OSM binary interchange fileformat is now part of osmosis trunk and is fully functional. This is the last chance to make potentially incompatible changes. In a week or two, I will add the design doc and command line options doc to the wiki. After that, schema changes will be much more