Re: [OSM-dev] Binary Format, Performance, pbf2osm

2010-10-17 Thread Frederik Ramm
Hi, updated according to Scott's request (and subject fixed), comparison using the OSM Bavaria extract: File sizes: .osm 2462778377 .osm.pbf 134579577 (with compression=deflate and lossless) .osm.pbf 255103238 (uncompressed) .osm.bz2 223006298 (-2) .osm.gz 280224099

Re: [OSM-dev] Binary Format, Performance, pbf2osm

2010-10-17 Thread Stefan de Konink
On Sun, 17 Oct 2010, Frederik Ramm wrote: The *** case couldn't be tested: Error unpacking PrimitiveBlock message. The offending file is at http://www.remote.org/frederik/tmp/by-none.osm.pbf if someone wants to check what's wrong with it. Gonna fix that :) Stefan

Re: [OSM-dev] Binary Format, Performance, pbf2osm

2010-10-17 Thread Stefan de Konink
On Sun, 17 Oct 2010, Stefan de Konink wrote: On Sun, 17 Oct 2010, Frederik Ramm wrote: The *** case couldn't be tested: Error unpacking PrimitiveBlock message. The offending file is at http://www.remote.org/frederik/tmp/by-none.osm.pbf if someone wants to check what's wrong with it.

Re: [OSM-dev] Binary Format, Performance, pbf2osm

2010-10-17 Thread Stefan de Konink
On Sun, 17 Oct 2010, Stefan de Konink wrote: message 'PrimitiveBlock': missing required field 'stringtable' Error unpacking PrimitiveBlock message (gdb) print *hmsg $3 = {base = {descriptor = 0x406740, n_unknown_fields = 0, unknown_fields = 0x0}, bbox = 0x0, n_required_features = 0,

Re: [OSM-dev] Binary Format, Performance, pbf2osm

2010-10-17 Thread Stefan de Konink
On Sun, 17 Oct 2010, Frederik Ramm wrote: The *** case couldn't be tested: Error unpacking PrimitiveBlock message. The offending file is at http://www.remote.org/frederik/tmp/by-none.osm.pbf if someone wants to check what's wrong with it. I have now explicitly said raw_size in the

Re: [OSM-dev] Binary Format, Performance, pbf2osm

2010-10-17 Thread Frederik Ramm
Hi, updated after Stefan's bugfix. Only the line marked *** is new. File sizes: .osm 2462778377 .osm.pbf 134579577 (with compression=deflate and lossless) .osm.pbf 255103238 (uncompressed) .osm.bz2 223006298 (-2) .osm.gz 280224099 Decompression (saving to .osm.xml): from .osm.bz2

Re: [OSM-dev] Binary Format, Performance, pbf2osm

2010-10-17 Thread Scott Crosby
On Sun, Oct 17, 2010 at 6:34 AM, Stefan de Konink ste...@konink.de wrote: On Sun, 17 Oct 2010, Stefan de Konink wrote: message 'PrimitiveBlock': missing required field 'stringtable' Error unpacking PrimitiveBlock message (gdb) print *hmsg $3 = {base = {descriptor = 0x406740,

Re: [OSM-dev] Binary Format, Performance, pbf2osm

2010-10-17 Thread Stefan de Konink
-BEGIN PGP SIGNED MESSAGE- Hash: SHA512 Op 17-10-10 22:13, Scott Crosby schreef: I left the raw_size unset, and you're getting the default value of 0. If this is by design, make it explicit on the wiki page (aka: this value is unset if no compression is used) I fixed it already... but