[OSM-dev] Writing PBF

2011-12-13 Thread Jochen Topf
Hi! The PBF format has maximum block sizes. Osmium used to just write 8000 objects into each block and hope that there is enough space. Turns out that there are cases where that doesn't work. If there are a lot of very large relations, the block can overflow. Somebody noticed that problem and

Re: [OSM-dev] Writing PBF

2011-12-13 Thread marqqs
: Jochen Topf joc...@remote.org An: dev@openstreetmap.org Betreff: [OSM-dev] Writing PBF Hi! The PBF format has maximum block sizes. Osmium used to just write 8000 objects into each block and hope that there is enough space. Turns out that there are cases where that doesn't work

Re: [OSM-dev] Writing PBF

2011-12-13 Thread Jochen Topf
On Tue, Dec 13, 2011 at 12:39:55PM +0100, mar...@gmx.eu wrote: If you limit the number of objects only to maximum block size (32 MiB), you will get smaller PBF files. I noticed this effect when writing the PBF-write module for osmconvert. The files are much smaller although I did not care

Re: [OSM-dev] Writing PBF

2011-12-13 Thread Peter Körner
Am 13.12.2011 15:04, schrieb Jochen Topf: Has anybody any data on how much smaller the files get with sorted vs. unsorted string table? Sorting the string table means there is a lot more work and a lot more main memory needed for the PBF writer. I encountered shrinkage of around 1-2% of the

Re: [OSM-dev] Writing PBF

2011-12-13 Thread marqqs
objects/block (download file) - n objects/block, but 30..31 MB/block (osmconvert) saves about 5% file size. Markus Original-Nachricht Datum: Tue, 13 Dec 2011 16:39:00 +0100 Von: Peter Körner osm-li...@mazdermind.de An: dev@openstreetmap.org Betreff: Re: [OSM-dev] Writing PBF Am