Re: [OSM-talk] bz2-format of the planet-latest file
On Mittwoch, 7. April 2010, andrzej zaborowski wrote: You can find the tool at http://compression.ca/pbzip2/ Just for the logs: I've found bug reports that describes the problem: http://www.netbsd.org/cgi-bin/query-pr-single.pl?number=41793 http://bugs.python.org/issue1625 I haven't mentioned in the first mail that I'm using the python bz2 module. (Python 2.6.2 (r262:71600, Oct 24 2009, 03:15:21) on openSUSE 11.2) Regards Werner ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
[OSM-talk] bz2-format of the planet-latest file
Hi there, I'm currently playing on a random access tool for compressed osm files. While my tool works fine for all files from http://download.geofabrik.de/osm/europe/, I've problems with the latest planet file. While all files from geofabrik are only single bz2 streams it seems that the planet consists of several independant streams that have many end of stream in the middle of the bz2 file. After recompressing the planet with bzcat planet-latest.osm.bz2 |bzip2 planet-recoded.osm.bz2 I can read the created planet-recoded with my script now. Does anyone know what is in the planet? Which tool is used to compress the planet? Links: Fileformat of bz2: http://en.wikipedia.org/wiki/Bzip2#File_format Regards Werner (werner2101) ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] bz2-format of the planet-latest file
The planet is compressed with a multi-threaded bz2 to make the generation faster. Shaun On 6 Apr 2010, at 23:09, Werner Hoch wrote: Hi there, I'm currently playing on a random access tool for compressed osm files. While my tool works fine for all files from http://download.geofabrik.de/osm/europe/, I've problems with the latest planet file. While all files from geofabrik are only single bz2 streams it seems that the planet consists of several independant streams that have many end of stream in the middle of the bz2 file. After recompressing the planet with bzcat planet-latest.osm.bz2 |bzip2 planet-recoded.osm.bz2 I can read the created planet-recoded with my script now. Does anyone know what is in the planet? Which tool is used to compress the planet? Links: Fileformat of bz2: http://en.wikipedia.org/wiki/Bzip2#File_format Regards Werner (werner2101) ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
Re: [OSM-talk] bz2-format of the planet-latest file
On 7 April 2010 00:17, Shaun McDonald sh...@shaunmcdonald.me.uk wrote: The planet is compressed with a multi-threaded bz2 to make the generation faster. You can find the tool at http://compression.ca/pbzip2/ Cheers ___ talk mailing list talk@openstreetmap.org http://lists.openstreetmap.org/listinfo/talk
