Re: [OSM-dev] New full history dump available

2010-08-03 Thread Peter Körner

Am 02.08.2010 21:40, schrieb Stefan de Konink:


Could someone also put this out as a torrent?

I'm not sure if it would help anybody. As only a little number of users 
will download it, it will get well distributed in the torrent network. 
With a small number of seeds a torrent download will take a lot longer 
then the http download -- and nobody will use it.


Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] New full history dump available

2010-08-03 Thread Anthony
On Tue, Aug 3, 2010 at 2:06 PM, Peter Körner osm-li...@mazdermind.de wrote:
 Am 02.08.2010 21:40, schrieb Stefan de Konink:

 Could someone also put this out as a torrent?

 I'm not sure if it would help anybody. As only a little number of users will
 download it, it will get well distributed in the torrent network. With a
 small number of seeds a torrent download will take a lot longer then the
 http download -- and nobody will use it.

Is there still no support in torrent for http seeding?

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] New full history dump available

2010-08-03 Thread Peter Körner

Am 03.08.2010 20:13, schrieb Anthony:

Is there still no support in torrent for http seeding?


I think there is in some clients, but eg. not in my Synology 
DiskStation. Also: as long as an http seed is available, why should 
users take the torrent way when they can't take advantage of a big pool 
of peers?


Peter

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] New full history dump available

2010-08-03 Thread Anthony
On Tue, Aug 3, 2010 at 2:16 PM, Peter Körner osm-li...@mazdermind.de wrote:
 Am 03.08.2010 20:13, schrieb Anthony:

 Is there still no support in torrent for http seeding?

 I think there is in some clients, but eg. not in my Synology DiskStation.
 Also: as long as an http seed is available, why should users take the
 torrent way when they can't take advantage of a big pool of peers?

Because a small pool of peers is better than no pool of peers?

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] New full history dump available

2010-08-03 Thread Peter Körner

So here you are:
http://toolserver.org/~mazder/temp/full-planet-100801.osm.bz2.torrent

I'm seeding for the next months via my 640 kBit/s uplink. I added the 
webseed to the torrent. It would be better if those torrents would be 
created automatically and published in an rss feed.


Peter

Am 03.08.2010 20:21, schrieb Anthony:

On Tue, Aug 3, 2010 at 2:16 PM, Peter Körnerosm-li...@mazdermind.de  wrote:

Am 03.08.2010 20:13, schrieb Anthony:


Is there still no support in torrent for http seeding?


I think there is in some clients, but eg. not in my Synology DiskStation.
Also: as long as an http seed is available, why should users take the
torrent way when they can't take advantage of a big pool of peers?


Because a small pool of peers is better than no pool of peers?



___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] New full history dump available

2010-08-03 Thread Erik Johansson
On Mon, Aug 2, 2010 at 9:29 PM, Lars Francke lars.fran...@gmail.com wrote:
 Hi guys,

 Matt Amos was so nice to run the history export again.
 The result is available here:
 http://planet.openstreetmap.org/full-experimental/full-planet-100801.osm.bz2
 and it's grown from 13 GB in February to 17 GB. The regular planet has
 grown from 8 to 10 GB in the same time.

 Have fun and it would always be interesting to know if you're using
 it, having problems with it and what you're using it for.


This is a non issue, but interesting.

I ran bzip2recover on it and every two bz2 blocks are just ~100bytes..
I'm guessing this is an artifact  from parallel bzip2, but that it
could be so extreme was new to me.

Size in bytes for bz2 blocks in full planet history file:
36972 rec00614fullplanet.bz2
152  rec00615fullplanet.bz2

This is from the ordinary planet dump:
107188  rec00025plane.bz2
32877  rec00026planet.bz2

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] New full history dump available

2010-08-03 Thread Grant Slater
Well spotted. Different releases of pbzip2 were used. We'll fix this
in future releases. But unlikely to be more frequent then once every 2
months.

/ Grant

On 8/4/10, Erik Johansson e...@kth.se wrote:
 On Mon, Aug 2, 2010 at 9:29 PM, Lars Francke lars.fran...@gmail.com wrote:
 Hi guys,

 Matt Amos was so nice to run the history export again.
 The result is available here:
 http://planet.openstreetmap.org/full-experimental/full-planet-100801.osm.bz2
 and it's grown from 13 GB in February to 17 GB. The regular planet has
 grown from 8 to 10 GB in the same time.

 Have fun and it would always be interesting to know if you're using
 it, having problems with it and what you're using it for.


 This is a non issue, but interesting.

 I ran bzip2recover on it and every two bz2 blocks are just ~100bytes..
 I'm guessing this is an artifact  from parallel bzip2, but that it
 could be so extreme was new to me.

 Size in bytes for bz2 blocks in full planet history file:
 36972 rec00614fullplanet.bz2
 152  rec00615fullplanet.bz2

 This is from the ordinary planet dump:
 107188  rec00025plane.bz2
 32877  rec00026planet.bz2

 ___
 dev mailing list
 dev@openstreetmap.org
 http://lists.openstreetmap.org/listinfo/dev


-- 
Sent from my mobile device

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


[OSM-dev] New full history dump available

2010-08-02 Thread Lars Francke
Hi guys,

Matt Amos was so nice to run the history export again.
The result is available here:
http://planet.openstreetmap.org/full-experimental/full-planet-100801.osm.bz2
and it's grown from 13 GB in February to 17 GB. The regular planet has
grown from 8 to 10 GB in the same time.

Have fun and it would always be interesting to know if you're using
it, having problems with it and what you're using it for.

Cheers,
Lars

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev


Re: [OSM-dev] New full history dump available

2010-08-02 Thread Stefan de Konink

On Mon, 2 Aug 2010, Lars Francke wrote:


Matt Amos was so nice to run the history export again.
The result is available here:
http://planet.openstreetmap.org/full-experimental/full-planet-100801.osm.bz2
and it's grown from 13 GB in February to 17 GB. The regular planet has
grown from 8 to 10 GB in the same time.

Have fun and it would always be interesting to know if you're using
it, having problems with it and what you're using it for.



Could someone also put this out as a torrent?


Stefan

___
dev mailing list
dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/dev