Re: Accessibility of official jigdo files for Sarge

2003-08-01 Thread Richard Atterer
On Thu, Jul 31, 2003 at 09:26:52PM +0200, Richard Atterer wrote: Hm, is this feature also somehow available in the Debian zlib packages? jigdo-file uses zlib to compress the .template files... Hm, it just occurred to me that it might be possible for me to allow rsyncability for .template files

Re: gzip/zlib rsyncable (was: Accessibility of official jigdo files for Sarge)

2003-08-01 Thread Conny Brunnkvist
Richard Atterer wrote: On Thu, Jul 31, 2003 at 08:35:11PM +0200, Conny Brunnkvist wrote: --rsyncable Make rsync-friendly archive Hm, is this feature also somehow available in the Debian zlib packages? jigdo-file uses zlib to compress the .template files... I understand that rsyncable is the

Re: Accessibility of official jigdo files for Sarge

2003-08-01 Thread Richard Atterer
On Thu, Jul 31, 2003 at 09:26:52PM +0200, Richard Atterer wrote: Hm, is this feature also somehow available in the Debian zlib packages? jigdo-file uses zlib to compress the .template files... Hm, it just occurred to me that it might be possible for me to allow rsyncability for .template files

Re: Accessibility of official jigdo files for Sarge

2003-07-31 Thread Conny Brunnkvist
John Winters wrote: IMHO, rsync is not more efficient for mirroring .jigdo/.template files than http/ftp, because all the data is gzipped. Some more mirrors for the images on gluck would still be nice, though. So they are! Funny, I could have sworn the .template files used to be text.

Re: Accessibility of official jigdo files for Sarge

2003-07-31 Thread Richard Atterer
On Thu, Jul 31, 2003 at 08:35:11PM +0200, Conny Brunnkvist wrote: --rsyncable Make rsync-friendly archive Maybe this feature could be of interest here? I haven't experimented with the effects myself yet though. Hm, is this feature also somehow available in the Debian zlib packages?

Re: Accessibility of official jigdo files for Sarge

2003-07-31 Thread Conny Brunnkvist
John Winters wrote: IMHO, rsync is not more efficient for mirroring .jigdo/.template files than http/ftp, because all the data is gzipped. Some more mirrors for the images on gluck would still be nice, though. So they are! Funny, I could have sworn the .template files used to be text.

Re: Accessibility of official jigdo files for Sarge

2003-07-31 Thread Richard Atterer
On Thu, Jul 31, 2003 at 08:35:11PM +0200, Conny Brunnkvist wrote: --rsyncable Make rsync-friendly archive Maybe this feature could be of interest here? I haven't experimented with the effects myself yet though. Hm, is this feature also somehow available in the Debian zlib packages?

Re: Accessibility of official jigdo files for Sarge

2003-07-30 Thread Greg Madden
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Friday 25 July 2003 11:09 am, Attila Nagy wrote: BTW, I try to offer more than only the i386 stuff, so now there are CDs and DVDs for all architectures in sarge and sid in jigdo format and ISOs for i386 CDs and DVDs. I hope somebody can

Re: Accessibility of official jigdo files for Sarge

2003-07-29 Thread Josip Rodin
On Tue, Jul 29, 2003 at 10:00:16AM +0200, Attila Nagy wrote: For Debian mirrors, we have practically no use in features like compression, RCS, deltas and whatever else. To eliminate the initial delay in rsyncing, now that would be a useful thing. Did you try that, is that improved with

Re: Accessibility of official jigdo files for Sarge

2003-07-29 Thread Mattias Wadenstein
On Tue, 29 Jul 2003, Josip Rodin wrote: On Tue, Jul 29, 2003 at 10:00:16AM +0200, Attila Nagy wrote: For Debian mirrors, we have practically no use in features like compression, RCS, deltas and whatever else. To eliminate the initial delay in rsyncing, now that would be a useful thing.

Re: Accessibility of official jigdo files for Sarge

2003-07-29 Thread Greg Madden
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Friday 25 July 2003 11:09 am, Attila Nagy wrote: BTW, I try to offer more than only the i386 stuff, so now there are CDs and DVDs for all architectures in sarge and sid in jigdo format and ISOs for i386 CDs and DVDs. I hope somebody can

Re: Accessibility of official jigdo files for Sarge

2003-07-29 Thread Attila Nagy
Josip Rodin wrote: For Debian mirrors, we have practically no use in features like compression, RCS, deltas and whatever else. To eliminate the initial delay in rsyncing, now that would be a useful thing. Did you try that, is that improved with cvsup? No, I didn't try it with Debian mirrors, but I

Re: Accessibility of official jigdo files for Sarge

2003-07-29 Thread Josip Rodin
On Tue, Jul 29, 2003 at 10:00:16AM +0200, Attila Nagy wrote: For Debian mirrors, we have practically no use in features like compression, RCS, deltas and whatever else. To eliminate the initial delay in rsyncing, now that would be a useful thing. Did you try that, is that improved with

Re: Accessibility of official jigdo files for Sarge

2003-07-29 Thread Mattias Wadenstein
On Tue, 29 Jul 2003, Josip Rodin wrote: On Tue, Jul 29, 2003 at 10:00:16AM +0200, Attila Nagy wrote: For Debian mirrors, we have practically no use in features like compression, RCS, deltas and whatever else. To eliminate the initial delay in rsyncing, now that would be a useful thing.

Re: Accessibility of official jigdo files for Sarge

2003-07-26 Thread Attila Nagy
Mattias Wadenstein wrote: Oh, well. There exists a debian package. So for some of our mirrors it shouldn't be much of a problem. But I guess that rsync will be the standard way for some more years. I didn't even know that cvsup exists in Debian. That's great. BTW, cvsup uses rsync for transferring

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread John Winters
On Fri, 2003-07-25 at 01:35, Richard Atterer wrote: On Thu, Jul 24, 2003 at 04:58:09PM +0100, John Winters wrote: I sell (amongst lots of other things) CDs of Debian Woody and testing snapshots of Sarge. Currently it appears that the only way one can download the official .jigdo files for

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Richard Atterer
On Fri, Jul 25, 2003 at 07:49:48AM +0100, John Winters wrote: Further suggestion then - could an un-gzipped version be made available by rsync *only*. It should be possible to use jigdo-file's -0 switch to switch off compression. I /guess/ that would make the files rsyncable. The changes

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread John Winters
On Fri, 2003-07-25 at 12:11, Attila Nagy wrote: Richard Atterer wrote: The changes from week to week can only be small and it would make sense to rsync the differences and re-build the files rather than re-download what can be a very big file. (Some of the later ones from fsn.hu have been

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Mattias Wadenstein
On Fri, 25 Jul 2003, Attila Nagy wrote: Richard Atterer wrote: The changes from week to week can only be small and it would make sense to rsync the differences and re-build the files rather than re-download what can be a very big file. (Some of the later ones from fsn.hu have been 90M for

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Attila Nagy
John Winters wrote: Ah good. I'm glad they've come down again. I moved away from using the files from fsn.hu because a) they got so big and b) they couldn't be used to create .isos - they referenced files which weren't available on any mirror, not even fsn.hu. Perhaps something had gone wrong

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Attila Nagy
Mattias Wadenstein wrote: The jigdo directories went up to 10+ gigs and we had to stop mirroring for a while (the debian main archive is kind of more important to us). Is this problem fixed now? find . -name jigdo -exec du -hs {} \; 874M./sarge/jigdo 484M./sarge-dvd/jigdo 872M

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Attila Nagy
Mattias Wadenstein wrote: Thanks for the tip, I'll take a look at it. It still doesn't change the fact that rsync is the well-known tool by mirror admins though. The only problem is that cvsup is written in Modula-3, so it's not quite in perl or C :) http://www.cvsup.org/ -- Attila Nagy

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Mattias Wadenstein
On Fri, 25 Jul 2003, Attila Nagy wrote: Mattias Wadenstein wrote: And mirrors would like to use rsync even if the rsync algorithm doesn't matter. It is a convenient and well-known tool for mirroring a directory structure, including all the metadata and stuff. If we wouldn't talk about

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Mattias Wadenstein
On Fri, 25 Jul 2003, Attila Nagy wrote: Mattias Wadenstein wrote: Thanks for the tip, I'll take a look at it. It still doesn't change the fact that rsync is the well-known tool by mirror admins though. The only problem is that cvsup is written in Modula-3, so it's not quite in perl or C :)

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread John Winters
On Fri, 2003-07-25 at 01:35, Richard Atterer wrote: On Thu, Jul 24, 2003 at 04:58:09PM +0100, John Winters wrote: I sell (amongst lots of other things) CDs of Debian Woody and testing snapshots of Sarge. Currently it appears that the only way one can download the official .jigdo files for

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Richard Atterer
On Fri, Jul 25, 2003 at 07:49:48AM +0100, John Winters wrote: Further suggestion then - could an un-gzipped version be made available by rsync *only*. It should be possible to use jigdo-file's -0 switch to switch off compression. I /guess/ that would make the files rsyncable. The changes

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Attila Nagy
Richard Atterer wrote: The changes from week to week can only be small and it would make sense to rsync the differences and re-build the files rather than re-download what can be a very big file. (Some of the later ones from fsn.hu have been 90M for just one (gzipped) .template file.) I wonder

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread John Winters
On Fri, 2003-07-25 at 12:11, Attila Nagy wrote: Richard Atterer wrote: The changes from week to week can only be small and it would make sense to rsync the differences and re-build the files rather than re-download what can be a very big file. (Some of the later ones from fsn.hu have been

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Mattias Wadenstein
On Fri, 25 Jul 2003, Richard Atterer wrote: On Thu, Jul 24, 2003 at 04:58:09PM +0100, John Winters wrote: I sell (amongst lots of other things) CDs of Debian Woody and testing snapshots of Sarge. Currently it appears that the only way one can download the official .jigdo files for

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Attila Nagy
John Winters wrote: Ah good. I'm glad they've come down again. I moved away from using the files from fsn.hu because a) they got so big and b) they couldn't be used to create .isos - they referenced files which weren't available on any mirror, not even fsn.hu. Perhaps something had gone wrong

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Attila Nagy
Mattias Wadenstein wrote: The jigdo directories went up to 10+ gigs and we had to stop mirroring for a while (the debian main archive is kind of more important to us). Is this problem fixed now? find . -name jigdo -exec du -hs {} \; 874M./sarge/jigdo 484M./sarge-dvd/jigdo 872M

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Attila Nagy
Mattias Wadenstein wrote: And mirrors would like to use rsync even if the rsync algorithm doesn't matter. It is a convenient and well-known tool for mirroring a directory structure, including all the metadata and stuff. If we wouldn't talk about Linux I would suggest forget rsync. It's very bad

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Attila Nagy
Mattias Wadenstein wrote: Thanks for the tip, I'll take a look at it. It still doesn't change the fact that rsync is the well-known tool by mirror admins though. The only problem is that cvsup is written in Modula-3, so it's not quite in perl or C :) http://www.cvsup.org/ -- Attila Nagy

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Mattias Wadenstein
On Fri, 25 Jul 2003, Attila Nagy wrote: Mattias Wadenstein wrote: And mirrors would like to use rsync even if the rsync algorithm doesn't matter. It is a convenient and well-known tool for mirroring a directory structure, including all the metadata and stuff. If we wouldn't talk about

Re: Accessibility of official jigdo files for Sarge

2003-07-25 Thread Mattias Wadenstein
On Fri, 25 Jul 2003, Attila Nagy wrote: Mattias Wadenstein wrote: Thanks for the tip, I'll take a look at it. It still doesn't change the fact that rsync is the well-known tool by mirror admins though. The only problem is that cvsup is written in Modula-3, so it's not quite in perl or C :)

Accessibility of official jigdo files for Sarge

2003-07-24 Thread John Winters
Hi all, I sell (amongst lots of other things) CDs of Debian Woody and testing snapshots of Sarge. Currently it appears that the only way one can download the official .jigdo files for unofficial Sarge CDs (!) is by means of http from gluck.debian.org. This is inefficient, particularly if

Re: Accessibility of official jigdo files for Sarge

2003-07-24 Thread Mattias Wadenstein
On Thu, 24 Jul 2003, John Winters wrote: Hi all, I sell (amongst lots of other things) CDs of Debian Woody and testing snapshots of Sarge. Currently it appears that the only way one can download the official .jigdo files for unofficial Sarge CDs (!) is by means of http from

Re: Accessibility of official jigdo files for Sarge

2003-07-24 Thread Richard Atterer
On Thu, Jul 24, 2003 at 04:58:09PM +0100, John Winters wrote: I sell (amongst lots of other things) CDs of Debian Woody and testing snapshots of Sarge. Currently it appears that the only way one can download the official .jigdo files for unofficial Sarge CDs (!) is by means of http from

Accessibility of official jigdo files for Sarge

2003-07-24 Thread John Winters
Hi all, I sell (amongst lots of other things) CDs of Debian Woody and testing snapshots of Sarge. Currently it appears that the only way one can download the official .jigdo files for unofficial Sarge CDs (!) is by means of http from gluck.debian.org. This is inefficient, particularly if one

Re: Accessibility of official jigdo files for Sarge

2003-07-24 Thread Mattias Wadenstein
On Thu, 24 Jul 2003, John Winters wrote: Hi all, I sell (amongst lots of other things) CDs of Debian Woody and testing snapshots of Sarge. Currently it appears that the only way one can download the official .jigdo files for unofficial Sarge CDs (!) is by means of http from

Re: Accessibility of official jigdo files for Sarge

2003-07-24 Thread Richard Atterer
On Thu, Jul 24, 2003 at 04:58:09PM +0100, John Winters wrote: I sell (amongst lots of other things) CDs of Debian Woody and testing snapshots of Sarge. Currently it appears that the only way one can download the official .jigdo files for unofficial Sarge CDs (!) is by means of http from