Re: big Packages.gz file

2001-01-10 Thread Goswin Brederlow
> " " == Brian May <[EMAIL PROTECTED]> writes: > "zhaoway" == zhaoway <[EMAIL PROTECTED]> writes: zhaoway> This is only a small part of the whole story, IMHO. See zhaoway> my other email replying you. ;) >>> Maybe there could be another version of Packages.gz without >>>

Re: big Packages.gz file

2001-01-09 Thread Brian May
> "Brian" == Brian May <[EMAIL PROTECTED]> writes: Brian> Note: [1] Normally I try to find the files manually via Brian> lynx, but right at the moment this is rather difficult, as Brian> I seem to try numerous directories but not get the expected Brian> result. Some packages

Re: big Packages.gz file

2001-01-09 Thread Brian May
> "zhaoway" == zhaoway <[EMAIL PROTECTED]> writes: zhaoway> This is only a small part of the whole story, IMHO. See zhaoway> my other email replying you. ;) >> Maybe there could be another version of Packages.gz without the >> extended descriptions -- I imagine they would tak

Re: big Packages.gz file

2001-01-09 Thread Goswin Brederlow
> " " == Brian May <[EMAIL PROTECTED]> writes: > "sluncho" == sluncho <[EMAIL PROTECTED]> writes: sluncho> How hard would it be to make daily diffs of the Package sluncho> file? Most people running unstable update every other day sluncho> and this will require downloading and

Re: big Packages.gz file

2001-01-09 Thread Brian May
> "sluncho" == sluncho <[EMAIL PROTECTED]> writes: sluncho> How hard would it be to make daily diffs of the Package sluncho> file? Most people running unstable update every other day sluncho> and this will require downloading and applying only a sluncho> couple of diff files.

Re: big Packages.gz file

2001-01-09 Thread sluncho
On Tue, Jan 09, 2001 at 11:40:01PM +1100, Hamish Moffatt wrote: > On Tue, Jan 09, 2001 at 06:04:58PM +0900, Miles Bader wrote: > > Hamish Moffatt <[EMAIL PROTECTED]> writes: > > > What is the real problem with the large package files? They take a long > > > time to download, but so do emacs and oth

Re: big Packages.gz file

2001-01-09 Thread zhaoway
From: Hamish Moffatt <[EMAIL PROTECTED]> Subject: Re: big Packages.gz file Date: Tue, 9 Jan 2001 19:59:13 +1100 > On Tue, Jan 09, 2001 at 03:04:10AM +0800, zhaoway wrote: > > A big package index IMHO is the current bottleneck of Debian package system. > > What is the real p

Re: big Packages.gz file

2001-01-09 Thread zhaoway
From: Hamish Moffatt <[EMAIL PROTECTED]> Subject: Re: big Packages.gz file Date: Tue, 9 Jan 2001 23:40:01 +1100 > On Tue, Jan 09, 2001 at 06:04:58PM +0900, Miles Bader wrote: > > The packages file gets downloaded _every single time_ you do an update, > > and for those of us w

Re: big Packages.gz file

2001-01-09 Thread Hamish Moffatt
On Tue, Jan 09, 2001 at 06:04:58PM +0900, Miles Bader wrote: > Hamish Moffatt <[EMAIL PROTECTED]> writes: > > What is the real problem with the large package files? They take a long > > time to download, but so do emacs and other bloatware. > > Yeah, but how often do you download emacs? Never, I

Re: big Packages.gz file

2001-01-09 Thread Miles Bader
Hamish Moffatt <[EMAIL PROTECTED]> writes: > What is the real problem with the large package files? They take a long > time to download, but so do emacs and other bloatware. Yeah, but how often do you download emacs? The packages file gets downloaded _every single time_ you do an update, and for

Re: big Packages.gz file

2001-01-09 Thread Hamish Moffatt
On Tue, Jan 09, 2001 at 03:04:10AM +0800, zhaoway wrote: > A big package index IMHO is the current bottleneck of Debian package system. What is the real problem with the large package files? They take a long time to download, but so do emacs and other bloatware. Hamish -- Hamish Moffatt VK3SB <

Re: Linux Gazette [Was: Re: big Packages.gz file]

2001-01-08 Thread Adrian Bridgett
On Mon, Jan 8, 2001 at 18:20:16 +0100 (+), Andreas Fuchs wrote: > On 2001-01-07, Goswin Brederlow > <[EMAIL PROTECTED]> wrote: > > zhaoway> 1) It prevent many more packages to come into Debian, for > > zhaoway> example, Linux Gazette are now not present newest issues > > zhaoway> i

Re: big Packages.gz file

2001-01-08 Thread calvin
Hello, On Tue, Jan 09, 2001 at 03:04:10AM +0800, zhaoway wrote: > * To seperate Packages.gz to be along with each package as another seperate > file. Ceazar's belong to Ceazar. ;) > i.e., each pkg_ver-sub_arch.deb with a pkg_ver-sub_arch.idx No, thats not a win. You would end up checking time

Re: big Packages.gz file

2001-01-08 Thread zhaoway
On Sun, Jan 07, 2001 at 05:18:02PM -0500, Chris Gray wrote: > > Brian May writes: > bm> What do large packages have to do with the size of the index file, > bm> Packages? > > I think the point was that every package adds about 30-45 lines to the > Packages file. You don't need to down

Re: Linux Gazette [Was: Re: big Packages.gz file]

2001-01-08 Thread Andreas Fuchs
On 2001-01-07, Goswin Brederlow <[EMAIL PROTECTED]> wrote: > zhaoway> 1) It prevent many more packages to come into Debian, for > zhaoway> example, Linux Gazette are now not present newest issues > zhaoway> in Debian. People occasionally got fucked up by packages > Any reasons why the

Re: package pool and big Packages.gz file

2001-01-08 Thread Jason Gunthorpe
On 8 Jan 2001, Goswin Brederlow wrote: > Then that feature should be limited to non-recursive listings or > turned off. Or .listing files should be created that are just served. *couf* rproxy *couf* > So when you have more blocks, the hash will fill up. So you have more > hits on the first leve

Re: package pool and big Packages.gz file

2001-01-08 Thread Goswin Brederlow
> " " == Jason Gunthorpe <[EMAIL PROTECTED]> writes: > On 8 Jan 2001, Goswin Brederlow wrote: >> I don't need to get a filelisting, apt-get tells me the >> name. :) > You have missed the point, the presence of the ability to do > file listings prevents the adoption of

Re: package pool and big Packages.gz file

2001-01-07 Thread Jason Gunthorpe
On 8 Jan 2001, Goswin Brederlow wrote: > > Apparently reversing the direction of rsync infringes on a > > patent. > When I rsync a file, rsync starts ssh to connect to the remote host > and starts rsync there in the reverse mode. Not really, you have to use quite a different set of o

Re: package pool and big Packages.gz file

2001-01-07 Thread Goswin Brederlow
> " " == Jason Gunthorpe <[EMAIL PROTECTED]> writes: > On 7 Jan 2001, Goswin Brederlow wrote: >> Actually the load should drop, providing the following feature >> add ons: >> >> 1. cached checksums and pulling instead of pushing 2. client >> side unpackging of compre

Re: package pool and big Packages.gz file

2001-01-07 Thread Brian May
> "Goswin" == Goswin Brederlow <[EMAIL PROTECTED]> writes: Goswin> URL? http://linuxcare.com.au/projects/rproxy/> The documentation seems very comprehensive, but I am not sure when it was last updated. Goswin> Sounds more like encapsulation of an rsync similar Goswin> protocol i

Re: package pool and big Packages.gz file

2001-01-07 Thread Goswin Brederlow
> " " == Brian May <[EMAIL PROTECTED]> writes: > "Goswin" == Goswin Brederlow <[EMAIL PROTECTED]> writes: Goswin> Actually the load should drop, providing the following Goswin> feature add ons: > How does rproxy cope? Does it require a high load on the > server? I suspe

Re: package pool and big Packages.gz file

2001-01-07 Thread Brian May
> "Goswin" == Goswin Brederlow <[EMAIL PROTECTED]> writes: Goswin> Actually the load should drop, providing the following Goswin> feature add ons: How does rproxy cope? Does it require a high load on the server? I suspect not, but need to check on this. I think of rsync as just bein

Re: package pool and big Packages.gz file

2001-01-07 Thread Jason Gunthorpe
On 7 Jan 2001, Goswin Brederlow wrote: > Actually the load should drop, providing the following feature add > ons: > > 1. cached checksums and pulling instead of pushing > 2. client side unpackging of compressed streams Apparently reversing the direction of rsync infringes on a patent. Plus th

Linux Gazette [Was: Re: big Packages.gz file]

2001-01-07 Thread Goswin Brederlow
> " " == Chris Gray <[EMAIL PROTECTED]> writes: > Brian May writes: > "zhaoway" == zhaoway <[EMAIL PROTECTED]> writes: zhaoway> 1) It prevent many more packages to come into Debian, for zhaoway> example, Linux Gazette are now not present newest issues zhaoway> in Debian. P

Re: big Packages.gz file

2001-01-07 Thread Chris Gray
> Brian May writes: > "zhaoway" == zhaoway <[EMAIL PROTECTED]> writes: zhaoway> 1) It prevent many more packages to come into Debian, for zhaoway> example, Linux Gazette are now not present newest issues zhaoway> in Debian. People occasionally got fucked up by packages zha

Re: package pool and big Packages.gz file

2001-01-07 Thread Goswin Brederlow
> " " == Matt Zimmerman <[EMAIL PROTECTED]> writes: > On Sun, Jan 07, 2001 at 03:49:43PM +0100, Goswin Brederlow > wrote: >> Actually the load should drop, providing the following feature >> add ons: [...] > The load should drop from that induced by the current rsync

Re: package pool and big Packages.gz file

2001-01-07 Thread Matt Zimmerman
On Sun, Jan 07, 2001 at 03:49:43PM +0100, Goswin Brederlow wrote: > Actually the load should drop, providing the following feature add > ons: > [...] The load should drop from that induced by the current rsync setup (for the mirrors), but if many, many more client start using rsync (instead of FT

Re: package pool and big Packages.gz file

2001-01-07 Thread Falk Hueffner
Sam Vilain <[EMAIL PROTECTED]> writes: > On Fri, 5 Jan 2001 19:08:38 +0200 > [EMAIL PROTECTED] (Sami Haahtinen) wrote: > > > Or, can rsync sync binary files? > > hmm.. this sounds like something worth implementing.. > > rsync can, but the problem is with a compressed stream if you insert > or al

Re: package pool and big Packages.gz file

2001-01-07 Thread Goswin Brederlow
> " " == Sam Vilain <[EMAIL PROTECTED]> writes: > On Fri, 5 Jan 2001 09:33:05 -0700 (MST) Jason Gunthorpe > <[EMAIL PROTECTED]> wrote: >> > If that suits your needs, feel free to write a bugreport on >> apt about this. Yes, I enjoy closing such bug reports with a >> ter

Re: package pool and big Packages.gz file

2001-01-07 Thread Sam Vilain
On Fri, 5 Jan 2001 19:08:38 +0200 [EMAIL PROTECTED] (Sami Haahtinen) wrote: > Or, can rsync sync binary files? > hmm.. this sounds like something worth implementing.. rsync can, but the problem is with a compressed stream if you insert or alter data early on in the stream, the data after that ch

Re: package pool and big Packages.gz file

2001-01-07 Thread Sam Vilain
On Fri, 5 Jan 2001 09:33:05 -0700 (MST) Jason Gunthorpe <[EMAIL PROTECTED]> wrote: > > If that suits your needs, feel free to write a bugreport on apt about > > this. > Yes, I enjoy closing such bug reports with a terse response. > Hint: Read the bug page for APT to discover why! >From bug report

Re: package pool and big Packages.gz file

2001-01-06 Thread Matt Zimmerman
On Sun, Jan 07, 2001 at 12:53:14PM +1100, Drake Diedrich wrote: > On Sun, Jan 07, 2001 at 11:43:39AM +1100, Sam Couter wrote: > > > > A deb plugin would be better. :) > >One problem with a deb plugin is that .debs are signed in compressed > form. gzip isn't guaranteed to produce the same co

Re: package pool and big Packages.gz file

2001-01-06 Thread Drake Diedrich
On Sun, Jan 07, 2001 at 11:43:39AM +1100, Sam Couter wrote: > > A deb plugin would be better. :) One problem with a deb plugin is that .debs are signed in compressed form. gzip isn't guaranteed to produce the same compressed file from identical uncompressed files on different architectures an

Re: package pool and big Packages.gz file

2001-01-06 Thread Brian May
> "Sam" == Sam Couter <[EMAIL PROTECTED]> writes: Sam> Andrew Stribblehill <[EMAIL PROTECTED]> wrote: >> Doesn't gzip have a --rsync option, or somesuch? Apparently >> Andrew Tridgell (Samba, Rsync) has a patch to do this, but I >> don't know whether he passed it onto the gzip

Re: package pool and big Packages.gz file

2001-01-06 Thread Sam Couter
Andrew Stribblehill <[EMAIL PROTECTED]> wrote: > > Doesn't gzip have a --rsync option, or somesuch? Apparently Andrew > Tridgell (Samba, Rsync) has a patch to do this, but I don't know > whether he passed it onto the gzip maintainers. I like the idea of having plugins for rsync to handle differen

Re: big Packages.gz file

2001-01-06 Thread Sam Couter
> On 2001-01-05, Brian May <[EMAIL PROTECTED]> wrote: > > What do large packages have to do with the size of the index file, > > Packages? Andreas Fuchs <[EMAIL PROTECTED]> wrote: > They waste one byte per multiple of 10 bytes of package size. (-; You mean one byte per order of magnitude of packa

Re: big Packages.gz file

2001-01-06 Thread Andreas Fuchs
On 2001-01-05, Brian May <[EMAIL PROTECTED]> wrote: > What do large packages have to do with the size of the index file, > Packages? They waste one byte per multiple of 10 bytes of package size. (-; Bad joke? So sue me. -- Andreas Fuchs, <[EMAIL PROTECTED]>, <[EMAIL PROTECTED]>, antifuchs Hail R

Re: package pool and big Packages.gz file

2001-01-06 Thread Andrew Stribblehill
Quoting Goswin Brederlow <[EMAIL PROTECTED]>: > > " " == Sami Haahtinen <[EMAIL PROTECTED]> writes: > > > Or, can rsync sync binary files? > > Of cause, but forget it with compressed data. Doesn't gzip have a --rsync option, or somesuch? Apparently Andrew Tridgell (Samba, Rsync) has a pa

Re: package pool and big Packages.gz file

2001-01-05 Thread Matthijs Melchior
Jason Gunthorpe wrote: > > Hint: Read the bug page for APT to discover why! > Looking through the apt bugs., saw this one, rejected: Bug#77054: wish: show current->upgraded versions on upgrade -u My private solution to this is the following patch to `apt-get': --- algo

Re: package pool and big Packages.gz file

2001-01-05 Thread Goswin Brederlow
> " " == Junichi Uekawa <[EMAIL PROTECTED]> writes: > In 05 Jan 2001 19:51:08 +0100 Goswin Brederlow > <[EMAIL PROTECTED]> cum veritate > scripsit : Hello, >> I'm currently discussing some changes to the rsync client with >> some people from the rsync ML which would unc

Re: package pool and big Packages.gz file

2001-01-05 Thread Junichi Uekawa
In 05 Jan 2001 19:51:08 +0100 Goswin Brederlow <[EMAIL PROTECTED]> cum veritate scripsit : Hello, > I'm currently discussing some changes to the rsync client with some > people from the rsync ML which would uncompress compressed data on the > client side (no changes to the server) and rsync thos

Re: package pool and big Packages.gz file

2001-01-05 Thread Goswin Brederlow
> " " == Jason Gunthorpe <[EMAIL PROTECTED]> writes: > On 5 Jan 2001, Goswin Brederlow wrote: >> If that suits your needs, feel free to write a bugreport on apt >> about this. > Yes, I enjoy closing such bug reports with a terse response. > Hint: Read the bug page for

Re: package pool and big Packages.gz file

2001-01-05 Thread Goswin Brederlow
> " " == Sami Haahtinen <[EMAIL PROTECTED]> writes: > On Fri, Jan 05, 2001 at 03:05:03AM +0100, Goswin Brederlow > wrote: >> Whats the problem with a big Packages file? >> >> If you don't want to download it again and again just because >> of small changes I have a b

Re: package pool and big Packages.gz file

2001-01-05 Thread Wichert Akkerman
Previously Sami Haahtinen wrote: > this would bring us to, apt renaming the old deb (if there is one) to the > name of the new package and rsync those. and we would save some time once > again... There is a --fuzzy-names patch for rsync that makes rsync do that itself. > Or, can rsync sync binar

Re: package pool and big Packages.gz file

2001-01-05 Thread Sami Haahtinen
On Fri, Jan 05, 2001 at 05:46:35AM +0800, zhaoway wrote: > > how about diffs bethween dinstall runs?.. > > sorry, but i don't understand here. dinstall is a server side thing here? yes, when dinstall runs it would copy the old packages file to, lets say, packages.old and create it's changes to th

Re: package pool and big Packages.gz file

2001-01-05 Thread Sami Haahtinen
On Fri, Jan 05, 2001 at 03:05:03AM +0100, Goswin Brederlow wrote: > Whats the problem with a big Packages file? > > If you don't want to download it again and again just because of small > changes I have a better solution for you: > > rsync > > apt-get update could rsync all Packages files (yes,

Re: package pool and big Packages.gz file

2001-01-05 Thread Jason Gunthorpe
On 5 Jan 2001, Goswin Brederlow wrote: > If that suits your needs, feel free to write a bugreport on apt about > this. Yes, I enjoy closing such bug reports with a terse response. Hint: Read the bug page for APT to discover why! Jason

Re: big Packages.gz file

2001-01-05 Thread Brian May
> "zhaoway" == zhaoway <[EMAIL PROTECTED]> writes: zhaoway> 1) It prevent many more packages to come into Debian, for zhaoway> example, Linux Gazette are now not present newest issues zhaoway> in Debian. People occasionally got fucked up by packages zhaoway> like anachism-doc

big Packages.gz file

2001-01-05 Thread zhaoway
[sorry, either fetchmail or my ISP made me lost 30 or so emails.] The problem with bigger and bigger Packages.gz, [I thought is obvious. :-(] is, 1) It prevent many more packages to come into Debian, for example, Linux Gazette are now not present newest issues in Debian. People occasionally got f

Re: [FINAL, for now ;-)] (Was: Re: package pool and big Packages.gz file)

2001-01-05 Thread Joey Hess
If you don't like large Packages files, implement a rsync transfer method for them. -- see shy jo

Re: package pool and big Packages.gz file

2001-01-04 Thread Goswin Brederlow
> " " == zhaoway <[EMAIL PROTECTED]> writes: > hi, [i'm not sure if this has been resolved, lart me if you > like.] > my proposal to resolve big Packages.gz is through package pool > system. Whats the problem with a big Packages file? If you don't want to download it a

[FINAL, for now ;-)] (Was: Re: package pool and big Packages.gz file)

2001-01-04 Thread zhaoway
final thoughts ;-) On bigger and bigger Packages.gz file, a try The directory structure looks roughly like this: debian/dists/woody/main/binary-all/Packages.deb debian/pool/main/a/abba/abba_1989.orig.tar.gz abba_1989-12.diff.gz abba_1989-12.dsc

Re: package pool and big Packages.gz file

2001-01-04 Thread zhaoway
On Thu, Jan 04, 2001 at 11:19:25PM +0100, Petr Cech wrote: > On Fri, Jan 05, 2001 at 06:07:20AM +0800 , zhaoway wrote: > > then, apt-get update will do nothing, > > apt-get install some.deb will first download some.pkg-gz, then check its > > dependency, > > then grab them.pkg-gz all, then install.

Re: package pool and big Packages.gz file

2001-01-04 Thread zhaoway
[quote myself, ;-) this is semi-final now ;-)] another solution is to let every single deb provides its.pkg-gz then, apt-get update will do nothing, apt-get install some.deb will first download some.pkg-gz, then check its dependency, then grab them.pkg-gz all, then install. that is a minimum.

Re: package pool and big Packages.gz file

2001-01-04 Thread Petr Cech
On Fri, Jan 05, 2001 at 06:07:20AM +0800 , zhaoway wrote: > On Thu, Jan 04, 2001 at 11:19:59PM +0200, Sami Haahtinen wrote: > > how would the package manager (namely apt) know which ones you need.. even > > if > > you don't have X11 installed (and apt assumes you don't need X11 packages > > file)

Re: package pool and big Packages.gz file

2001-01-04 Thread zhaoway
On Fri, Jan 05, 2001 at 06:07:20AM +0800, zhaoway wrote: > another solution is to let every single deb provides its.pkg-gz > > then, apt-get update will do nothing, > apt-get install some.deb will first download some.pkg-gz, then check its > dependency, > then grab them.pkg-gz all, then install.

Re: package pool and big Packages.gz file

2001-01-04 Thread zhaoway
On Thu, Jan 04, 2001 at 11:19:59PM +0200, Sami Haahtinen wrote: > how would the package manager (namely apt) know which ones you need.. even if > you don't have X11 installed (and apt assumes you don't need X11 packages > file) > doesn't mean that you wouldn't want to install x11 packages file. a

Re: package pool and big Packages.gz file

2001-01-04 Thread zhaoway
On Thu, Jan 04, 2001 at 11:01:15PM +0200, Sami Haahtinen wrote: > On Fri, Jan 05, 2001 at 03:02:15AM +0800, zhaoway wrote: > > my proposal to resolve big Packages.gz is through package > > pool system. > > > > add 36 or so new debian package, namely, > > > > [a-zA-Z0-1]-packages-gz_date_all.deb >

Re: package pool and big Packages.gz file

2001-01-04 Thread Sami Haahtinen
On Thu, Jan 04, 2001 at 03:07:00PM -0600, Vince Mulhollon wrote: > > The only other possibility not yet proposed (?) would be to split the > packages file by section. > > base-packages > games-packages > x11-packages > net-packages > > Then a server that just doesn't do x11 or doesn't go games h

Re: package pool and big Packages.gz file

2001-01-04 Thread Vince Mulhollon
Fax to: Subject: Re: package pool and big Packages.gz file 01/04/2001

Re: package pool and big Packages.gz file

2001-01-04 Thread Sami Haahtinen
On Fri, Jan 05, 2001 at 03:02:15AM +0800, zhaoway wrote: > my proposal to resolve big Packages.gz is through package > pool system. > > add 36 or so new debian package, namely, > > [a-zA-Z0-1]-packages-gz_date_all.deb > > contents of each is quite obvious. ;-) > and a virtual unstable-packages-g

Re: package pool and big Packages.gz file

2001-01-04 Thread zhaoway
On Fri, Jan 05, 2001 at 03:17:30AM +0800, zhaoway wrote: > [read my previous semi-proposal] > > this has some more benefits, > > 1) package maintainer could upload (to pool) in whatever > frequency they like. in an ideal world, developer should upload to ''xxx-auto-builder'' ;-) 9i'm turning ou

Re: package pool and big Packages.gz file

2001-01-04 Thread zhaoway
[read my previous semi-proposal] this has some more benefits, 1) package maintainer could upload (to pool) in whatever frequency they like. 2) release is seperated from package pool which is a storage system. and release is a qa system. 3) release could be managed through BTS on specific packag

package pool and big Packages.gz file

2001-01-04 Thread zhaoway
hi, [i'm not sure if this has been resolved, lart me if you like.] my proposal to resolve big Packages.gz is through package pool system. add 36 or so new debian package, namely, [a-zA-Z0-1]-packages-gz_date_all.deb contents of each is quite obvious. ;-) and a virtual unstable-packages-gz depe