On Wed, Jul 05, 2006 at 08:38:42AM -0500, Lance Albertson wrote: > Brian Harring wrote: > > On Wed, Jul 05, 2006 at 09:00:29AM -0400, Chris Gianelloni wrote: > >> On Tue, 2006-07-04 at 18:34 +0300, Marius Mauch wrote: > >>> Patrick McLean schrieb: > >>>> I have absolutely zero experience with catalyst, but couldn't it be made > >>>> to create a source CD ISO when it is generating the binary one? Just > >>>> make a cd with all the distfiles used in the ISO, and keep the source > >>>> ISO with the binary one in /historical. > >>> Creating an ISO isn't a problem (assuming you have the sources, which > >>> for historical releases might be a problem), but it would require > >>> another several hundred megabytes per release on the mirrors which isn't > >>> exactly a trivial amount. > >> No, it would almost double the space used by the release. Current > >> releases use about 12-14G of space. Doubling that would mean reducing > >> the amount of stuff we're allowed to distribute dramatically, > >> essentially crippling our release capabilities. > > > > Stupid question, but the master mirroring setup actually holds onto > > files after it moves them off of the gentoo mirror tier- purgatory > > dir. > > > > Why not just make that dir accessible via web/torrent/whatever on > > a seperate server? Abusing osprey for it is a bit much (mainly infra > > has asked to wipe files from the purgatory dir in the past, which is a > > no go), so seperate probably is wise. > > No way in hell are we running such a service on the master mirror.
If you read what I said, I explicitly said do *not* run it on the tier/master mirror. > I > don't see why we need to have a public system setup as long as we can > provide the source when asked. As far as a I know, the GPL doesn't > dicate that we have to provide the sources in an internet media form. > They just need to be available when requested. Perhaps we can have a > document that explains a process for getting said sources. I don't see > the point of creating a torrent/whatever system just for the rare > instances that people want the older source. Way too much overhead for > something I don't see being used much. Files are going to have to be held onto somewhere long term- which is easier, flipping on lighttpd for the storage dir, or having to dick around with making requests of infra (waiting for them to respond), and requiring infra to do more work? Upshot of my suggestion, folk have access to the purgatory dir so they can go digging through old files from the mirror tier as needed. Two birds, one stone. > > Further filtering of the files to those under gpl (pulled from pkg > > metadata) is doable, just would need to mangle mirror-dist a bit to > > maintain long term info about who owned what (instead of it's current > > "out of sight, out of the db" approach). > > > > Just a thought- machinery is mostly there, might as well abuse it. > > A lot of the stuff that's currently in the purgatory area also includes > sources for stuff we didn't make (upstream sources, etc). If you can > separate those files from Gentoo specific files, then it would be much > easier to manag (from an admin point of view). Its not practical to > assume we have an infinite amount of space. As I said, mirror-dist would require modification- something that is a few hours worth of work, rather then harassing releng to hack up catalyst to build a src image... then harassing infra for a location they can upload it to, and harassing infra to push those files into an archival location. End result, infra has to maintain archives. My proposal, all infra has to do is flip on lighttpd somewhere, and I (or zac) do the mirror-dist modifications. ~harring
pgpasirHoywWe.pgp
Description: PGP signature
