Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On Tue, Nov 05, 2013 at 08:53:05AM +0100, Niels Thykier wrote: [1] I certainly wouldn't have space for something like this: http://en.wikipedia.org/wiki/File:Z800_2066_JKU.jpeg (and much less the money. Yeah I know that is technically not an s390, but as I understand it, an s390 should be around that size) I'm not sure where the it's not technically a s390 is coming from (because current Debian doesn't run on it anymore?), but it's pretty accurate. You get them in chunks of one or two racks, plus commonly one or more racks of storage. ;-) Kind regards Philipp Kern signature.asc Description: Digital signature
Re: Bits from the Release Team (Jessie freeze info)
Am 29.10.2013 17:48, schrieb Ian Jackson: (Mind you, I have my doubts about a process which counts people promising to do work - it sets up some rather unfortunate incentives. I guess it's easier to judge and more prospective than a process which attempts to gauge whether the work has been done well enough.) As an example I remember having received several complains from e.g. the GCC maintainers in regards to the state of gcc on various ports[1]. Here I would suspect a patch would be sufficient without needing to actually NMU gcc to get the fix in. There are also stuff like the port concerns from DSA that attention. Right. that's not enough. GCC has some primary and some secondary release architectures. Toolchain support for primary architectures in Debian should be waived, for the secondary and other architectures, Debian needs somebody who is maintaining the relationship between Debian and upstream. Surprisingly this is the case for many non-release Debian architectures like kfreebsd, the Hurd, alpha, hppa, m68k, but not for Debian release architectures like s390, sparc, ia64 and mips*. So we really need somebody to care about this, where the port is considered a secondary citizen or no citizen, or we should demote a port to the ports archive. Matthias -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/527c2170.8020...@debian.org
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On Tue, Nov 05, 2013 at 08:53:05AM +0100, Niels Thykier wrote: [1] I certainly wouldn't have space for something like this: http://en.wikipedia.org/wiki/File:Z800_2066_JKU.jpeg (and much less the money. Yeah I know that is technically not an s390, but as I understand it, an s390 should be around that size) That is in fact a s390, and pretty much the smallest of the zSeries you can find. You wouldn't be able to do anything with it even if you got it, though - it doesn't have internal storage at all (no Mainframe has, except the previous-generation Multiprise 3000 series), and requires external FICON/ESCON SAN storage to boot/operate. So you'd have to take a big clunky enterprise array of disks as well - just another full rack, if you're lucky. I was offered one of these z800 at some point, and had to pass on it too. Oh, and then there's the licensing stuff... chances of getting the required IBM assistance to get it (re)installed are about on par with Justin Bieber's chances of getting elected as President. There's an emulator (hercules) which can run zSeries operating systems on top of Linux, if you can get your hands on those. Anyway, sorry for going offtopic. :-) Lennert signature.asc Description: Digital signature
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
Niels Thykier writes (Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))): On 2013-11-03 16:03, Steven Chamberlain wrote: http://udd.debian.org/bugs.cgi?release=jessie_or_sidmerged=ignfnewerval=7kfreebsd=1sortby=severitysorto=desccseverity=1ctags=1 Actually, I meant a real BTS page (e.g. like [1]) rather than just a list of tagged bugs. The list of tagged bugs definitely have it uses, but it does not give me an overview of which bugs should be fixed by the maintainer of the given package and which the porters should fix. I think this would be a good idea. If the psuedo-package had a predictable name which depended only on the architecture, even better. Ian. -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/21113.13532.963985.569...@chiark.greenend.org.uk
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On Tue, 05 Nov 2013, Niels Thykier wrote: In this regard; I am guilty of filing some those bugs without tagging them. Honestly, adding the tags get a bit in the way right now. If a package FTBFS on 4 architectures, I have to dig up 3-4 different usertags (with different user) and associate it with the bug. This sounds like a case where we should turn these usertags into fully fledged tags. [Or alternatively, they should just be made usertags under the debian-po...@lists.debian.org user or similar.] I'm OK with assisting with either, but I need to know which solution porters would prefer. -- Don Armstrong http://www.donarmstrong.com For those who understand, no explanation is necessary. For those who do not, none is possible. -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20131105183439.gy9...@rzlab.ucr.edu
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On Tue, 05 Nov 2013, Don Armstrong wrote: On Tue, 05 Nov 2013, Niels Thykier wrote: In this regard; I am guilty of filing some those bugs without tagging them. Honestly, adding the tags get a bit in the way right now. If a package FTBFS on 4 architectures, I have to dig up 3-4 different usertags (with different user) and associate it with the bug. This sounds like a case where we should turn these usertags into fully fledged tags. [Or alternatively, they should just be made usertags under the debian-po...@lists.debian.org user or similar.] I would also be OK with creating a pseudopackage as well as Ian suggested. [Or multiple pseudopackages.] Something like i386.ports.debian.org or similar would work, with each current port getting a pseudopackage, and the maintainer of the pseudopackage being the ports list. -- Don Armstrong http://www.donarmstrong.com America was far better suited to be the World's Movie Star. The world's tequila-addled pro-league bowler. The world's acerbic bi-polar stand-up comedian. Anything but a somber and tedious nation of socially responsible centurions. -- Bruce Sterling, _Distraction_ p122 -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20131105185031.gz9...@rzlab.ucr.edu
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
Op 05-11-13 19:50, Don Armstrong schreef: On Tue, 05 Nov 2013, Don Armstrong wrote: On Tue, 05 Nov 2013, Niels Thykier wrote: In this regard; I am guilty of filing some those bugs without tagging them. Honestly, adding the tags get a bit in the way right now. If a package FTBFS on 4 architectures, I have to dig up 3-4 different usertags (with different user) and associate it with the bug. This sounds like a case where we should turn these usertags into fully fledged tags. [Or alternatively, they should just be made usertags under the debian-po...@lists.debian.org user or similar.] Well, I did ask for the creation of port-specific tags back at debconf8 (if I'm not mistaken), but you told me to go for usertags instead ;-) I still think such tags are a good idea, not only because it allows porters to more easily figure out bugs specific to their architecture, but also because it allows maintainers to better triage their bugs (which is slightly more bothersome with a usertag that isn't linked to your email address) I would also be OK with creating a pseudopackage as well as Ian suggested. [Or multiple pseudopackages.] Something like i386.ports.debian.org or similar would work, with each current port getting a pseudopackage, and the maintainer of the pseudopackage being the ports list. Yes, I think that's a good idea; it would avoid issues where maintainers are waiting on porters and vice versa, since the reassigning of a bug to a port pseudopackage would make it clear who's waiting for whom. Additionally, it would allow porters to have a todo list of things that need to be done for their port but aren't specific to any one package (or of which the root cause hasn't been found yet, e.g., recently compiled binaries segfault, but we don't know why yet) If you're going down this road, I would appreciate it if ports listed on debian-ports.org would also be getting pseudopackages. -- This end should point toward the ground if you want to go to space. If it starts pointing toward space you are having a bad problem and you will not go to space today. -- http://xkcd.com/1133/ -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/527947b3.8080...@debian.org
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
Hi, On 05/11/13 18:50, Don Armstrong wrote: On Tue, 05 Nov 2013, Don Armstrong wrote: This sounds like a case where we should turn these usertags into fully fledged tags. [Or alternatively, they should just be made usertags under the debian-po...@lists.debian.org user or similar.] Either of those sounds good. Fully-fledged tags would be the easiest for most reporters to remember to use, but I wonder if this pollutes the tag namespace. [Or multiple pseudopackages.] Something like i386.ports.debian.org or similar would work, with each current port getting a pseudopackage, and the maintainer of the pseudopackage being the ports list. Would that be only for generic issues with a port, not specific to a package? I doubt this would be used much. These bugs might typically be reassigned to kernel packages or eglibc anyway. Regards, -- Steven Chamberlain ste...@pyro.eu.org -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/527949c5.8040...@pyro.eu.org
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
Op 05-11-13 20:40, Steven Chamberlain schreef: [pseudopackages] Would that be only for generic issues with a port, not specific to a package? I doubt this would be used much. These bugs might typically be reassigned to kernel packages or eglibc anyway. Eventually, yes, but that doesn't matter. Reassigning a bug means transferring the responsibility of fixing the matter at hand to a different person (or group of people). If you're the maintainer of a package which has a port-specific bug, you can currently say so, but you can't reassign the bug to the porters if you think it really isn't your fault. After a porter has debugged it and figured out the fix, they will probably reassign back to the original package, indeed, since they can't do an upload. But that doesn't mean that in the mean time the bug wasn't theirs. -- This end should point toward the ground if you want to go to space. If it starts pointing toward space you are having a bad problem and you will not go to space today. -- http://xkcd.com/1133/ -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/52794b8d.2090...@debian.org
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On Tue, 05 Nov 2013, Wouter Verhelst wrote: Well, I did ask for the creation of port-specific tags back at debconf8 (if I'm not mistaken), but you told me to go for usertags instead ;-) Sounds familiar. Usertags have the advantage of not requiring me to do any work. But presumably at the time I hadn't thought of the difficulties of coordinating all of the different usertags between porters. Yes, I think that's a good idea; it would avoid issues where maintainers are waiting on porters and vice versa, since the reassigning of a bug to a port pseudopackage would make it clear who's waiting for whom. Additionally, it would allow porters to have a todo list of things that need to be done for their port but aren't specific to any one package (or of which the root cause hasn't been found yet, e.g., recently compiled binaries segfault, but we don't know why yet) If you're going down this road, I would appreciate it if ports listed on debian-ports.org would also be getting pseudopackages. Since they would all be under the same ports.debian.org (or similar) namespace, I wouldn't have a problem with it. [My main concern about pseudopackages is polluting the package namespace; since I can't imagine anyone ever wanting to create a package called someport.ports.debian.org for a sane reason, that shouldn't be a big deal.] It would also be possible (in the meantime) for bugs to be assigned to both the port-specific pseudopackage, and the original package which spawned the bug. In any event, if a few active porters wouldn't mind creating a wishlist bug against bugs.debian.org for this with a suggested course of action, I'd appreciate it. Assuming there is no significant disagreement about that course of action, I'd like to implement it within a week or so. -- Don Armstrong http://www.donarmstrong.com PowerPoint is symptomatic of a certain type of bureaucratic environment: one typified by interminable presentations with lots of fussy little bullet-points and flashy dissolves and soundtracks masked into the background, to try to convince the audience that the goon behind the computer has something significant to say. -- Charles Stross _The Jennifer Morgue_ p33 -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20131105201345.ga9...@rzlab.ucr.edu
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On 2013-11-05 21:13, Don Armstrong wrote: On Tue, 05 Nov 2013, Wouter Verhelst wrote: Yes, I think that's a good idea; it would avoid issues where maintainers are waiting on porters and vice versa, since the reassigning of a bug to a port pseudopackage would make it clear who's waiting for whom. Additionally, it would allow porters to have a todo list of things that need to be done for their port but aren't specific to any one package (or of which the root cause hasn't been found yet, e.g., recently compiled binaries segfault, but we don't know why yet) Even if a first-class tag for each architecture may be too much inflation, perhaps a generic portspecific tag could be helpful (although I cant give precise recipes how this should be used ...) And while we are at suggesting real tags ... what about a dfsg tag? It would also be possible (in the meantime) for bugs to be assigned to both the port-specific pseudopackage, and the original package which spawned the bug. There is would be nice if reassigning a package would preserve fixed and found versions - at least for the common subset of source packages in the old and new assignment set. Would Control: affects -1 + port1-pseudopackage port2-pseudopackage be useful? Andreas -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/5279b490.7060...@debian.org
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On 03/11/13 10:54, Niels Thykier wrote: Come to think of it; maybe we should have a BTS page for each of the ports (e.g. a pseudo package in the BTS). We've had this on kfreebsd, due it to having been a release goal: http://udd.debian.org/bugs.cgi?release=jessie_or_sidmerged=ignfnewerval=7kfreebsd=1sortby=severitysorto=desccseverity=1ctags=1 It uses usertags, but someone has to set those. Porters usually set them on bugs they file; but quite often FTBFS on kfreebsd bugs are filed without being tagged or Cc'd to our list, so someone has to periodically look for and tag things. Regards, -- Steven Chamberlain ste...@pyro.eu.org -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/527665af.2040...@pyro.eu.org
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On 2013-11-03 16:03, Steven Chamberlain wrote: On 03/11/13 10:54, Niels Thykier wrote: Come to think of it; maybe we should have a BTS page for each of the ports (e.g. a pseudo package in the BTS). We've had this on kfreebsd, due it to having been a release goal: http://udd.debian.org/bugs.cgi?release=jessie_or_sidmerged=ignfnewerval=7kfreebsd=1sortby=severitysorto=desccseverity=1ctags=1 Actually, I meant a real BTS page (e.g. like [1]) rather than just a list of tagged bugs. The list of tagged bugs definitely have it uses, but it does not give me an overview of which bugs should be fixed by the maintainer of the given package and which the porters should fix. It uses usertags, but someone has to set those. Porters usually set them on bugs they file; but quite often FTBFS on kfreebsd bugs are filed without being tagged or Cc'd to our list, so someone has to periodically look for and tag things. Regards, In this regard; I am guilty of filing some those bugs without tagging them. Honestly, adding the tags get a bit in the way right now. If a package FTBFS on 4 architectures, I have to dig up 3-4 different usertags (with different user) and associate it with the bug. Do we have a tool you can give a source package, a version plus a list of architectures and it will generate a bug with the right tags? I think that would help a lot for me. ~Niels [1] http://bugs.debian.org/release.debian.org -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/52789fdb.2000...@thykier.net
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On 2013-11-03 23:04, Steve Langasek wrote: On Sun, Nov 03, 2013 at 11:54:34AM +0100, Niels Thykier wrote: [...] I suppose a sponsor-only DD could be sufficient, provided that the sponsor knows the porters well enough to be willing to sign off on e.g. access to porter boxes. I guess the sponsor would also need to dedicate time to mentor (new?) porters on workflows and on quicks like when is a FTBFS RC and when it isn't etc. Why would the sponsor need to be involved in getting the porters access to porter boxes? Porter boxes exist so that DDs *not* involved in a port have access to a machine of the architecture and can keep their packages working. I've never heard of a porter who didn't have access to their own box for porting work. I will not rule out that it was a poor choice of example on my part for ia64 (and maybe powerpc), which is(/are) the concrete port(s) we would be talking in this case. That said, it is my understanding that one does not simply own an s390(x)[1]. Nor would I be concerned to have arm porters that worked on all 3 arm ports while possessing hardware only for a (non-empty) subset of those architectures. ~Niels [1] I certainly wouldn't have space for something like this: http://en.wikipedia.org/wiki/File:Z800_2066_JKU.jpeg (and much less the money. Yeah I know that is technically not an s390, but as I understand it, an s390 should be around that size) -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/5278a3e1.30...@thykier.net
Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On 2013-10-29 17:48, Ian Jackson wrote: Niels Thykier writes (Re: Bits from the Release Team (Jessie freeze info)): [...] As mentioned we are debating whether the 5 DDs requirement still makes sense. Would you say that we should abolish the requirement for DD porters completely? I.e. Even if there are no (soon to be) DDs, we should consider the porter requirements fulfilled as long as they are enough active porters behind the port[0]? I don't have a good feel for the answer to that question. It's just that if it is the case that a problem with ports is the lack of specifically DDs, rather than porter effort in general, then sponsorship is an obvious way to solve that problem. If you feel that that's not really the main problem then a criterion which counts porters of any status would be better. I suppose a sponsor-only DD could be sufficient, provided that the sponsor knows the porters well enough to be willing to sign off on e.g. access to porter boxes. I guess the sponsor would also need to dedicate time to mentor (new?) porters on workflows and on quicks like when is a FTBFS RC and when it isn't etc. (Mind you, I have my doubts about a process which counts people promising to do work - it sets up some rather unfortunate incentives. I guess it's easier to judge and more prospective than a process which attempts to gauge whether the work has been done well enough.) [...] Thanks, Ian. Ah, you are not the first to question this process. Obviously, we intend to keep people up on their promise by actively maintaining their port. Sadly, we do not have a clear definition of actively maintained ports and I doubt we will have it any time soon either. But porters can start by working on the concerns from DSA (if they haven't already done so). Ports having gcc-4.6 as default compiler might also consider improving in that area[1]. Then there are more concrete things like ruby's test suite seg. faulting on ia64 (#593141), ld seg. faulting with --as-needed on ia64 (#718047[2]), a lot of ruby packages being stuck on kfreebsd-any due to ruby2.0 FTBFS (#726095[3]). Personally, I would also expect that key-packages work on all ports (on which they are built) in general[4]. All of the (non-mild) DSA concerns are already something we will officially hold against the ports. Most of the other issues listed above are not official concerns. However, I would not be surprised if most of them became official issues eventually. Until we have a clear definition of actively maintained ports, I would recommend porters to err on the side of being verbose over being silent. As an example, lack of visible reply to mails like [5] makes it seem like nobody is home. Mind you, I am not saying porters have the responsibility to fix every problem forwarded to their port list. I am also aware that sometimes issues/mail disappear in the depths of people inbox - heck it happens to me as well. Come to think of it; maybe we should have a BTS page for each of the ports (e.g. a pseudo package in the BTS). That way it would at least be easier for all people to find outstanding issues for the port[6]. It would also give us the possiblity to trivial declare a problem RC (or not) for ports. (Plus, then I won't have to update some random file on release.d.o for every new issue :P) Anyhow, I hope to be able to give a more official statement in the near future. ~Niels [1] Nothing official yet, but gcc-4.6 (and earlier) /might/ not be acceptable as a default for Jessie. [2] Apparently it is controversial whether that bug should be RC, but it definitely looks like that kind of thing that will cause issues for ia64 later. [3] That one got a patch, but it might be worth it to put some pressure on the maintainer or even doing a NMU. [4] A rule of thumb could be something like your port should probably not be listed here in the long run: http://udd.debian.org/bugs.cgi?release=jessie_and_sidmerged=ignkeypackages=onlyfnewerval=7flastmodval=7rc=1sortby=idsorto=asc [5] https://lists.debian.org/debian-mips/2013/08/msg5.html Btw, this is not intended to single out mips. [6] I know that people have been usertags for issues that affect the port, but it is not clear to me that all those usertags bugged is something we expect porters to fix. Rather it seems more like porters tagging the FTBFS bugs they file. -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/52762b6a.5060...@thykier.net
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
Niels Thykier dixit: Then there are more concrete things like ruby's test suite seg. faulting on ia64 (#593141), ld seg. faulting with --as-needed on ia64 And only statically linked klibc-compiled executables work on IA64, not dynamically linked ones. I’ve looked into it, but Itanic is so massively foreign I didn’t manage to find out anything except that the problem appears to happen before main. Until we have a clear definition of actively maintained ports, I would recommend porters to err on the side of being verbose over being silent. I’ve held off on the m68k side because I think the role call was only for architectures in the main archive, right? [1] Nothing official yet, but gcc-4.6 (and earlier) /might/ not be acceptable as a default for Jessie. Didn't Doko say he’d want 4.8? We (on the m68k side) are putting effort into that one, since 4.7 appears to only be used by eglibc right now. And 4.6 for GNAT, but gnat-4.8 is new, and the ICE may be fixed as there’s active upstream on the GCC/m68k side. bye, //mirabilos -- diogenese Beware of ritual lest you forget the meaning behind it. igli yeah but it means if you really care about something, don't ritualise it, or you will lose it. don't fetishise it, don't obsess. or you'll forget why you love it in the first place. -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/pine.bsm.4.64l.1311031444380.31...@herc.mirbsd.org
Re: Potential issues for most ports (Was: Re: Bits from the Release Team (Jessie freeze info))
On Sun, Nov 03, 2013 at 11:54:34AM +0100, Niels Thykier wrote: On 2013-10-29 17:48, Ian Jackson wrote: Niels Thykier writes (Re: Bits from the Release Team (Jessie freeze info)): [...] As mentioned we are debating whether the 5 DDs requirement still makes sense. Would you say that we should abolish the requirement for DD porters completely? I.e. Even if there are no (soon to be) DDs, we should consider the porter requirements fulfilled as long as they are enough active porters behind the port[0]? I don't have a good feel for the answer to that question. It's just that if it is the case that a problem with ports is the lack of specifically DDs, rather than porter effort in general, then sponsorship is an obvious way to solve that problem. If you feel that that's not really the main problem then a criterion which counts porters of any status would be better. I suppose a sponsor-only DD could be sufficient, provided that the sponsor knows the porters well enough to be willing to sign off on e.g. access to porter boxes. I guess the sponsor would also need to dedicate time to mentor (new?) porters on workflows and on quicks like when is a FTBFS RC and when it isn't etc. Why would the sponsor need to be involved in getting the porters access to porter boxes? Porter boxes exist so that DDs *not* involved in a port have access to a machine of the architecture and can keep their packages working. I've never heard of a porter who didn't have access to their own box for porting work. -- Steve Langasek Give me a lever long enough and a Free OS Debian Developer to set it on, and I can move the world. Ubuntu Developerhttp://www.debian.org/ slanga...@ubuntu.com vor...@debian.org signature.asc Description: Digital signature
Re: Bits from the Release Team (Jessie freeze info)
Niels Thykier writes (Bits from the Release Team (Jessie freeze info)): Results of porter roll-call === ... Summary table: Arch || DDs || NMs/DMs || Other || Total - ---++-++-++---++-- armel || 5 || 0 || 2 ||7 armhf || 6 || 1 || 2 ||9 hurd-i386 || 5 || 0 || 3 ||8 ia64 || *0* || 0 || 3 ||3 kfreebsd-amd64 || 5 || 0 || 2 ||6 kfreebsd-i386 || 5 || 0 || 2 ||6 mips || 2 || 0 || 1 ||3 mipsel || 2 || 0 || 1 ||3 powerpc[1] || (1) || 0 || 2 || 2.5? s390x || 1 || 0 || 1 ||2 sparc || 1 || 0 || 0 ||1 ... Based on the number of porters, we are considering changing the current requirements of 5 DDs to better reflect the reality of the situation. We will follow up in a future bits on the changes. Thanks. I think it is disappointing to find that we may be dropping architectures where a significant amount of effort is available, simply because the volunteers don't have enough status - specifically, because of a lack of DDs. I'm keen that Debian should continue to support a wide range of architectures. Would it help if I, as a DD, volunteered to sponsor porter uploads for any architecture ? That is I guess I'm volunteering to become a new kind of person - a non-port-specific porter sponsor. Obviously I will review the debdiff etc. I'm an experienced C programmer with some background in C language lawyering and portability stuff, so I should usually be able to do a decent review of a patch even on an unfamiliar architecture. In fact, regardless of what the release team decide for the policy, I would be happy to sponsor porter uploads. Please just email me. Ian. -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/21103.52917.876297.985...@chiark.greenend.org.uk
Re: on bootstrapping ports (was: Re: Bits from the Release Team (Jessie freeze info))
On Monday, October 28, 2013 12:15:09 PM Emmanuel Bourg wrote: Le 27/10/2013 16:30, Daniel Schepler a écrit : (To be honest, the Java packages are such a tangled mess that I've given up on trying to bootstrap that part of the archive for now -- and many of those do get pulled into the minimal set of ca. 1473 source packages I get with my criteria.) Hi Daniel, could you elaborate on the tangled mess of the Java packages? As someone who cares about the Java packages in general I'd be interested in hearing what could be improved. (Let's take any more detailed discussions on this off debian-devel and leave it just on debian-java.) The first task would be to bootstrap gcj and then openjdk (and the latter's binary dependencies on libatk-wrapper-java-jni, ca-certificates-java, tzdata- java). Then I have to bootstrap ant, which is made difficult by the fact that there are so many Build-Depends needed before it's possible to build a full version of ant-optional. In the past I've done that by first building just ant from that package, and then whenever one of the indirect Build-Depends of ant- optional has a Build-Depends on ant-optional itself, I build a throwaway version of ant-optional against whatever I have available at that point. But now, with libgnumail-java having a Build-Depends on bnd which Build-Depends on some packages from eclipse, I don't really have any idea how to handle that, other than to drop the call to bnd and cross my fingers hoping nothing needs whatever the bnd call adds to that package. Mixed in with that, I also have to bootstrap maven-repo-helper, and for a few packages that I need before I'm able to do that, I do the ugly thing of just taking the metadata files from existing packages and installing them by hand into bootstrapped packages. Then, the next major hurdle is that many packages that are part of the Maven build system or its binary dependencies have Build- Depends on maven-debian-helper themselves. A while ago I figured out a way to bootstrap this using maven-ant-helper, but that's a long drawn-out process involving probably hundreds of packages. And I'm not sure that my process will still work, as there are even more packages that have switched to using maven-debian-helper to build in the meantime, including libjaxen-java which has always been a headache because of its circular Build-Depends with dom4j, libjdom1-java, xom. (Also, maven-ant-helper itself isn't necessarily that easy to bootstrap, as it Build-Depends on ant-contrib, which Build-Depends on ivy, which Build-Depends on libcommons-vfs-java, which needs maven-debian- helper.) And yes, maven-debian-helper is part of that set of ca. 1473 source packages, for example via the chain x11proto-core - fop - xmlgraphics- commons - mockito - objenesis - maven-debian-helper. Anyway, that's just an overview of the main issues I face with a bootstrap of the Java packages. If you want, I could restart my bootstrap process and let you know in more detail what Build-Depends cycles I run into (and solutions where I've been able to find them in past iterations). Obviously, though, very little of this will be relevant for the case of bootstrapping a new port, using the existing Architecture: all packages. -- Daniel Schepler -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/2411641.bXzH0chkUq@frobozz
Re: Bits from the Release Team (Jessie freeze info)
On 2013-10-29 16:05, Ian Jackson wrote: Niels Thykier writes (Bits from the Release Team (Jessie freeze info)): Results of porter roll-call === ... Summary table: Arch || DDs || NMs/DMs || Other || Total - ---++-++-++---++-- armel || 5 || 0 || 2 ||7 armhf || 6 || 1 || 2 ||9 hurd-i386 || 5 || 0 || 3 ||8 ia64 || *0* || 0 || 3 ||3 kfreebsd-amd64 || 5 || 0 || 2 ||6 kfreebsd-i386 || 5 || 0 || 2 ||6 mips || 2 || 0 || 1 ||3 mipsel || 2 || 0 || 1 ||3 powerpc[1] || (1) || 0 || 2 || 2.5? s390x || 1 || 0 || 1 ||2 sparc || 1 || 0 || 0 ||1 ... Based on the number of porters, we are considering changing the current requirements of 5 DDs to better reflect the reality of the situation. We will follow up in a future bits on the changes. Thanks. You are welcome. :) I think it is disappointing to find that we may be dropping architectures where a significant amount of effort is available, simply because the volunteers don't have enough status - specifically, because of a lack of DDs. As mentioned we are debating whether the 5 DDs requirement still makes sense. Would you say that we should abolish the requirement for DD porters completely? I.e. Even if there are no (soon to be) DDs, we should consider the porter requirements fulfilled as long as they are enough active porters behind the port[0]? I'm keen that Debian should continue to support a wide range of architectures. Would it help if I, as a DD, volunteered to sponsor porter uploads for any architecture ? That is I guess I'm volunteering to become a new kind of person - a non-port-specific porter sponsor. I suppose that could help ports without a DD if we allowed such to be in testing. However, it is my understanding that our main issue with ports often is that they are not actively maintained (or appears to lack active maintenance). As an example I remember having received several complains from e.g. the GCC maintainers in regards to the state of gcc on various ports[1]. Here I would suspect a patch would be sufficient without needing to actually NMU gcc to get the fix in. There are also stuff like the port concerns from DSA that attention. Obviously I will review the debdiff etc. I'm an experienced C programmer with some background in C language lawyering and portability stuff, so I should usually be able to do a decent review of a patch even on an unfamiliar architecture. In fact, regardless of what the release team decide for the policy, I would be happy to sponsor porter uploads. Please just email me. Ian. :) ~Niels [0] Leaving the definition of active porter vaguely defined for now. [1] Obviously, I haven't been keeping track of them so I had to ask for a reminder. https://lists.debian.org/debian-release/2013/10/msg00710.html -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/526fdfe3.7060...@thykier.net
Re: Bits from the Release Team (Jessie freeze info)
Niels Thykier writes (Re: Bits from the Release Team (Jessie freeze info)): On 2013-10-29 16:05, Ian Jackson wrote: I'm keen that Debian should continue to support a wide range of architectures. Would it help if I, as a DD, volunteered to sponsor porter uploads for any architecture ? That is I guess I'm volunteering to become a new kind of person - a non-port-specific porter sponsor. ... I suppose that could help ports without a DD if we allowed such to be in testing. Indeed. However, it is my understanding that our main issue with ports often is that they are not actively maintained (or appears to lack active maintenance). Right. As mentioned we are debating whether the 5 DDs requirement still makes sense. Would you say that we should abolish the requirement for DD porters completely? I.e. Even if there are no (soon to be) DDs, we should consider the porter requirements fulfilled as long as they are enough active porters behind the port[0]? I don't have a good feel for the answer to that question. It's just that if it is the case that a problem with ports is the lack of specifically DDs, rather than porter effort in general, then sponsorship is an obvious way to solve that problem. If you feel that that's not really the main problem then a criterion which counts porters of any status would be better. (Mind you, I have my doubts about a process which counts people promising to do work - it sets up some rather unfortunate incentives. I guess it's easier to judge and more prospective than a process which attempts to gauge whether the work has been done well enough.) As an example I remember having received several complains from e.g. the GCC maintainers in regards to the state of gcc on various ports[1]. Here I would suspect a patch would be sufficient without needing to actually NMU gcc to get the fix in. There are also stuff like the port concerns from DSA that attention. Right. Thanks, Ian. -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/21103.59120.410686.914...@chiark.greenend.org.uk
Re: on bootstrapping ports (was: Re: Bits from the Release Team (Jessie freeze info))
Le 27/10/2013 16:30, Daniel Schepler a écrit : (To be honest, the Java packages are such a tangled mess that I've given up on trying to bootstrap that part of the archive for now -- and many of those do get pulled into the minimal set of ca. 1473 source packages I get with my criteria.) Hi Daniel, could you elaborate on the tangled mess of the Java packages? As someone who cares about the Java packages in general I'd be interested in hearing what could be improved. Emmanuel Bourg -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/526e473d.7070...@apache.org
on bootstrapping ports (was: Re: Bits from the Release Team (Jessie freeze info))
Hi Peter, Quoting peter green (2013-10-27 01:11:24) Johannes Schauer wrote: Until these two issues are fixed we will not be able to get an algorithmic answer to the question of what constitutes the minimum required set of packages. There is also the complication of what I will call non-key self building compilers. fpc is an example Yes, this is also an issue and the two issues I mentioned are only a necessity but not a sufficiency for the whole bootstrap problem. In practice, it is of course not only needed to know that one must be able to build src:fpc without all the fp-* binaries (that's what my algorithms do right now) but also that this is really possible in practice. Since I only work with the algorithmic side of things I often forget to mention that one naturally needs more than correct meta data (dependency relationships) to make everything work :) You will find your example (fpc) in the section of Type 1 Self-Cycles on http://mister-muffin.de/bootstrap/stats/ together with other compilers like for haskell, sml or lisp. We call Type 1 Self-Cycles those where the source package directly build depends on a binary package it builds. Those are the most obvious self cycles and they are mostly made up of the non-key self building compilers as you call them. These are not needed to bootstrap the core of debian but if one wants to bootstrap all of debian they will need to be built. Indeed, none of the Type 1 Self-Cycles are needed to bootstrap the core of Debian. Unfortunately though, most of the Type 2 Self-Cycles are. You will find many surprising (at least to me) examples in the section of Type 2 Self-Cycles under the above link. We call Type 2 Self-Cycles those where the source package indirectly and strongly [1] build depends on a binary package it builds. They are hard to find because the only tool which is able to compute strong dependencies (afaik) is dose3 which is used by botch to do the required computations. [1] www.mancoosi.org/papers/esem-2009.pdf Surely every maintainer of source packages involved in a Type 1 Self-Cycle knows about this issue. Because Type 2 Self-Cycles are non-obvious we could in the future (once build profiles are available) embed this information in the pts for the relevant packages. On the other hand, there only exist a small number (26 for amd64) source packages involved in Type 2 Self-Cycles so it might be enough to just post priority wishlist bug reports for each of them. Since the only way to build them is with themselves they cannot be bootstrapped natively even with the help of build profiles. So the only way to bootstrap them is to either cross-build them or start with a binary from upstream. And even compilers which allow some way of bootstrapping them, do not have this process automated (ghc [2], mlton [3]). This is fine under the assumption that initial porting is rarely done and once it's done does not have to be repeated. But it does not allow continuous testing of bootstrappability of the whole archive. [2] http://ghc.haskell.org/trac/ghc/wiki/Building/Porting [3] http://mlton.org/PortingMLton cheers, josch -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20131027083354.16796.89806@hoothoot
Re: on bootstrapping ports (was: Re: Bits from the Release Team (Jessie freeze info))
On Sun, Oct 27, 2013 at 4:33 PM, Johannes Schauer wrote: Surely every maintainer of source packages involved in a Type 1 Self-Cycle knows about this issue. Because Type 2 Self-Cycles are non-obvious we could in the future (once build profiles are available) embed this information in the pts for the relevant packages. On the other hand, there only exist a small number (26 for amd64) source packages involved in Type 2 Self-Cycles so it might be enough to just post priority wishlist bug reports for each of them. Please do file a bug on the PTS (qa.debian.org, usertag pts) about this when the appropriate machine-readable package list and human-readable explanations are available. But it does not allow continuous testing of bootstrappability of the whole archive. This might be interesting information to have on edos.debian.net or elsewhere on Debian QA infrastructure. -- bye, pabs http://wiki.debian.org/PaulWise -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/caktje6edwqggqxw7ks2jwft83eo-ct0un6s2gyzuqcdpb-y...@mail.gmail.com
Re: on bootstrapping ports (was: Re: Bits from the Release Team (Jessie freeze info))
Johannes Schauer wrote: Indeed, none of the Type 1 Self-Cycles are needed to bootstrap the core of Debian. Unfortunately though, most of the Type 2 Self-Cycles are. You will find many surprising (at least to me) examples in the section of Type 2 Self-Cycles under the above link. On the other hand, if you count Build-Depends-Indep and Architecture: all packages as part of what you want to bootstrap, then gnat-4.6 does get pulled in... gzip Build-Depends-Indep: mingw-w64 mingw-w64 Build-Depends: gcc-mingw-w64-{i686,x86_64} gcc-mingw-w64 Build-Depends: gnat-4.6 (And also, you have the issue that gcc-4.8 Build-Depends on libantlr-java and libecj-java, whose builds require either gcj-4.8 from the same source package, or openjdk-7-jdk which also Build-Depends on ecj.) I realize that these sorts of issues aren't as important for the practical problem of bootstrapping a new port; but ideally, from a philosophical point of view we should be able to bootstrap all our packages. (To be honest, the Java packages are such a tangled mess that I've given up on trying to bootstrap that part of the archive for now -- and many of those do get pulled into the minimal set of ca. 1473 source packages I get with my criteria.) -- Daniel Schepler -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/2085384.4n0ClPvkx6@frobozz
Re: on bootstrapping ports (was: Re: Bits from the Release Team (Jessie freeze info))
Hi Daniel, Quoting Daniel Schepler (2013-10-27 16:06:43) Johannes Schauer wrote: Indeed, none of the Type 1 Self-Cycles are needed to bootstrap the core of Debian. Unfortunately though, most of the Type 2 Self-Cycles are. You will find many surprising (at least to me) examples in the section of Type 2 Self-Cycles under the above link. On the other hand, if you count Build-Depends-Indep and Architecture: all packages as part of what you want to bootstrap, then gnat-4.6 does get pulled in... gzip Build-Depends-Indep: mingw-w64 mingw-w64 Build-Depends: gcc-mingw-w64-{i686,x86_64} gcc-mingw-w64 Build-Depends: gnat-4.6 (And also, you have the issue that gcc-4.8 Build-Depends on libantlr-java and libecj-java, whose builds require either gcj-4.8 from the same source package, or openjdk-7-jdk which also Build-Depends on ecj.) I realize that these sorts of issues aren't as important for the practical problem of bootstrapping a new port; but ideally, from a philosophical point of view we should be able to bootstrap all our packages. (To be honest, the Java packages are such a tangled mess that I've given up on trying to bootstrap that part of the archive for now -- and many of those do get pulled into the minimal set of ca. 1473 source packages I get with my criteria.) you can easily use botch for an analysis of dependency cycles under your conditions as well. Botch is a collection of tools doing some mangling with sets of binary and source package metadata and creating and analyzing a graph build from them. By calling the involved tools a bit differently than it is done in the example shell script (which is to demonstrate the practical bootstrap scenario and thus drops B-D-I and arch:all) you can also analyze the situation you are talking about. More specifically, you want to change how the create_graph binary is called. The --available option expects a filename of a file containing the list of packages which is expected to be available in the bootstrapping sense [1]. This file is currently compiled containing all arch:all and all cross compiled binary packages. You are free to not add any arch:all packages or only some to that list. Secondly, per default B-D-I dependencies are ignored but you can pass the --keep-indep argument to the create_graph binary to let them be considered nevertheless. cheers, josch [1] https://gitorious.org/debian-bootstrap/pages/Terminology#Availability -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20131027152758.16796.78747@hoothoot
Re: on bootstrapping ports (was: Re: Bits from the Release Team (Jessie freeze info))
Am 27.10.2013 16:06, schrieb Daniel Schepler: Johannes Schauer wrote: Indeed, none of the Type 1 Self-Cycles are needed to bootstrap the core of Debian. Unfortunately though, most of the Type 2 Self-Cycles are. You will find many surprising (at least to me) examples in the section of Type 2 Self-Cycles under the above link. On the other hand, if you count Build-Depends-Indep and Architecture: all packages as part of what you want to bootstrap, then gnat-4.6 does get pulled in... gzip Build-Depends-Indep: mingw-w64 mingw-w64 Build-Depends: gcc-mingw-w64-{i686,x86_64} gcc-mingw-w64 Build-Depends: gnat-4.6 (And also, you have the issue that gcc-4.8 Build-Depends on libantlr-java and libecj-java, whose builds require either gcj-4.8 from the same source package, or openjdk-7-jdk which also Build-Depends on ecj.) I realize that these sorts of issues aren't as important for the practical problem of bootstrapping a new port; but ideally, from a philosophical point of view we should be able to bootstrap all our packages. (To be honest, the Java packages are such a tangled mess that I've given up on trying to bootstrap that part of the archive for now -- and many of those do get pulled into the minimal set of ca. 1473 source packages I get with my criteria.) well, please can we concentrate on practical issues first, then come back to the philosopicals again? With recent binary-indep packages you just cross-build gcc-4.8 including java. Problem solved. I never did see a bug report about the tangled mess in the java packages, so I'll just ignore that. gcj and openjdk were one of the easier parts for the AArch64 bootstrap. Matthias -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/526d497d@debian.org
Re: Bits from the Release Team (Jessie freeze info)
Hi, On Mittwoch, 23. Oktober 2013, Stewart Smith wrote: Jenkins can have slaves on remote hosts, via SSH. It runs a small java app there, so as long as the arch has a JVM then you're pretty right. that JVM is not even needed, just schedule jobs via ssh and be done. cheers, Holger signature.asc Description: This is a digitally signed message part.
Re: Bits from the Release Team (Jessie freeze info)
Hi, (I was not able to find the debian-ports list on lists.debian.org (so I subscribed via email) did I just miss it?) Quoting Steven Chamberlain (2013-10-23 22:04:59) I had a play with the 'botch' tool (see description[1]) for determining build order when bootstrapping an architecture. botch author here. Just stumbled upon this already a few day old email in my inbox :) To start off with it determines a minimum required set of packages - you'd normally cross-compile those from another system. This set (see attached example list for kfreebsd-amd64 wheezy) looks to me like what constitutes the 'toolchain'. This minimum set of packages which has to be cross compiled (because no binary package of the target architecture exists at this point) is what we call the minimal native build system (the name is misleading as disjunct dependencies make different choices of this set possible). Currently it is not possible to present a correct selection of source packages which have to be cross compiled to produce the minimal build system. What we currently do is to just do: grep-dctrl -X \( -FPackage build-essential --or -FPackage debhelper --or -FEssential yes) and assume that the resulting list of packages (the one you attached to your last email) is cross compilable from nothing. This is of course not the case in practice but a formal analysis is not possible yet. This is because multiarch annotations are missing in some packages and because of the problem of how to handle source packages directly depending on gcc, g++, binutils etc in the cross compilation case. While the first one is easy to fix there doesnt exist a solution for the second one yet. Build profiles would be able to solve the second problem. Until these two issues are fixed we will not be able to get an algorithmic answer to the question of what constitutes the minimum required set of packages. On the other hand wookey did lots of ubuntu crossing and identified that with just (I think it was) a dozen modified packages (reducing their build dependencies to break cross build dependency cycles) he was able to cross build all of these packages: http://people.linaro.org/~wookey/buildd/raring-arm64/status-bootstrap.html So while an automated analysis is not possible right now, it also does not seem to be necessary to have this automated. Having the to-be-crossed selection of packages retrieved automatically becomes more interesting as more source packages are known to be cross-compilable including all their required recursive build dependencies. The list will be different for each port, and change over time. This example included freebsd-libs, freebsd-utils and kfreebsd-kernel-headers but of course others won't. Thanks for trying out botch for kfreebsd :) AIUI those packages should be able to rebuild each of themselves without any other dependencies. Should but unfortunately they are not :( In fact, to nativel rebuild the minimal build system for amd64 (just essential:yes + build-essential + debhelper) one needs to be able to compile 383 source packages (excluding the source packages in the minimal build system itself). This is as of debconf13 when I last ran those scripts. You can look at the numbers here as well: http://mister-muffin.de/bootstrap/stats/ These 383 source packages include ugly ones like iceweasel, nautilus, webkit, network-manager, mysql, kde4libs which as you can imagine draw in half of what makes a modern desktop system and thus might naively have been dismissed as non-essential for the bootstrapping purpose at all. But of course this list will be different between arches. I think doing that regularly would be a good health check for a port's toolchain. Probably these packages would be the focus of the reproducible-builds project, at least from a security point-of-view. Any differences in output of subsequent builds are of interest, and would potentially reveal when significant changes or bugs were introduced too. Being able to use botch to automatically bootstrap all arches from scratch has always been one of botch's goals. Unfortunately the build profile discussion is holding up the implementation of this in practice but guillem promised to look into this for dpkg 1.17.2. cheers, josch -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20131026213931.16796.6@hoothoot
Re: Bits from the Release Team (Jessie freeze info)
Johannes Schauer j.scha...@email.de (2013-10-26): (I was not able to find the debian-ports list on lists.debian.org (so I subscribed via email) did I just miss it?) Dead list: http://lists.debian.org/debian-ports/ AFAICT it's now an alias for all debian-$port lists. Mraw, KiBi. signature.asc Description: Digital signature
Re: Bits from the Release Team (Jessie freeze info)
Johannes Schauer wrote: Until these two issues are fixed we will not be able to get an algorithmic answer to the question of what constitutes the minimum required set of packages. There is also the complication of what I will call non-key self building compilers. fpc is an example These are not needed to bootstrap the core of debian but if one wants to bootstrap all of debian they will need to be built. Since the only way to build them is with themselves they cannot be bootstrapped natively even with the help of build profiles. So the only way to bootstrap them is to either cross-build them or start with a binary from upstream. -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/526c4c1c.3060...@p10link.net
Re: Bits from the Release Team (Jessie freeze info)
On Wed, Oct 23, 2013 at 12:36 AM, Stewart Smith stew...@flamingspork.com wrote: Jenkins can have slaves on remote hosts, via SSH. It runs a small java app there, so as long as the arch has a JVM then you're pretty right. For whatever definition of small. I've seen it consuming 1 GiB of memory... Gr{oetje,eeting}s, Geert -- Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- ge...@linux-m68k.org In personal conversations with technical people, I call myself a hacker. But when I'm talking to journalists I just say programmer or something like that. -- Linus Torvalds -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/camuhmdvz3jwmdujds762z-cnhv4z5c9wuuf5rkanarqbsdx...@mail.gmail.com
Re: Bits from the Release Team (Jessie freeze info)
I run Jenkins at my job. Small is around 256mb. Plus the Jenkins server can sit on a high-memory machine and the agent just sit on a 68k box doing builds. Small is like 64M ram. You Amiga/Atari guys seem to have oodles of ram to work with Lol. On Oct 23, 2013 2:45 AM, Geert Uytterhoeven ge...@linux-m68k.org wrote: On Wed, Oct 23, 2013 at 12:36 AM, Stewart Smith stew...@flamingspork.com wrote: Jenkins can have slaves on remote hosts, via SSH. It runs a small java app there, so as long as the arch has a JVM then you're pretty right. For whatever definition of small. I've seen it consuming 1 GiB of memory... Gr{oetje,eeting}s, Geert -- Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- ge...@linux-m68k.org In personal conversations with technical people, I call myself a hacker. But when I'm talking to journalists I just say programmer or something like that. -- Linus Torvalds -- To UNSUBSCRIBE, email to debian-68k-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/camuhmdvz3jwmdujds762z-cnhv4z5c9wuuf5rkanarqbsdx...@mail.gmail.com
Re: Bits from the Release Team (Jessie freeze info)
Small is 64m ram not 256m. I just woke up and was catching up on things. My apologies. On Oct 23, 2013 7:20 AM, Britt Dodd brittman...@gmail.com wrote: I run Jenkins at my job. Small is around 256mb. Plus the Jenkins server can sit on a high-memory machine and the agent just sit on a 68k box doing builds. Small is like 64M ram. You Amiga/Atari guys seem to have oodles of ram to work with Lol. On Oct 23, 2013 2:45 AM, Geert Uytterhoeven ge...@linux-m68k.org wrote: On Wed, Oct 23, 2013 at 12:36 AM, Stewart Smith stew...@flamingspork.com wrote: Jenkins can have slaves on remote hosts, via SSH. It runs a small java app there, so as long as the arch has a JVM then you're pretty right. For whatever definition of small. I've seen it consuming 1 GiB of memory... Gr{oetje,eeting}s, Geert -- Geert Uytterhoeven -- There's lots of Linux beyond ia32 -- ge...@linux-m68k.org In personal conversations with technical people, I call myself a hacker. But when I'm talking to journalists I just say programmer or something like that. -- Linus Torvalds -- To UNSUBSCRIBE, email to debian-68k-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/camuhmdvz3jwmdujds762z-cnhv4z5c9wuuf5rkanarqbsdx...@mail.gmail.com
Re: Bits from the Release Team (Jessie freeze info)
On 22/10/13 23:36, Stewart Smith wrote: Jenkins can have slaves on remote hosts, via SSH. It runs a small java app there, so as long as the arch has a JVM then you're pretty right. That may be useful to set up on some arches, for things where Jenkins needs direct control over CPU-intensive tasks. Building and testing d-i, for example. But for this, I would imagine only the test suite needs to run over SSH, and the master Jenkins instance just has to process the output? For the proposed test suite to be as accessible as possible to a new/upcoming port, the barrier to using it ought to be very low. A working JVM is quite a lot to ask, the current openjdk-7 is not even built for mipsel in more. mipsel buildds and porterboxes had only 1GB RAM maximum until now, and that is heavily used already for their current tasks. Regards, -- Steven Chamberlain ste...@pyro.eu.org signature.asc Description: OpenPGP digital signature
Re: Bits from the Release Team (Jessie freeze info)
Geert Uytterhoeven ge...@linux-m68k.org writes: On Wed, Oct 23, 2013 at 12:36 AM, Stewart Smith stew...@flamingspork.com wrote: Jenkins can have slaves on remote hosts, via SSH. It runs a small java app there, so as long as the arch has a JVM then you're pretty right. For whatever definition of small. I've seen it consuming 1 GiB of memory... with 'm68k' in your email address your definition of small is likely much different than my many years in large scale databases small :) That being said... I haven't recently seen a slave jenkins java process more than one or two hundred mb. This is (of course) absolutely insane, as is the 4-6GB jenkins master process. However, dollars per GB of memory is suitably low that it's not worth me fixing it, instead it just sits there annoying me as it could undoubtedly be better -- Stewart Smith pgpYLYPIugD_P.pgp Description: PGP signature
Re: Bits from the Release Team (Jessie freeze info)
On 23/10/13 12:55, Stewart Smith wrote: Geert Uytterhoeven ge...@linux-m68k.org writes: On Wed, Oct 23, 2013 at 12:36 AM, Stewart Smith stew...@flamingspork.com wrote: Jenkins can have slaves on remote hosts, via SSH. It runs a small java app there, so as long as the arch has a JVM then you're pretty right. For whatever definition of small. I've seen it consuming 1 GiB of memory... with 'm68k' in your email address your definition of small is likely much different than my many years in large scale databases small :) Come to think of it, it must take a day or more for m68k to rebuild eglibc. This is a more serious problem than resources needed by Jenkins. We can't ask them to rebuild their entire toolchain each night! For the goal of software freedom, it shouldn't be too difficult for anyone to do that, though. We should be trying to make it easier. Maybe it would be permissible for the toolchain test suite to run on a faster platform, and cross-compile, or use any sort of emulation available in Debian free packages. If it were technically feasible for each Debian port to rebuild its toolchain and some essential packages, at least once per week, I think that would be an accomplishment. And the smaller the initial set of packages required to boostrap the process, the better. Regards, -- Steven Chamberlain ste...@pyro.eu.org signature.asc Description: OpenPGP digital signature
Re: Bits from the Release Team (Jessie freeze info)
Steven Chamberlain dixit: Come to think of it, it must take a day or more for m68k to rebuild eglibc. This is a more serious problem than resources needed by Kernel takes a day now (on the fastest VMs), eglibc 3 days, gcc 5 days (since gcj got folded into it; add another day or so once gnat will also be folded). Jenkins. We can't ask them to rebuild their entire toolchain each night! No OpenJDK either (can probably be fixed, but zero is sloow). Additionally, with only, say, 256 or 768 MiB physmem, running additional software on the buildds is something you do not want, considering how much RAM building some stuff takes (I had to use about 5 GiB of swap to link Webkit, and imagine just how much paging that involves, also in terms of time). Building GCC isn’t exactly resource-saving. (Even running apt/dpkg isn’t due to the sheer size of the archive, though Guillem kindly reduced memory usage in the upcoming dpkg upload.) I think with my “better SCC proposal” we could have a sliding scale for this, but I’d oppose using something OpenJDK-based for that (think of mipsel, too). Especially as simple mksh scripts would take care of the job too (including CGI for web export ;). bye, //mirabilos -- Solange man keine schmutzigen Tricks macht, und ich meine *wirklich* schmutzige Tricks, wie bei einer doppelt verketteten Liste beide Pointer XORen und in nur einem Word speichern, funktioniert Boehm ganz hervorragend. -- Andreas Bogk über boehm-gc in d.a.s.r -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/pine.bsm.4.64l.1310231242320.29...@herc.mirbsd.org
Re: Bits from the Release Team (Jessie freeze info)
On 22/10/13 21:27, Steven Chamberlain wrote: Some people have been trying to identify small sets of essential packages already, in the context of bootstrapping an architecture[1]. I wonder if that's likely to overlap with this? It encompasses toolchain and essential arch-specific packages. I had a play with the 'botch' tool (see description[1]) for determining build order when bootstrapping an architecture. To start off with it determines a minimum required set of packages - you'd normally cross-compile those from another system. This set (see attached example list for kfreebsd-amd64 wheezy) looks to me like what constitutes the 'toolchain'. The list will be different for each port, and change over time. This example included freebsd-libs, freebsd-utils and kfreebsd-kernel-headers but of course others won't. AIUI those packages should be able to rebuild each of themselves without any other dependencies. I think doing that regularly would be a good health check for a port's toolchain. Probably these packages would be the focus of the reproducible-builds project, at least from a security point-of-view. Any differences in output of subsequent builds are of interest, and would potentially reveal when significant changes or bugs were introduced too. [0]: https://gitorious.org/debian-bootstrap/botch [1]: http://blog.mister-muffin.de/2013/01/25/bootstrappable-debian---new-milestone/ Regards, -- Steven Chamberlain ste...@pyro.eu.org apt base-files base-passwd bash binutils bsdmainutils build-essential bzip2 coreutils dash db debianutils diffutils dpkg e2fsprogs eglibc expat file findutils freebsd-libs freebsd-utils gawk gcc-4.7 gcc-defaults gdbm gettext glib2.0 gmp gnupg grep groff gzip hostname html2text insserv kfreebsd-kernel-headers libbsd libcroco libffi libgssglue libpipeline libsigsegv libtirpc libunistring libusb libxml2 make-dfsg man-db mpclib mpfr4 ncurses pam patch pcre3 perl readline6 sed shadow slang2 sysvinit tar util-linux xz-utils zlib
Re: Bits from the Release Team (Jessie freeze info)
Hi Niels, This was quite interesting as it seems to tie in with some other projects that are already being pursued... On 21/10/13 16:42, Niels Thykier wrote: I would love for us to have an automated system to give us a weather-report on the toolchain for each architecture. It would be nice both for us to see how ports are doing and for porters to spot and fix problems early. That sounds a lot like the purpose of Jenkins[0], but I'm not sure if it's exactly suitable. It seems a little heavy, that someone could more easily be able to script some cron jobs for a task than learn how to use it. And Jenkins isn't available yet on all arches; some ports may not have hardware powerful enough to run it. Maybe that doesn't matter - a single Jenkins instance might be able to launch jobs via remote shells to other boxes, running the actual test suite there, or maybe just to fetch, analyse and report on the resulting log files. Ideally I'd like to see a set of command-line scripts runnable either from cron, or maybe someday by Jenkins jobs if someone wants to set that up. And packaged up for people to use at home! [0]: http://jenkins.debian.net/ Which implies a set of packages being the current version of the overwhelming part of the archive plus all of d-i. However, that is not something you just build, so having a smaller set as a basic test would probably be way more useful. I am not aware of such a basic test set, so feel free to propose one. Some people have been trying to identify small sets of essential packages already, in the context of bootstrapping an architecture[1]. I wonder if that's likely to overlap with this? It encompasses toolchain and essential arch-specific packages. I imagine a healthy port should be able to bootstrap itself with only current package versions. If this was being tested regularly it could let porters know if circular dependencies are introduced, for example. [1]: https://wiki.debian.org/DebianBootstrap#Toolchain I would maybe take that a little further and say that a system is only stable if it can bootstrap itself, install and boot into the resulting system, and repeat the whole process again... I like the toolchain nightly thing as well. I don't think it is required, but it sounds like the kind of thing that would help people spot issues sooner rather than later! And this also ties in with the reproducible-builds project[2] (not sure if you were hinting at that before). The 'toolchain' is of particular concern because the security of the whole system depends on it. Differences in the output of builds needs to be avoided, or otherwise explained. It would help greatly if there were frequent builds happening so we could see unexpected changes occurring. [2]: https://wiki.debian.org/ReproducibleBuilds So if something can make something that fulfills all the above goals it would certainly be beneficial :) Regards, -- Steven Chamberlain ste...@pyro.eu.org -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/5266df9d.9040...@pyro.eu.org
Re: Bits from the Release Team (Jessie freeze info)
Steven Chamberlain ste...@pyro.eu.org writes: On 21/10/13 16:42, Niels Thykier wrote: I would love for us to have an automated system to give us a weather-report on the toolchain for each architecture. It would be nice both for us to see how ports are doing and for porters to spot and fix problems early. That sounds a lot like the purpose of Jenkins[0], but I'm not sure if it's exactly suitable. It seems a little heavy, that someone could more easily be able to script some cron jobs for a task than learn how to use it. It's actually a pretty low barrier to entry, if you know what commands you need to run, it's pretty easy to get started with jenkins (create job, have it execute shell commands, write shell in box, hit build). I'd say that it's about 10 times more likely you'll get it right in Jenkins before you get it right in cron. And Jenkins isn't available yet on all arches; some ports may not have hardware powerful enough to run it. Maybe that doesn't matter - a single Jenkins instance might be able to launch jobs via remote shells to other boxes, running the actual test suite there, or maybe just to fetch, analyse and report on the resulting log files. Jenkins can have slaves on remote hosts, via SSH. It runs a small java app there, so as long as the arch has a JVM then you're pretty right. -- Stewart Smith pgpK9r2igtQxx.pgp Description: PGP signature
Re: Bits from the Release Team (Jessie freeze info)
On 2013-10-19 16:38, Jeremiah C. Foster wrote: Hello, On Sun, Oct 13, 2013 at 05:01:31PM +0200, Niels Thykier wrote: [snip freeze policy] Hi, I s/-arm/-ports/'ed the CC, since I figured the rest of the porters would find the answer equally interesting. Results of porter roll-call === [...] That said, we would like to encourage porters behind all ports to ensure that the toolchain is up to date and working. We are aware of at least gcc on mips having its test suite disabled[GCC]. Other ports may suffer from similar issues and we hope to have those resolved sooner rather than later. We are currently waiting for the gcc maintainers to compile a list of such issues. So I can extrapolate from this that ensuring that the toolchain is up to date and working is a key activity of a porter. Yes; build-essential being broken is obviously a problem. But also having the same default compiler on all architectures is also desired. If my assumption is correct, is there a complete definition of the toolchain as we see it in Debian that a porter might reasonably be expected to use to do thier porting? I do not have an complete list of packages, although it will definitely include build-essential. My intuition is that toolchain should include any compiler used by packages on that architecture[1] (e.g. if the arch has built haskell packages, it should have a working haskell compiler as well). But as said, that is my personally view and not an official statement. In addition, I wonder if there is a way to report the status of the toolchain and what sort of expectations are there around up to date? I would love for us to have an automated system to give us a weather-report on the toolchain for each architecture. It would be nice both for us to see how ports are doing and for porters to spot and fix problems early. As for up-to-date, I don't have a complete answer here. I seem to remember the GCC maintainers being frustrated at having to maintain gcc-4.6 (it is apparently still default for some architectures) despite gcc-4.8 being the latest stable release. Is it expected to build Debian toolchain nightly and run a specific test suite? Is the expectation that one uses pbuilder and builds a set of packages? What we got in the policy so far[2]: Installer: The architecture must have a working,tested installer. [...] Archive coverage: The architecture needs to have successfully compiled the current version of the overwhelming part of the archive [...] Which implies a set of packages being the current version of the overwhelming part of the archive plus all of d-i. However, that is not something you just build, so having a smaller set as a basic test would probably be way more useful. I am not aware of such a basic test set, so feel free to propose one. I like the toolchain nightly thing as well. I don't think it is required, but it sounds like the kind of thing that would help people spot issues sooner rather than later! Perhaps this is outlined on the wiki somewhere and if not perhaps it ought to be? Regards, Jeremiah Having documentation on it would definitely be a good thing. For actual requirements, we should add them to the policy[2], but having a wiki-page of recommended porter practises/tests would probably be a nice addition too. ~Niels [1] My rationale for this is that we would like to be able to rebuild/reproduce builds, which would require a working compiler. [2] http://release.debian.org/jessie/arch_policy.html -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/52654b6d.9020...@thykier.net
Re: Bits from the Release Team (Jessie freeze info)
Hello, On Sun, Oct 13, 2013 at 05:01:31PM +0200, Niels Thykier wrote: [snip freeze policy] Results of porter roll-call === Summary table: Arch || DDs || NMs/DMs || Other || Total - ---++-++-++---++-- armel || 5 || 0 || 2 ||7 armhf || 6 || 1 || 2 ||9 hurd-i386 || 5 || 0 || 3 ||8 ia64 || *0* || 0 || 3 ||3 kfreebsd-amd64 || 5 || 0 || 2 ||6 kfreebsd-i386 || 5 || 0 || 2 ||6 mips || 2 || 0 || 1 ||3 mipsel || 2 || 0 || 1 ||3 powerpc[1] || (1) || 0 || 2 || 2.5? s390x || 1 || 0 || 1 ||2 sparc || 1 || 0 || 0 ||1 [1] The (1) and .5 is from a I am not primarily a porter [...]-remark, so I wasn't sure how to count it. Based on the number of porters, we are considering changing the current requirements of 5 DDs to better reflect the reality of the situation. We will follow up in a future bits on the changes. That said, we would like to encourage porters behind all ports to ensure that the toolchain is up to date and working. We are aware of at least gcc on mips having its test suite disabled[GCC]. Other ports may suffer from similar issues and we hope to have those resolved sooner rather than later. We are currently waiting for the gcc maintainers to compile a list of such issues. So I can extrapolate from this that ensuring that the toolchain is up to date and working is a key activity of a porter. If my assumption is correct, is there a complete definition of the toolchain as we see it in Debian that a porter might reasonably be expected to use to do thier porting? In addition, I wonder if there is a way to report the status of the toolchain and what sort of expectations are there around up to date? Is it expected to build Debian toolchain nightly and run a specific test suite? Is the expectation that one uses pbuilder and builds a set of packages? Perhaps this is outlined on the wiki somewhere and if not perhaps it ought to be? Regards, Jeremiah -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20131019143847.GA9075@sylph
Re: Bits from the Release Team (Jessie freeze info)
❦ 14 octobre 2013 10:19 CEST, Thijs Kinkhorst th...@debian.org : As a Brit I guess I'm as surprised by people not knowing this as some US folks are when I don't have plans for the 4th July. The pleasures of an international project Everyone will find the 5 December milestone easy to remember; perhaps with the exception of those not living in the Netherlands or on the Netherlands Antilles. http://what-if.xkcd.com/53/ ;-) -- /* Identify the flock of penguins. */ 2.2.16 /usr/src/linux/arch/alpha/kernel/setup.c signature.asc Description: PGP signature
Re: Bits from the Release Team (Jessie freeze info)
On Sun, October 13, 2013 22:28, Jonathan Dowland wrote: As a Brit I guess I'm as surprised by people not knowing this as some US folks are when I don't have plans for the 4th July. The pleasures of an international project Everyone will find the 5 December milestone easy to remember; perhaps with the exception of those not living in the Netherlands or on the Netherlands Antilles. Thijs -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/57be485f8a1df7dda2e85e90194c0060.squir...@aphrodite.kinkhorst.nl
Re: Bits from the Release Team (Jessie freeze info)
On Sun, Oct 13, 2013 at 09:28:04PM +0100, Jonathan Dowland wrote: On 13/10/13 19:47, Niels Thykier wrote: (Not sure of the origins of the rime; I remember it being used in V from Vendetta though.) As a Brit I guess I'm as surprised by people not knowing this as some US folks are when I don't have plans for the 4th July. What's so special about the 4th of July? :) -- If you're not careful, the newspapers will have you hating the people who are being oppressed, and loving the people who are doing the oppressing. --- Malcolm X -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20131014110719.GB3831@tal
Re: Bits from the Release Team (Jessie freeze info)
On Tue, Oct 15, 2013 at 12:07:19AM +1300, Chris Bannister wrote: On Sun, Oct 13, 2013 at 09:28:04PM +0100, Jonathan Dowland wrote: On 13/10/13 19:47, Niels Thykier wrote: (Not sure of the origins of the rime; I remember it being used in V from Vendetta though.) As a Brit I guess I'm as surprised by people not knowing this as some US folks are when I don't have plans for the 4th July. What's so special about the 4th of July? :) It's precisely 10 days before Bastille Day. -- Steve Langasek Give me a lever long enough and a Free OS Debian Developer to set it on, and I can move the world. Ubuntu Developerhttp://www.debian.org/ slanga...@ubuntu.com vor...@debian.org signature.asc Description: Digital signature
Re: Bits from the Release Team (Jessie freeze info)
Hi Niels, First of all, thanks a lot for planning this well in advance. Much appreciated. This changes a lot compared to what happened in NYC! :) On 10/13/2013 11:01 PM, Niels Thykier wrote: Freeze date and Freeze Policy for Jessie We are happy to announce that we will freeze Jessie at 23:59 UTC on the 5th of November 2014. This date is surprising me. I thought we would have the same freeze date every 2 years, so I was expecting late June 2014, 2 years after the freeze of Wheezy. Wasn't this announced previously? Just right after Ubuntu had it's LTS out seemed to be a good moment. In fact, synchronizing the Debian freeze date with the Ubuntu LTS would have been even better, IMO (or the Ubuntu freeze date for the next LTS). Why the 5th of November 2014? Why beginning of November? Why the 5th and not the 4th or 6th? In other words: what's the reasoning behind this date? Cheers, Thomas -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/525ad75c.3090...@debian.org
Re: Bits from the Release Team (Jessie freeze info)
However, I think that we are also entitled to expect jessie release at 8/9 July 2015 maybe. This expectation resulting from my wheezy analysis of last freeze is in line with it. 2013/10/13 Thomas Goirand z...@debian.org: Hi Niels, First of all, thanks a lot for planning this well in advance. Much appreciated. This changes a lot compared to what happened in NYC! :) On 10/13/2013 11:01 PM, Niels Thykier wrote: Freeze date and Freeze Policy for Jessie We are happy to announce that we will freeze Jessie at 23:59 UTC on the 5th of November 2014. This date is surprising me. I thought we would have the same freeze date every 2 years, so I was expecting late June 2014, 2 years after the freeze of Wheezy. Wasn't this announced previously? Just right after Ubuntu had it's LTS out seemed to be a good moment. In fact, synchronizing the Debian freeze date with the Ubuntu LTS would have been even better, IMO (or the Ubuntu freeze date for the next LTS). Why the 5th of November 2014? Why beginning of November? Why the 5th and not the 4th or 6th? In other words: what's the reasoning behind this date? Cheers, Thomas -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/525ad75c.3090...@debian.org -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/CAF-vDa_r5etax9fS1rbS1H+u=SOLm8o6R-AtFkX0=o3qs8u...@mail.gmail.com
Re: Bits from the Release Team (Jessie freeze info)
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Hi, We are happy to announce that we will freeze Jessie at 23:59 UTC on the 5th of November 2014. thanks for annoucing that early and for your work! [...] * Proactive automated removals 3 months into the freeze. - Note that bug-free packages will be removed if they (build-)depend on a RC-buggy, non-key package. Could we get a warning about such removals before they are scheduled? Like at least one week before? Having an eye on all packages all my packages build-depend is something which would be great to avoid ;) [...] - Native packages are at a disadvantage here, since all uploads of native packages are considered a new upstream version. So whats the fix for that? Migrating native packages to non-native ones does not always make sense. [...] - It should also go without saying that embedding a new upstream release in a patch just to get a such carte blanche exception is also considered abuse. What about bugfix point-releases from upstream, like postgres and other sane upstreams do it? thanks cheers, Bernd - -- Bernd ZeimetzDebian GNU/Linux Developer http://bzed.dehttp://www.debian.org GPG Fingerprint: ECA1 E3F2 8E11 2432 D485 DD95 EB36 171A 6FF9 435F -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.14 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iQIcBAEBCAAGBQJSWtszAAoJEOs2Fxpv+UNfINMP/jvhfnBwKvZH/NuQAOSD4bHM KNw8ptkaHROHk5JRsqadUzPk5fO5EHXYfYug1d65wlDxpMppk0HvAehC0jd8JSa7 Pk0nl0BK3jdymS52ghN4L6kiDaG9Y6o0FhWUaeQisV9YIp65dLrBDTVntLIcuSLQ K6fuJvvsHj2m8ZH1ke3Oj6wSlPYTpftCqqZubnQ8XfKuZbgKU7kxQZJ+9SWxDrK1 LdP+jVKwfcV8EnnV8/m8hDuz5Nl5D3aiaw0mM+RJbiTmgq/DeaEGQlfQT6+WRBTl HTmV51kjbVtMdj12sdHVE6HhXFHJ7eKH84+uabm0Teu5o2MBeT80Wu63u8bwTdZS ZzTGbKUzZQscWdmHHy719w4nTcE/5FpNlV8yvNxe9DlFCrh0AXuXsY7Coo7yalT6 r1Tb1BP80G6KWBiaZVA1uf4fh83RXXdxMixhwDwfpj7jEuFtHI6OIY5/x7HiYScl X8l7/HHLFiEpiyzs0voWX0n3/La6LC/BJisbJFZ1h2H4wuqTa7vxGCtO6OR+cwOV F8Y/C1KEi54tVlXvUy+qV3QAz32dZuFuZzyNGaBG+etKA3PNvYmU4zz/Isd11FC7 YB2JEPl1EPJBQ2Az27Y/lcCG1+KgBGVnj9xGPTJefC4I96su9bnQi7uVd+3yLX29 HMh0/OPElaGVMQLhzI82 =dV3F -END PGP SIGNATURE- -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/525adb3b.20...@bzed.de
Re: Bits from the Release Team (Jessie freeze info)
On 2013-10-13 19:24, Thomas Goirand wrote: Hi Niels, Hi, First of all, thanks a lot for planning this well in advance. Much appreciated. This changes a lot compared to what happened in NYC! :) You are welcome, :) On 10/13/2013 11:01 PM, Niels Thykier wrote: Freeze date and Freeze Policy for Jessie We are happy to announce that we will freeze Jessie at 23:59 UTC on the 5th of November 2014. This date is surprising me. I thought we would have the same freeze date every 2 years, so I was expecting late June 2014, 2 years after the freeze of Wheezy. Wasn't this announced previously? Personally, I backed a freeze in November 2014 because I wanted to aim for a = 2 year release cycle. This (at most) 2-year estimate includes an 18 month development period and a(n up to) 6 month freeze. Obviously, if the freeze is shorter than 6 months, great! Having 2 years between every freeze date would make sense if we could keep our freezes shorter than 6 months. It could hopefully also motivate people into making the freezes shorter (giving us a slightly longer development cycle). But if our freezes are 10 months, then 2-years between freeze-dates leaves us with only 14 months of development. Of which, the Release Team would be spending 4-5 months recuperating from the last freeze (based on the past year). Just right after Ubuntu had it's LTS out seemed to be a good moment. In fact, synchronizing the Debian freeze date with the Ubuntu LTS would have been even better, IMO (or the Ubuntu freeze date for the next LTS). I think our first priority should be getting back in control of our freezes and the length thereof. Why the 5th of November 2014? Why beginning of November? Why the 5th and not the 4th or 6th? In other words: what's the reasoning behind this date? Cheers, Thomas We picked the 5th over another date in November because it was believed the 5th would be easier to remember[1]. ~Niels [1] I think the 5th of November is also Gunpowder day and also happens to have a good simple mnemonic/rime: Remember, remember the fifth of November (Not sure of the origins of the rime; I remember it being used in V from Vendetta though.) -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/525aeac5.9060...@thykier.net
Re: Bits from the Release Team (Jessie freeze info)
On 13/10/13 19:47, Niels Thykier wrote: We picked the 5th over another date in November because it was believed the 5th would be easier to remember[1]. ... (Not sure of the origins of the rime; I remember it being used in V from Vendetta though.) https://en.wikipedia.org/wiki/Gunpowder_plot https://en.wikipedia.org/wiki/Guy_Fawkes_Night S -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/525af4b3.5070...@debian.org
Re: Bits from the Release Team (Jessie freeze info)
On 2013-10-13 19:41, Bernd Zeimetz wrote: Hi, We are happy to announce that we will freeze Jessie at 23:59 UTC on the 5th of November 2014. thanks for annoucing that early and for your work! You are welcome. :) [...] * Proactive automated removals 3 months into the freeze. - Note that bug-free packages will be removed if they (build-)depend on a RC-buggy, non-key package. Could we get a warning about such removals before they are scheduled? Like at least one week before? Having an eye on all packages all my packages build-depend is something which would be great to avoid ;) We could just finish the finish the freeze within 3 months and not have this problem at all! XD Honestly, I am hoping we can have such a list of packages be found in an automatically. At the current time, about 3k of all source packages builds at least one key package vs. a total of 20k-21k source packages (in sid). A quick estimate suggests that we got over 80% source packages that could be candidates for such removals. If I have to find those manually, I will probably end up being pretty sad (and unable to do it on a regular basis - which would somewhat defeat the purpose of this idea). [...] - Native packages are at a disadvantage here, since all uploads of native packages are considered a new upstream version. So whats the fix for that? Migrating native packages to non-native ones does not always make sense. The quick fix is to not do these carte blanche-unblocks at all, which is the status-quo/current plan. Obviously, if the upload of a native package fits the freeze policy, it can still receive a manual unblock. But honestly, I would prefer if we didn't need to resolve this gray area at all. If people are trying to rely on carte blanche-unblocks, they might be optimising for the wrong thing. Having your packages ready and *in testing* before November is really a much simplier and easier for all parties involved. Bonus if they are 100% bug free too. On a related note: I would recommend people to get accustomised to interpreting the excuses from Britney[1] and keeping an eye out for Valid candidate-packages that are not migrating despite being in that state for a couple of days. Even if we were to do carte blanche-unblocks, your package must still be able to migrate as-is, which apparently caught many people by surprise during the Wheezy cycle. This is actually another argument for not doing these carte blanche-unblocks. We had quite some difficulty in conveying our intention behind them. People seemed to have quite a different understanding of how they were supposed to work. Side note: Should you be fed up with Britney's (un)helpful exucses-page, you are more than welcome to get in touch with us and to help us write patches to classify the problems better. [...] - It should also go without saying that embedding a new upstream release in a patch just to get a such carte blanche exception is also considered abuse. What about bugfix point-releases from upstream, like postgres and other sane upstreams do it? thanks cheers, Bernd If you are doing a new point release, you ought to bump the upstream version of your package. As soon as you do that, it would no longer be applicable for a carte blanche unblock. The note referenced above is about embedding all the upstream changes in a Debian patch and only bumping the Debian revision (while keeping the upstream version unchanged). Basically, it is a don't game the system-rule (like the don't abuse urgency-rule). ~Niels [1] They are admittedly not always very helpful to non-Britney-developers. Basically, people tend to get confused by out of date-binaries and side-effects caused by having out of date-binaries. See also: http://nthykier.wordpress.com/2013/07/14/britney-excuses-ood/ The tricky part of an “out of date”-excuse is that Britney simply identifies a symptom and not a cause. Side-effects of out of date-binaries may include RC bugs fixed in sid is not considered fixed by Britney and package not migrating to testing. -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/525af8ba.30...@thykier.net
Re: Bits from the Release Team (Jessie freeze info)
On 13/10/13 19:47, Niels Thykier wrote: (Not sure of the origins of the rime; I remember it being used in V from Vendetta though.) As a Brit I guess I'm as surprised by people not knowing this as some US folks are when I don't have plans for the 4th July. The pleasures of an international project ☺ -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/20131013202804.GA23218@debian
Re: Bits from the Release Team (Jessie freeze info)
On 2013-10-13 17:01, Niels Thykier wrote: Freeze date and Freeze Policy for Jessie We are happy to announce that we will freeze Jessie at 23:59 UTC on the 5th of November 2014. To avoid any confusion around exactly how we will freeze, we have prepared a draft of the Jessie Freeze Policy in advance [FREEZE_POLICY]. [...] As noted we are dealing with a draft, so there may be changes to the actual freeze policy. Should we change the policy in a substantial way, this will be included in subsequent bits. [...] Niels, on behalf of the Debian Release Team. [FREEZE_POLICY] http://release.debian.org/jessie/freeze_policy.html [...] Hi, I have gotten several (private) follow-ups asking whether 2014 is a typo or not. Obviously, it did not help that there was a typo in the freeze policy listing 2013 in some places (they should now all say 2014). So to clarify: We will freeze the 5th November 2014, which is about thirteen months from now (i.e. next year). ~Niels -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/525b1038.1080...@thykier.net
Re: Bits from the Release Team (Jessie freeze info)
On Sun, Oct 13, 2013 at 11:01 PM, Niels Thykier wrote: We are happy to announce that we will freeze Jessie at 23:59 UTC on the 5th of November 2014. Thanks for announcing the freeze so early! In an effort to spread the word to our upstreams and users, I posted a link to your mail to LWN, Slashdot and Hacker News, here are the submission links: https://news.ycombinator.com/item?id=6543123 http://slashdot.org/submission/3043667/freeze-date-and-policy-for-debian-jessie -- bye, pabs http://wiki.debian.org/PaulWise -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/CAKTje6HOyeixA5w0GJDH1pfZVDH-77+ehmjFvXc_Lju=w31...@mail.gmail.com
Re: Bits from the Release Team (Jessie freeze info)
On Mon, Oct 14, 2013 at 9:18 AM, Paul Wise wrote: In an effort to spread the word to our upstreams and users, I posted a link to your mail to LWN, Slashdot and Hacker News, here are the submission links: I didn't submit it but here is one more: http://www.phoronix.com/scan.php?page=news_itempx=MTQ4NTA http://www.phoronix.com/news2forums.php?view=MTQ4NTA -- bye, pabs http://wiki.debian.org/PaulWise -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a subject of unsubscribe. Trouble? Contact listmas...@lists.debian.org Archive: http://lists.debian.org/CAKTje6EZSsey30R7cQutaxXeFL9c5NFRjHF5QwoUp_=hv-k...@mail.gmail.com