Bug#879145: net-retriever doesn't pull udebs from the 'unreleased' distribution

[Cyril Brulebois]

jhcha54008  (2017-12-30):
> clone 879145 -1
> retitle -1 backports support
> thanks
> 
> Thank you for your answer. I can understand that you prioritize
> backports support. Perhaps we should open a different bug report 
> to keep track of the discussion about backports support ?
> 
> debian-ports supports seems comparatively easier : there is no
> udeb package overlap between the two suites 'unstable' and 'unreleased',
> as far as I can see. Some packages in 'unreleased' are arch-specific 
> to a non released architecture - and so not in 'unstable'. And the
> other packages didn't make their way to 'unstable' because they FTBFS -
> modified versions were uploded to 'unreleased'.

Provided your input, it looks like adding support for unreleased would
be trivial once we have backports support. As I said in my earlier mail,
let's see if we can make that happen during January. Pokes welcome if
you don't see anything move by the end of that month.

Season's greetings to you too!

Cheers,
-- 
Cyril Brulebois (k...@debian.org)
D-I release manager -- Release team member -- Freelance Consultant


signature.asc
Description: PGP signature

Bug#879145: net-retriever doesn't pull udebs from the 'unreleased' distribution

[jhcha54008]

clone 879145 -1
retitle -1 backports support
thanks

Thank you for your answer. I can understand that you prioritize
backports support. Perhaps we should open a different bug report 
to keep track of the discussion about backports support ?

debian-ports supports seems comparatively easier : there is no
udeb package overlap between the two suites 'unstable' and 'unreleased',
as far as I can see. Some packages in 'unreleased' are arch-specific 
to a non released architecture - and so not in 'unstable'. And the
other packages didn't make their way to 'unstable' because they FTBFS -
modified versions were uploded to 'unreleased'.

Bonne fin d'année à tous !

Regards,
JH Chatenet


Le vendredi 20 octobre à 11h 32mn 29s (+0200), Cyril Brulebois a écrit :
> Hi,
> 
> jhcha54008  (2017-10-19):
> > net-retriever pulls udeb packages from one sole suite
> > (the one registered in mirror/udeb/suite).
> > 
> > Non released architectures from www.debian-ports.org may store
> > some udebs in the suite 'unreleased' too. These are currently
> > neglected by net-retriever.
> > 
> > The patch below enables the use of both suites by net-retriever
> > on non released architectures. (A file 'port_architecture'
> > should be created previously by another package, e.g. 
> > choose-mirror-bin. See #879130)
> 
> We still haven't managed to get around to merging support for backports
> over the past few years, but I'd slightly prefer if we could merge it
> first.
> 
> I only have a vague recollection, but ISTR net-retriever was only able
> to perform installations from a single source, and I had to implement
> merging Packages files from stable and stable-backports, which I don't
> see in your proposed patch.
> 
> 
> KiBi.

Bug#879145: net-retriever doesn't pull udebs from the 'unreleased' distribution

[Cyril Brulebois]

John Paul Adrian Glaubitz  (2017-10-20):
> Didn't debian-installer add support for adding backports to the
> sources.list during installation? I vaguely remember having seen such
> an option which could be checked during installation.

This is an apt-setup question, entirely unrelated to building d-i
against backports, which is most useful to get a more recent kernel.
(Then fetching extra udebs from backports as well.)

> But I assume that one merely set up backports for the target system to
> be used after the installation without the possibility to pull
> backports packages during installation.

Exactly.
 

KiBi.


signature.asc
Description: PGP signature

Bug#879145: net-retriever doesn't pull udebs from the 'unreleased' distribution

[John Paul Adrian Glaubitz]

On 10/20/2017 11:32 AM, Cyril Brulebois wrote:

We still haven't managed to get around to merging support for backports
over the past few years, but I'd slightly prefer if we could merge it
first.


Didn't debian-installer add support for adding backports to the sources.list
during installation? I vaguely remember having seen such an option which
could be checked during installation.

But I assume that one merely set up backports for the target system to
be used after the installation without the possibility to pull backports
packages during installation.


I only have a vague recollection, but ISTR net-retriever was only able
to perform installations from a single source, and I had to implement
merging Packages files from stable and stable-backports, which I don't
see in your proposed patch.


I agree, that would be a sensible thing to do first.

Adrian

--
 .''`.  John Paul Adrian Glaubitz
: :' :  Debian Developer - glaub...@debian.org
`. `'   Freie Universitaet Berlin - glaub...@physik.fu-berlin.de
  `-GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913

Bug#879145: net-retriever doesn't pull udebs from the 'unreleased' distribution

[Cyril Brulebois]

Hi,

jhcha54008  (2017-10-19):
> net-retriever pulls udeb packages from one sole suite
> (the one registered in mirror/udeb/suite).
> 
> Non released architectures from www.debian-ports.org may store
> some udebs in the suite 'unreleased' too. These are currently
> neglected by net-retriever.
> 
> The patch below enables the use of both suites by net-retriever
> on non released architectures. (A file 'port_architecture'
> should be created previously by another package, e.g. 
> choose-mirror-bin. See #879130)

We still haven't managed to get around to merging support for backports
over the past few years, but I'd slightly prefer if we could merge it
first.

I only have a vague recollection, but ISTR net-retriever was only able
to perform installations from a single source, and I had to implement
merging Packages files from stable and stable-backports, which I don't
see in your proposed patch.


KiBi.


signature.asc
Description: PGP signature

Bug#879145: net-retriever doesn't pull udebs from the 'unreleased' distribution

[jhcha54008]

Package: net-retriever
Version: 1.44
Severity: wishlist
Tags: patch
X-Debbugs-CC: "Helge Deller" , "John Paul Adrian Glaubitz" 
, "James Clarke" 

Dear Maintainer,

net-retriever pulls udeb packages from one sole suite
(the one registered in mirror/udeb/suite).

Non released architectures from www.debian-ports.org may store
some udebs in the suite 'unreleased' too. These are currently
neglected by net-retriever.

The patch below enables the use of both suites by net-retriever
on non released architectures. (A file 'port_architecture'
should be created previously by another package, e.g. 
choose-mirror-bin. See #879130)

Regards,
JH Chatenet

--- a/net-retriever
+++ b/net-retriever
@@ -84,31 +84,9 @@
exit 1
 }
 
-cmd="$1"
-shift
-
-case "$cmd" in
-retrieve)
-   fetch "$@"
-   exit $?
-   ;;
-
-packages)
-   rm -f "$1"
-   touch "$1"
-
-   # Setting codename to a suite is not very nice, but can do no harm
-   if ! db_get mirror/udeb/suite || [ -z "$RET" ]; then
-   if [ -f /etc/udebs-source ]; then
-   RET=$(cat /etc/udebs-source)
-   else
-   db_get mirror/codename
-   fi
-   fi
-   codename="$RET"
-
+get_packages () {
Release="/tmp/net-retriever-$$-Release"
-   fetch "dists/$codename/Release" "$Release" || exit $?
+   fetch "dists/$codename/Release" "$Release" || return $?
# If gpgv and a keyring are installed, authentication is
# mandatory by default.
if type gpgv >/dev/null && [ -f "$keyring" ]; then
@@ -157,6 +135,43 @@
break
done
done
+
+   return $ret;
+}
+
+cmd="$1"
+shift
+
+case "$cmd" in
+retrieve)
+   fetch "$@"
+   exit $?
+   ;;
+
+packages)
+   rm -f "$1"
+   touch "$1"
+
+   # Setting codename to a suite is not very nice, but can do no harm
+   if ! db_get mirror/udeb/suite || [ -z "$RET" ]; then
+   if [ -f /etc/udebs-source ]; then
+   RET=$(cat /etc/udebs-source)
+   else
+   db_get mirror/codename
+   fi
+   fi
+   codename="$RET"
+
+   get_packages "$1" || exit $ret
+
+   if [ -e /usr/lib/choose-mirror/port_architecture ]; then
+   # Port architectures use both suites 'unstable' and 'unreleased'
+   # We append the 'Packages' file from 'unreleased' to the one 
from 'unstable'
+   # We don't require the availability of 'unreleased'
+   codename="unreleased"
+   get_packages "$1"
+   fi
+
exit $ret
;;