Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Hello, all, I was experiencing this problem and was able to get around it by additionally passing `--no-systemd-networkd --enable-dhcp` to vmdebootstrap. regards Afif -- Afif Elghraoui | عفيف الغراوي http://afif.ghraoui.name
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
On Wed, 30 Nov 2016 at 09:16:09 +0100, Johannes Schauer wrote: > Quoting Martin Pitt (2016-11-30 08:52:51) > > The expected state is that it is a symlink to > > /run/systemd/resolve/resolv.conf, and that's the bit that apparently doesn't > > exist -- i. e. systemd-resolved.service is not running in your case. So > > using > > the second method and vmdebootstrapping a VM without the setup script and > > checking it inside sounds like a good next step. ... > One solution might be to document that the autopkgtest qemu setupscript > depends > on systemd-resolved.service running. Another solution would be to make the > script independent of it. Maybe there is also something that can be addressed > in vmdebootstrap? If the VM is completely dependent on systemd-resolved for name resolution, then I think the problem might be that vmdebootstrap, despite its name, does not actually do anything with VMs. Instead, it runs as root and does everything with chroot(), including running the setup script - so at the time the setup script runs, systemd-resolved.service is not available, because services aren't run while chrooted? S
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Hi, Quoting Martin Pitt (2016-11-30 09:51:10) > Johannes Schauer [2016-11-30 9:39 +0100]: > > sorry I didn't mention that before. Without the autopkgtest setup script, > > vmdebootstrap finishes successfully. > > Finish yes, that's the easy part. The interesting part is whether you can > boot that VM and resolve names in it? Is resolved running? yes, it runs fine and internet is working. /etc/resolv.conf is indeed a symbolic link to /run/systemd/resolve/resolv.conf systemd-resolved is running cheers, josch signature.asc Description: signature
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Johannes Schauer [2016-11-30 9:39 +0100]: > sorry I didn't mention that before. Without the autopkgtest setup script, > vmdebootstrap finishes successfully. Finish yes, that's the easy part. The interesting part is whether you can boot that VM and resolve names in it? Is resolved running? Martin -- Martin Pitt| http://www.piware.de Ubuntu Developer (www.ubuntu.com) | Debian Developer (www.debian.org) signature.asc Description: PGP signature
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Hi, Quoting Martin Pitt (2016-11-30 09:32:05) > Hence I would like to see if vmdebootstrap is also broken without the setup > script. It might very well be possible that the autopkgtest setup script > changes some configuration which breaks resolved or whatnot. sorry I didn't mention that before. Without the autopkgtest setup script, vmdebootstrap finishes successfully. cheers, josch signature.asc Description: signature
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Johannes Schauer [2016-11-30 9:16 +0100]: > > The expected state is that it is a symlink to > > /run/systemd/resolve/resolv.conf, and that's the bit that apparently doesn't > > exist -- i. e. systemd-resolved.service is not running in your case. So > > using > > the second method and vmdebootstrapping a VM without the setup script and > > checking it inside sounds like a good next step. > > okay, that will fix things in my case but how would the general problem here > be > addressed. And who is at fault? There's no "fix" here yet, we are still trying to find out what happens in your case :-) So I can't say yet who is at fault -- the most likely candidates are a bug in vmdebootstrap or systemd. Hence I would like to see if vmdebootstrap is also broken without the setup script. It might very well be possible that the autopkgtest setup script changes some configuration which breaks resolved or whatnot. Martin -- Martin Pitt| http://www.piware.de Ubuntu Developer (www.ubuntu.com) | Debian Developer (www.debian.org) signature.asc Description: PGP signature
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Hi Martin, Quoting Martin Pitt (2016-11-30 08:52:51) > The expected state is that it is a symlink to > /run/systemd/resolve/resolv.conf, and that's the bit that apparently doesn't > exist -- i. e. systemd-resolved.service is not running in your case. So using > the second method and vmdebootstrapping a VM without the setup script and > checking it inside sounds like a good next step. okay, that will fix things in my case but how would the general problem here be addressed. And who is at fault? One solution might be to document that the autopkgtest qemu setupscript depends on systemd-resolved.service running. Another solution would be to make the script independent of it. Maybe there is also something that can be addressed in vmdebootstrap? Thanks! cheers, josch signature.asc Description: signature
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Hello, Johannes Schauer [2016-11-29 8:04 +0100]: > + cat /tmp/tmpSxHjE2/etc/resolv.conf > cat: /tmp/tmpSxHjE2/etc/resolv.conf: No such file or directory > EEEK! Something bad happened... > Command failed: /usr/share/autopkgtest/setup-commands/setup-testbed > /tmp/tmpSxHjE2 autopkgtest-sid.raw > > So apparently, there is no /etc/resolv.conf inside the chroot?? The expected state is that it is a symlink to /run/systemd/resolve/resolv.conf, and that's the bit that apparently doesn't exist -- i. e. systemd-resolved.service is not running in your case. So using the second method and vmdebootstrapping a VM without the setup script and checking it inside sounds like a good next step. Martin -- Martin Pitt| http://www.piware.de Ubuntu Developer (www.ubuntu.com) | Debian Developer (www.debian.org) signature.asc Description: PGP signature
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Hi Martin, Quoting Martin Pitt (2016-11-28 22:31:52) > Johannes Schauer [2016-11-28 12:15 +]: > > Can you tell me a way to diagnose the problem as apparently it works fine > > for > > you? So I put this into the file: echo $root cat $root/etc/resolv.conf And added a -x. With that I got on standard error: Running customize script /usr/share/autopkgtest/setup-commands/setup-testbed + umask 0022 + [ /tmp/tmpSxHjE2 = --help ] + root=/tmp/tmpSxHjE2 + echo /tmp/tmpSxHjE2 /tmp/tmpSxHjE2 + cat /tmp/tmpSxHjE2/etc/resolv.conf cat: /tmp/tmpSxHjE2/etc/resolv.conf: No such file or directory EEEK! Something bad happened... Command failed: /usr/share/autopkgtest/setup-commands/setup-testbed /tmp/tmpSxHjE2 autopkgtest-sid.raw Cleaning up Umounting /tmp/tmpSxHjE2 ERROR: Command failed: /usr/share/autopkgtest/setup-commands/setup-testbed /tmp/tmpSxHjE2 autopkgtest-sid.raw So apparently, there is no /etc/resolv.conf inside the chroot?? cheers, josch signature.asc Description: signature
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Hi, Quoting Martin Pitt (2016-11-27 22:43:21) > I ran exactly the same command successfully on my box, with the same > vmdebootstrap version, and http://httpredir.debian.org/debian works fine > inside the VM. Was that perhaps a temporary network glitch? (Deutsche > Telekom has failed DNS resolution today..) no Telekom here and as I wrote in my initial report, the name resolved fine outside of the VM. I also tried again inside the Uni network and inside the $work network. Same results. > Do you get it without the $AUTOPKGTEST_APT_PROXY too? (I tried with an > invalid one and the error looks different). Yes and same results (as I wrote in my initial report). > Does httpredir.d.o work on your host? Yes. Can you tell me a way to diagnose the problem as apparently it works fine for you? Thanks! cheers, josch signature.asc Description: signature
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Control: tag -1 unreproducible Johannes Schauer [2016-11-27 1:28 +0100]: > $ AUTOPKGTEST_APT_PROXY=http://127.0.0.1:3142 sudo vmdebootstrap --verbose > --serial-console --distribution=sid > --customize=/usr/share/autopkgtest/setup-commands/setup-testbed > --user=test/test --size=10 --grub --image=autopkgtest-sid.raw > Err:1 http://httpredir.debian.org/debian sid/main amd64 libdbus-1-3 amd64 > 1.10.12-1 > Temporary failure resolving 'httpredir.debian.org' I ran exactly the same command successfully on my box, with the same vmdebootstrap version, and http://httpredir.debian.org/debian works fine inside the VM. Was that perhaps a temporary network glitch? (Deutsche Telekom has failed DNS resolution today..) Do you get it without the $AUTOPKGTEST_APT_PROXY too? (I tried with an invalid one and the error looks different). Does httpredir.d.o work on your host? Martin -- Martin Pitt| http://www.piware.de Ubuntu Developer (www.ubuntu.com) | Debian Developer (www.debian.org)
Bug#845925: autopkgtest customize script for vmdebootstrap is unable to resolve httpredir.debian.org
Package: autopkgtest
Version: 4.2.1
Severity: normal
Hi,
as the man page suggests, I'm running:
$ AUTOPKGTEST_APT_PROXY=http://127.0.0.1:3142 sudo vmdebootstrap --verbose
--serial-console --distribution=sid
--customize=/usr/share/autopkgtest/setup-commands/setup-testbed
--user=test/test --size=10 --grub --image=autopkgtest-sid.raw
Creating disk image
Creating partitions
Creating filesystem ext4
Mounting /dev/mapper/loop0p1 on /tmp/tmpmc1xY2
Debootstrapping sid [amd64]
Give root an empty password
Removing udev persistent cd and net rules
Enabling systemd-networkd for DHCP
Enabling systemctl-resolved for DNS
Running customize script /usr/share/autopkgtest/setup-commands/setup-testbed
perl: warning: Setting locale failed.
perl: warning: Please check that your locale settings:
LANGUAGE = (unset),
LC_ALL = (unset),
LANG = "en_US.UTF-8"
are supported and installed on your system.
perl: warning: Falling back to the standard locale ("C").
/usr/sbin/grub-probe: error: cannot find a device for / (is /dev mounted?).
WARNING: update-grub failed!
Err:1 http://httpredir.debian.org/debian sid InRelease
Temporary failure resolving 'httpredir.debian.org'
Reading package lists... Done
W: Failed to fetch http://httpredir.debian.org/debian/dists/sid/InRelease
Temporary failure resolving 'httpredir.debian.org'
W: Some index files failed to download. They have been ignored, or old ones
used instead.
Reading package lists... Done
Building dependency tree... Done
The following additional packages will be installed:
libdbus-1-3 libeatmydata1 libexpat1
Suggested packages:
default-dbus-session-bus | dbus-session-bus
The following NEW packages will be installed:
dbus eatmydata libdbus-1-3 libeatmydata1 libexpat1
0 upgraded, 5 newly installed, 0 to remove and 0 not upgraded.
Need to get 509 kB of archives.
After this operation, 1435 kB of additional disk space will be used.
Err:1 http://httpredir.debian.org/debian sid/main amd64 libdbus-1-3 amd64
1.10.12-1
Temporary failure resolving 'httpredir.debian.org'
Err:2 http://httpredir.debian.org/debian sid/main amd64 libexpat1 amd64 2.2.0-1
Temporary failure resolving 'httpredir.debian.org'
Err:3 http://httpredir.debian.org/debian sid/main amd64 dbus amd64 1.10.12-1
Temporary failure resolving 'httpredir.debian.org'
Err:4 http://httpredir.debian.org/debian sid/main amd64 libeatmydata1 amd64
105-5
Temporary failure resolving 'httpredir.debian.org'
Err:5 http://httpredir.debian.org/debian sid/main amd64 eatmydata all 105-5
Temporary failure resolving 'httpredir.debian.org'
E: Failed to fetch
http://httpredir.debian.org/debian/pool/main/d/dbus/libdbus-1-3_1.10.12-1_amd64.deb
Temporary failure resolving 'httpredir.debian.org'
E: Failed to fetch
http://httpredir.debian.org/debian/pool/main/e/expat/libexpat1_2.2.0-1_amd64.deb
Temporary failure resolving 'httpredir.debian.org'
E: Failed to fetch
http://httpredir.debian.org/debian/pool/main/d/dbus/dbus_1.10.12-1_amd64.deb
Temporary failure resolving 'httpredir.debian.org'
E: Failed to fetch
http://httpredir.debian.org/debian/pool/main/libe/libeatmydata/libeatmydata1_105-5_amd64.deb
Temporary failure resolving 'httpredir.debian.org'
E: Failed to fetch
http://httpredir.debian.org/debian/pool/main/libe/libeatmydata/eatmydata_105-5_all.deb
Temporary failure resolving 'httpredir.debian.org'
E: Unable to fetch some archives, maybe run apt-get update or try with
--fix-missing?
EEEK! Something bad happened...
Command failed: /usr/share/autopkgtest/setup-commands/setup-testbed
/tmp/tmpmc1xY2 autopkgtest-sid.raw
Cleaning up
Umounting /tmp/tmpmc1xY2
ERROR: Command failed: /usr/share/autopkgtest/setup-commands/setup-testbed
/tmp/tmpmc1xY2 autopkgtest-sid.raw
This problem appears with or without AUTOPKGTEST_APT_PROXY set. My host
is able to resolve httpredir.debian.org just fine:
$ ping -c 4 httpredir.debian.org
PING httpredir.debian.org (5.153.231.35) 56(84) bytes of data.
64 bytes from httpredir-bm-01.debian.org (5.153.231.35): icmp_seq=1 ttl=41
time=49.1 ms
64 bytes from httpredir-bm-01.debian.org (5.153.231.35): icmp_seq=2 ttl=41
time=47.5 ms
64 bytes from httpredir-bm-01.debian.org (5.153.231.35): icmp_seq=3 ttl=41
time=45.8 ms
64 bytes from httpredir-bm-01.debian.org (5.153.231.35): icmp_seq=4 ttl=41
time=53.9 ms
This is with vmdebootstrap (= 1.7-1).
Thanks!
cheers, josch
-- System Information:
Debian Release: stretch/sid
APT prefers testing
APT policy: (990, 'testing'), (500, 'unstable'), (1, 'experimental')
Architecture: amd64 (x86_64)
Foreign Architectures: i386, armhf
Kernel: Linux 4.8.0-1-amd64 (SMP w/4 CPU cores)
Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
Versions of packages autopkgtest depends on:
ii apt-utils 1.3
ii libdpkg-perl1.18.13
ii procps
