Public bug reported:

First of all I am not sure that is about a bug or misunderstanding of a
concept.

I am trying to make a custom ISO w/ autoinstall to automatically install Ubuntu 
Server 24.04.1 LTS onto our machines. We of course need to install some extra 
apt packages as part of the customization. The problem is, this installation 
needs to be done entirely offline (mostly with rj45 unplugged), so I can't just 
add them to the apt package list and have subiquity magic take care of 
everything. Briefly:
- Extract iso. I'll call the extracted dir 'iso';
- Add the packages to iso/pool/universe/path/to/package.deb; added also deps 
(apt-get --print-uris --yes install "$package" | grep ^\' | cut -d\' -f2);
- Then to add them to the Packages and Packages.gz file that lists all the 
available packages by calling;
- Update the the Release file;
- Create a gpg key and sign the Release file;
- Add the public key (gpg) to trusted keys in 
ubuntu-server-minimal.ubuntu-server.squashfs.
- resumm md5 (cd image && find . -type f -print0 | xargs -0 md5sum | grep -v 
"\./md5sum.txt" > md5sum.txt)

For testing purpose I downloaded traceroute. user-data looks like:
#cloud-config
autoinstall:
  version: 1
  source:
    id: ubuntu-server
  shutdown: poweroff
  packages:
    - traceroute
  identity:
    realname: 'UntouchedWagons'
    username: ubuntu
    password: 'secret'
    hostname: local-host

  locale: en_US.UTF-8
  keyboard:
    layout: us
  timezone: "Europe/Athena"
  storage:
    layout:
      name: lvm
      sizing-policy: all
  ssh:
    allow-pw: true
    install-server: true
    authorized-keys:
      - some-keys

I've also tried variations and combinations of the above where I've also
specified a "late-commands:" or "network:" section, detailed late. It
"appears" to me that subiquity crash while downloading/install
traceroute:

 Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11210]: It is, so unshare 
will use --mount-proc=/target/proc
 Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11210]: Running command 
['unshare', '--fork', '--pid', '--mount-proc=/target/proc', '--', 'chroot', 
'/target', 'apt-get', '--quiet', '--option=Acquire::Languages=none', 'update'] 
with allowed return codes [0] (capture=False)
 Sep 10 21:25:27 ubuntu-server systemctl[11227]: Running in chroot, ignoring 
command 'start'
 Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11221]: Get:1 file:/cdrom 
noble InRelease
 Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11221]: Ign:1 file:/cdrom 
noble InRelease
 Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11221]: Get:2 file:/cdrom 
noble Release [1296 B]
 Sep 10 21:25:27 ubuntu-server subiquity_log.1716[11221]: Get:2 file:/cdrom 
noble Release [1296 B]
 Sep 10 21:25:27 ubuntu-server subiquity_event.1716[1716]:    
subiquity/Install/install/postinstall/install_traceroute/cmd-system-install: 
curtin command system-install
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11221]: Reading package 
lists...

... exacly what I was hoping/needing

 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['unshare', '--fork', '--pid', '--mount-proc=/target/proc', '--', 'chroot', 
'/target', 'apt-get', '--quiet', '--assume-yes', 
'--option=Dpkg::options::=--force-unsafe-io', 
'--option=Dpkg::Options::=--force-confold', 'install', '--download-only', 
'traceroute'] with allowed return codes [0] (capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: Reading package 
lists...
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: Building dependency 
tree...
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: Reading state 
information...
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: Package traceroute is 
not available, but is referred to by another package.
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: This may mean that 
the package is missing, has been obsoleted, or
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: is only available 
from another source
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11333]: E: Package 
'traceroute' has no installation candidate
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['udevadm', 'settle'] with allowed return codes [0] (capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: TIMED 
subp(['udevadm', 'settle']): 0.011
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['mount', '--make-private', '/target/usr/bin/ischroot'] with allowed return 
codes [0] (capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['umount', '/target/usr/bin/ischroot'] with allowed return codes [0] 
(capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['mount', '--make-private', '/target/sys/firmware/efi/efivars'] with allowed 
return codes [0] (capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['umount', '/target/sys/firmware/efi/efivars'] with allowed return codes [0] 
(capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['mount', '--make-private', '/target/sys'] with allowed return codes [0] 
(capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['umount', '/target/sys'] with allowed return codes [0] (capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['mount', '--make-private', '/target/run'] with allowed return codes [0] 
(capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['umount', '/target/run'] with allowed return codes [0] (capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['mount', '--make-private', '/target/proc'] with allowed return codes [0] 
(capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['umount', '/target/proc'] with allowed return codes [0] (capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['mount', '--make-private', '/target/dev'] with allowed return codes [0] 
(capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Running command 
['umount', '/target/dev'] with allowed return codes [0] (capture=False)
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: system install failed 
for ['traceroute']: Unexpected error while running command.
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Command: ['unshare', 
'--fork', '--pid', '--mount-proc=/target/proc', '--', 'chroot', '/target', 
'apt-get', '--quiet', '--assume-yes', 
'--option=Dpkg::options::=--force-unsafe-io', 
'--option=Dpkg::Options::=--force-confold', 'install', '--download-only', 
'traceroute']
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Exit code: 100
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Reason: -
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Stdout: ''
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: Stderr: ''
 Sep 10 21:25:28 ubuntu-server subiquity_log.1716[11210]: finish: 
cmd-system-install: FAIL: curtin command system-install
 Sep 10 21:25:28 ubuntu-server curtin_event.1716.9[11210]: finish: 
cmd-system-install: FAIL: curtin command system-install

I searched for "has_network" in 
var/crash/1725992736.960986614.install_fail.crash and here are the results:
  2024-09-10 18:22:47,079 DEBUG subiquitycore.models.network:469 has_network 
False

... also as I was expecting

When the installer crash's while still in the Live session, if I pop into the 
terminal and check the following:
apt-get install --download-only traceroute
- works fine
apt-get install traceroute
- works fine

I have used such a method to install our systems since ubuntu 12.04 with seed 
files and "d-i pkgsel/include string " worked like a charm. After a lot a 
research I found that somehow this is normal behavior:
cat /cdrom/etc/apt/sources.list
"deb cdrom:[Ubuntu-Server 24.04.1 LTS _Noble Numbat_ - Release amd64 
(20240827)]/ noble main restricted universe"
and corecly read components from "/cdrom/dists/noble/Release" -> "Components: 
main restricted universe"

But in chrooted env that install run:
cat /target/cdrom/etc/apt/sources.list
"deb [check-date=no] file:///cdrom noble main restricted"
the "universe" component is missing because apt.py:L245 says:
        write_file(
            self.install_tree.p('etc/apt/sources.list'),
            f'deb [check-date=no] file:///cdrom {codename} main restricted\n')
that looks laike a fail-safe method
*) what if I need also multiverse?

I have some workarounds for my issue like copying all my debs in a tmp
/target directory and run "dpkg -i *", also copying in
"/target/var/cache/apt/archives" but not sure if it is enought for apt-
get to install it, or even more go to debian. Anyway, none of those
looks for me an elegant one.

My question is that if am I doing something wrong because
autoinstall/subiquity/curtin was designed for different purpose, or
there is any solution?

** Affects: subiquity (Ubuntu)
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2080745

Title:
  Subiquity curtin apt-get insatll fails from cdrom files

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/subiquity/+bug/2080745/+subscriptions


-- 
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to