[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-29 Thread Michael Hudson-Doyle
Thanks for the update! I wasn't expecting the UEFI install to work but
happy to hear it does!

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-29 Thread Malte Kuhn
Mainboard firmware update worked. Installable and bootable in both
legacy and uefi mode.

** Changed in: subiquity
   Status: New => Fix Released

** Changed in: subiquity (Ubuntu)
   Status: New => Fix Released

** Changed in: curtin
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-29 Thread Malte Kuhn
Sorry for the delay. Installation continues and finishes in UEFI mode.

Now we ran into boot issues (SSD is the same model, but mainboard
isn't), but those are unlikely Software related (seems like an AHCI
Driver bug in the mainboard firmware) - so we can't confirm that the
installed OS boots.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-29 Thread Malte Kuhn
So this issue can be closed.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-17 Thread Malte Kuhn
We'll try next week. Then i've physical access

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-14 Thread Michael Hudson-Doyle
The latest daily (i.e. 20200414) has the patches discussed here.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-11 Thread Michael Hudson-Doyle
They're not on an ISO yet but if you can try with the edge snap, you'll
get a subiquity with these patches. https://discourse.ubuntu.com/t/how-
to-test-the-latest-version-of-subiquity/12428 has a few ways you can do
this.

I would not expect UEFI installs to work yet but hopefully the BIOS
install will work with edge.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-10 Thread Malte Kuhn
As soon those patches are in the daily live iso - we would like to test
again. Please send us a notice, so we can report back.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-09 Thread Server Team CI bot
This bug is fixed with commit 0832e4ef to curtin on branch master.
To view that commit see the following URL:
https://git.launchpad.net/curtin/commit/?id=0832e4ef


** Changed in: curtin
   Status: Confirmed => Fix Committed

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-08 Thread Launchpad Bug Tracker
** Merge proposal linked:
   https://code.launchpad.net/~raharper/curtin/+git/curtin/+merge/381963

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-08 Thread Michael Hudson-Doyle
The crash file from the failed UEFI install is in comment #18, and
contains the probe data.

** Changed in: curtin
   Status: Incomplete => Confirmed

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-08 Thread Ryan Harper
Can we get the /var/log/installer/block/probe-data*.json files?


Also, if you have the var-crash from your failed UEFI install, that would help 
me fix the UEFI install.

** Also affects: curtin
   Importance: Undecided
   Status: New

** Changed in: curtin
   Status: New => Incomplete

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/curtin/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-08 Thread Malte Kuhn
After you mentioned UEFI, we are now able to install in bios legacy mode. 
ヽ(•‿•)ノ
We still have a second system, that can be used to test the latest ISO on UEFI 
mode

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-08 Thread Michael Hudson-Doyle
It never ends, the failure is now

 + grub-install --target=x86_64-efi --efi-directory=/boot/efi 
--bootloader-id=ubuntu --recheck
 Installing for x86_64-efi platform.
 grub-install: warning: efivarfs_get_variable: 
open(/sys/firmware/efi/efivars/blk0-47c7b225-c42a-11d2-8e57-00a0c969723b): No 
such file or directory.
 grub-install: warning: efi_get_variable: ops->get_variable failed: No 
such file or directory.
 grub-install: warning: device_get: readlink of 
/sys/block/(null)/device failed: No such file or directory.
 grub-install: warning: open_disk: could not open disk: No such file or 
directory.
 grub-install: warning: efi_va_generate_file_device_path_from_esp: 
could not open disk: No such file or directory.
 grub-install: warning: efi_generate_file_device_path_from_esp: could 
not generate File DP from ESP: No such file or directory.
 grub-install: error: failed to register the EFI boot entry: No such 
file or directory.
 failed to install grub!

I'm going to lie down for a bit before I think about this though.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-08 Thread Malte Kuhn
Well that worked for the block probing step :)

The device is now selectable and the installation process begins. :+1:

But the patched curtin (from your paste) seems to trip on a next error
during install:


Tags:  focal uec-images
Title: install failed crashed with CalledProcessError
Traceback:
 Traceback (most recent call last):
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/curtin/commands/main.py", 
line 202, in main
 ret = args.func(args)
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/curtin/commands/curthooks.py",
 line 1638, in curthooks
 builtin_curthooks(cfg, target, state)
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/curtin/commands/curthooks.py",
 line 1604, in builtin_curthooks
 setup_grub(cfg, target, osfamily=osfamily)
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/curtin/commands/curthooks.py",
 line 627, in setup_grub
 join_stdout_err + args + instdevs, env=env, capture=True)
   File "/snap/subiquity/1999/lib/python3.6/site-packages/curtin/util.py", line 
275, in subp
 return _subp(*args, **kwargs)
   File "/snap/subiquity/1999/lib/python3.6/site-packages/curtin/util.py", line 
141, in _subp
 cmd=args)
 curtin.util.ProcessExecutionError: Unexpected error while running command.


The install fail is attached.

Thank you for your commitment and patience, Michael!

** Attachment added: "1586336110.222144365.install_fail.crash"
   
https://bugs.launchpad.net/subiquity/+bug/1868109/+attachment/5349400/+files/1586336110.222144365.install_fail.crash

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-07 Thread Michael Hudson-Doyle
This tiny patch to curtin https://paste.ubuntu.com/p/fbJVRmdBjz/ gets
past this crash. If your expeditious colleague would like to try
patching the subiquity snap with that and trying again, I'd be
interested to hear if that works!

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-07 Thread Michael Hudson-Doyle
So the udev data for /dev/nvme0n1 is:

/devices/virtual/nvme-subsystem/nvme-subsys0/nvme0n1
 N: nvme0n1
 L: 0
 S: disk/by-id/nvme-SAMSUNG_MZPLL3T2HAJQ-5_S4CCNE0M300015
 S: disk/by-id/nvme-eui.344343304d300015002538450004
 E: DEVPATH=/devices/virtual/nvme-subsystem/nvme-subsys0/nvme0n1
 E: SUBSYSTEM=block
 E: DEVNAME=/dev/nvme0n1
 E: DEVTYPE=disk
 E: MAJOR=259
 E: MINOR=1
 E: USEC_INITIALIZED=5210525
 E: MPATH_SBIN_PATH=/sbin
 E: DM_MULTIPATH_DEVICE_PATH=0
 E: ID_SERIAL_SHORT=S4CCNE0M300015
 E: ID_WWN=eui.344343304d300015002538450004
 E: ID_MODEL=SAMSUNG MZPLL3T2HAJQ-5
 E: ID_REVISION=GPJA0B3Q
 E: ID_SERIAL=SAMSUNG MZPLL3T2HAJQ-5_S4CCNE0M300015
 E: ID_PART_TABLE_UUID=4bac57b7-307b-4b0e-a853-e0232c6fb955
 E: ID_PART_TABLE_TYPE=gpt
 E: DEVLINKS=/dev/disk/by-id/nvme-SAMSUNG_MZPLL3T2HAJQ-5_S4CCNE0M300015 
/dev/disk/by-id/nvme-eui.344343304d300015002538450004
 E: TAGS=:systemd:

The specific problem we have here is that when scanning for physical
disks, we filter out DEVPATHs that start with /devices/virtual, because
you know, we're looking for physical disks. Maybe we should only filter
on /devices/virtual/block instead?

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-07 Thread Michael Hudson-Doyle
The crash is now

 Traceback (most recent call last):
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/subiquity/controllers/filesystem.py",
 line 144, in _probe
 self._probe_once_task.task, 15.0)
   File "/snap/subiquity/1999/usr/lib/python3.6/asyncio/tasks.py", line 358, in 
wait_for
 return fut.result()
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/subiquity/controllers/filesystem.py",
 line 124, in _probe_once
 self.model.load_probe_data(storage)
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/subiquity/models/filesystem.py",
 line 1529, in load_probe_data
 self.reset()
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/subiquity/models/filesystem.py",
 line 1266, in reset
 self._probe_data)["storage"]["config"]
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/curtin/storage_config.py", 
line 1317, in extract_storage_config
 tree = get_config_tree(cfg.get('id'), final_config)
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/curtin/storage_config.py", 
line 275, in get_config_tree
 for dep in find_item_dependencies(item, sconfig):
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/curtin/storage_config.py", 
line 245, in find_item_dependencies
 _validate_dep_type(item_id, dep_key, dep, config)
   File 
"/snap/subiquity/1999/lib/python3.6/site-packages/curtin/storage_config.py", 
line 193, in _validate_dep_type
 'Invalid dep_id (%s) not in storage config' % dep_id)
 ValueError: Invalid dep_id (disk-nvme0n1) not in storage config

so, progress of a kind I guess? Will take a look later.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-07 Thread Malte Kuhn
My colleague manually patched probert in the subiquity snap (fictional
snap revision 1999 based on 1626 and your PR above) and we get a
different stacktrace now.

** Attachment added: "probert patch applied"
   
https://bugs.launchpad.net/subiquity/+bug/1868109/+attachment/5348624/+files/subiquity-error.tar.xz

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-07 Thread Michael Hudson-Doyle
I created https://github.com/CanonicalLtd/probert/pull/86 which is
hopefully a workaround/fix for this

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-06 Thread Michael Hudson-Doyle
Sorry for the slow response and thanks for the offer but I think we have
enough information to go on to debug this. Other things just keep on
coming up! Hopefully I can look at this tomorrow.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-02 Thread Malte Kuhn
Even if my last comment was sent on April 1st - it was no joke :)

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1868109] Re: block probing fails with KeyError MAJOR

2020-04-01 Thread Malte Kuhn
Hi Michael,

would it help to grant you SSH access into the installation session
(daily-live current iso) on that machine?

Regards
Malte

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1868109

Title:
  block probing fails with KeyError MAJOR

To manage notifications about this bug go to:
https://bugs.launchpad.net/subiquity/+bug/1868109/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs