[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-06-16 Thread Marcelo Cerri
The issue can't be reproduced anymore. ** Changed in: linux-signed-azure (Ubuntu) Status: Incomplete => Won't Fix -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1858495 Title: multiple long

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-03-27 Thread Colin Ian King
** Changed in: linux-signed-azure (Ubuntu) Status: New => Incomplete -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1858495 Title: multiple long delays during kernel and userspace boot To

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-03-24 Thread Colin Ian King
I added initcall debug and got some more data: The first delay: # [ 2.846188] localhost.localdomain kernel: AES CTR mode by8 optimization enabled # [ 5.919313] localhost.localdomain kernel: raid6: avx2x4 gen() 21512 MB/s There are some silent initializations occuring between these two points,

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-03-23 Thread Colin Ian King
Thanks for the useful feedback, I'll enable some finer grained metrics tomorrow and see if I can pin point those longer delays. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1858495 Title: multiple

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-03-23 Thread Ryan Harper
Ah, from the journal.log: Command line: BOOT_IMAGE=/boot/vmlinuz-5.3.0-1008-azure root=PARTUUID=1261a2c6-48ca-43ee-9b70-197f5b89b82c ro console=tty1 console=ttyS0 earlyprintk=ttyS0 panic=-1 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-03-23 Thread Ryan Harper
None of the VMs will be using spinning disks, it's all SSD; and virtual disks anyhow. I would not expect much timing difference on virtual hardware; there aren't real device or pci timing delays; though the kernel may wait for them; however, it should be consistent. In terms of the things that

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-03-23 Thread Colin Ian King
Some of the early kernel boot time variations occur when detecting and spinning up devices sda and sbd and reading the partition information. Given this is probably spinny disc media, one would expect variations of this kind in early boot. The other variations I can see are also due to probing of

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-03-23 Thread Colin Ian King
And also data for bug-bionic-baseline-no-templating-Standard-DS2-v2.csv attached ** Attachment added: "Results-baseline-no-templating-Standard-DS2-v2.ods"

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-03-23 Thread Colin Ian King
Hi Ryan, I analysed the data from comment #6 using the journal.log from bug- bionic-baseline-after-templating-Standard-DS2-v2 and collated some notable places in the boot process and compared boots 1 through to 10. Attached are the results as a LibreOffice Calc spread sheet. The data shows a

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-03-19 Thread Colin Ian King
Can you update the bug with the output from the command: cat /proc/cmdline I wonder if an overly pessimistic rootdelay setting is being used. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1858495

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-02-26 Thread Ryan Harper
The primary concern is time before rootfs mounting and executing /sbin/init. For the spots after that, that falls into systemd territory. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1858495 Title:

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-02-26 Thread Ryan Harper
> 14:48:15> this slowness is happening with a particular instance type? I've not tested extensively across all types; but it's common for any of the "fast" types which have SSD backing. I've seen this DS1_v2, DS2_v2, DS3_v3, D4-v2, B2s, A2s, L4s > 14:49:38> the slowness is happening across

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-02-26 Thread Ryan Harper
here is some debug data I captured: -rw-rw-r-- 1 ubuntu ubuntu 729 Dec 16 12:15 bug-bionic-baseline-after-templating-Standard-DS2-v2.csv drwxrwxr-x 12 ubuntu ubuntu 22 Dec 16 12:15 bug-bionic-baseline-after-templating-Standard-DS2-v2.csv.debug/ -rw-rw-r-- 1 ubuntu ubuntu 721 Dec 16 13:07

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-02-26 Thread Ryan Harper
Sorry for missing the questions earlier. Azure has two "machine types" gen1 which boots a non-uefi based virtual hardware platform and gen2 which is UEFI with newer virtual hardware, details here: https://azure.microsoft.com/en-us/updates/generation-2-virtual-machines-

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-02-26 Thread Colin Ian King
Hi Ryan, We would like to reproduce this bug to debug it further. Can you answer the questions below relating to your initial comments in the bug: "Booting some Bionic instances in Azure (gen1 machines).." Q: What is a gen1 machine? What instance type is this? "..I see some large delays during

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-02-18 Thread Andrea Righi
Hi Ryan, these boot delays are happening with a particular instance type or a particular configuration? Is this slowness consistent across reboots (rebooting the same instance multiple times)? I'm doing some tests (profiling kernel initcalls and user-space boot time via systemd-analize) using an

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-02-08 Thread Colin Ian King
** Changed in: linux-signed-azure (Ubuntu) Importance: Undecided => Medium ** Changed in: linux-signed-azure (Ubuntu) Status: New => In Progress -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1858495] Re: multiple long delays during kernel and userspace boot

2020-01-16 Thread Colin Ian King
** Changed in: linux-signed-azure (Ubuntu) Assignee: (unassigned) => Colin Ian King (colin-king) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1858495 Title: multiple long delays during kernel