[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Bug Watch Updater]

** Changed in: binutils
   Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/binutils/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Bug Watch Updater]

** Changed in: binutils (Debian)
   Status: Confirmed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/binutils/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Launchpad Bug Tracker]

This bug was fixed in the package binutils - 2.37.90.20220130-0ubuntu2

---
binutils (2.37.90.20220130-0ubuntu2) jammy; urgency=medium

  * Also ignore regressions for the cross packages.

 -- Matthias Klose   Sun, 30 Jan 2022 16:59:06 +0100

** Changed in: binutils (Ubuntu Jammy)
   Status: New => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/binutils/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Bug Watch Updater]

** Changed in: binutils (Debian)
   Status: New => Confirmed

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/binutils/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Bug Watch Updater]

** Changed in: binutils
   Status: Confirmed => In Progress

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/binutils/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Brian Murray]

** Also affects: binutils (Ubuntu Jammy)
   Importance: Critical
   Status: New

** Also affects: xen (Ubuntu Jammy)
   Importance: Undecided
   Status: Invalid

** Tags removed: rls-jj-incoming

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/binutils/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Matthieu Clemenceau]

** Tags added: fr-2001

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/binutils/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Bug Watch Updater]

** Changed in: binutils (Debian)
   Status: Unknown => New

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/binutils/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Bug Watch Updater]

Launchpad has imported 1 comments from the remote bug at
https://sourceware.org/bugzilla/show_bug.cgi?id=28826.

If you reply to an imported comment from within Launchpad, your comment
will be sent to the remote bug automatically. Read more about
Launchpad's inter-bugtracker facilities at
https://help.launchpad.net/InterBugTracking.


On 2022-01-27T11:12:58+00:00 Matthias Klose wrote:

seen with the 2.38 branch 20220123 and 20220126,

https://bugs.debian.org/1004269
https://bugs.launchpad.net/ubuntu/+source/binutils/+bug/1958389

The Debian report contains the more useful stack trace.  The Ubuntu
report suggests that this is only seen on Intel hardware, not AMD
hardware.

Reply at: https://bugs.launchpad.net/launchpad-
buildd/+bug/1958389/comments/12


** Changed in: binutils
   Status: Unknown => Confirmed

** Changed in: binutils
   Importance: Unknown => Medium

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/binutils/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Matthias Klose]

** Bug watch added: Sourceware.org Bugzilla #28826
   https://sourceware.org/bugzilla/show_bug.cgi?id=28826

** Also affects: binutils via
   https://sourceware.org/bugzilla/show_bug.cgi?id=28826
   Importance: Unknown
   Status: Unknown

** Bug watch added: Debian Bug tracker #1004269
   https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1004269

** Also affects: binutils (Debian) via
   https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1004269
   Importance: Unknown
   Status: Unknown

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/binutils/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Brian Murray]

** Tags added: rls-jj-incoming

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Christian Ehrhardt ]

For xen itself we know now how to "work around it" which is retry until running 
on one of the new builders. Leaving the bug open as it clearly seems to be a 
real issue.
I also leave the PPA as-is so that you can grab sources from there for 
recreating this binutils issue.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Christian Ehrhardt ]

Being a platform dependent (thereby rather severe, but easy to miss)
crash in binutils I feel it is time to bump priority of this to get it
onto the radar avoiding to ship it that way (potentially breaking more)
in our next LTS.

** Changed in: binutils (Ubuntu)
   Importance: Undecided => Critical

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Christian Ehrhardt ]

This build ran 10:26 -> 10:33 and the crash happened "in between". As i
said in local sbuild those are not fatal but on LP they are. Therefore
attaching the build log ...

** Attachment added: "build log that did not exit fatally, but triggered the 
crash we also see on LP (there fatally)"
   
https://bugs.launchpad.net/ubuntu/+source/xen/+bug/1958389/+attachment/774/+files/xen_4.16.0-1~ubuntu1~jammyppa3_amd64-2022-01-18T10%3A26%3A25Z.build

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Christian Ehrhardt ]

The build log I attached above shall help to spot the versions needed
for debug symbols to read this crash correctly.

** Attachment added: "Crash file of x86_64-linux-gnu-ld.bfd as seen in local 
sbuild"
   
https://bugs.launchpad.net/ubuntu/+source/xen/+bug/1958389/+attachment/775/+files/_usr_bin_x86_64-linux-gnu-ld.bfd.1000.crash

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Christian Ehrhardt ]

Thanks for the hint,
in case anyone needs to do the same - you can see the associated builder right 
when the build starts - then abort it immediately, refresh and rebuild.
That way you get 1 build try <1min, I got

lgw01 018
lgw01 044
lgw01 023
lcy02 001

And the build on the latter I let finish which indeed let it build
successfully.


That also means the crash I got locally is actually relevant to doko or anyone 
else looking for this from binutils POV. Therefore I'll attach mine.


** Changed in: xen (Ubuntu)
   Status: New => Invalid

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Christian Ehrhardt ]

Thanks Colin, even without debug symbols that still is probably enough
to confirm it is actually the same crash that I see on my laptop.

While I do not see why it is fatal for the build on LP but not on local
sbuild or dpkg-buildpkg in a local VM it means that most likely someone
looking into this from the binutils POV can reproduce it the way I
outlined in my report on most common intel laptops.

In use here I have:
Intel(R) Core(TM) i7-8550U CPU @ 1.80GHz

Maybe you could add what chip the failing lgw01 builders use to try
isolating the affected series?


/me is trying to retry until it ran on an lcy02 builder now ...

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Colin Watson]

It probably isn't useful, but the backtrace without extra debug symbols
looks like this:

buildd@dogfood-lgw01-amd64-001:/build/xen-jT2uET/xen-4.16.0/xen/arch/x86$ gdb 
--args x86_64-linux-gnu-ld -mi386pep --subsystem=10 
--image-base=0x82d04000 --stack=0,0 --heap=0,0 
--section-alignment=0x20 --file-alignment=0x20 --major-image-version=4 
--minor-image-version=16 --major-os-version=2 --minor-os-version=0 
--major-subsystem-version=2 --minor-subsystem-version=0 --no-insert-timestamp 
--build-id=sha1 -T efi.lds -N prelink.o  
/build/xen-jT2uET/xen-4.16.0/xen/common/symbols-dummy.o -b pe-x86-64 
efi/buildid.o -o /build/xen-jT2uET/xen-4.16.0/xen/.xen.efi.0x82d04000.0
GNU gdb (Ubuntu 11.2-0ubuntu1) 11.2
Copyright (C) 2022 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later 
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
.
Find the GDB manual and other documentation resources online at:
.

For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from x86_64-linux-gnu-ld...
(No debugging symbols found in x86_64-linux-gnu-ld)
(gdb) r
Starting program: /usr/bin/x86_64-linux-gnu-ld -mi386pep --subsystem=10 
--image-base=0x82d04000 --stack=0,0 --heap=0,0 
--section-alignment=0x20 --file-alignment=0x20 --major-image-version=4 
--minor-image-version=16 --major-os-version=2 --minor-os-version=0 
--major-subsystem-version=2 --minor-subsystem-version=0 --no-insert-timestamp 
--build-id=sha1 -T efi.lds -N prelink.o 
/build/xen-jT2uET/xen-4.16.0/xen/common/symbols-dummy.o -b pe-x86-64 
efi/buildid.o -o /build/xen-jT2uET/xen-4.16.0/xen/.xen.efi.0x82d04000.0
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".

Program received signal SIGSEGV, Segmentation fault.
0x77ca3b4a in ?? () from /lib/x86_64-linux-gnu/libc.so.6
(gdb) bt
#0  0x77ca3b4a in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x77f672d0 in ?? () from 
/lib/x86_64-linux-gnu/libbfd-2.37.50-system.20220106.so
#2  0x77f2d1e8 in ?? () from 
/lib/x86_64-linux-gnu/libbfd-2.37.50-system.20220106.so
#3  0x77f2d509 in coff_write_alien_symbol ()
   from /lib/x86_64-linux-gnu/libbfd-2.37.50-system.20220106.so
#4  0x77f2e3bd in _bfd_coff_final_link ()
   from /lib/x86_64-linux-gnu/libbfd-2.37.50-system.20220106.so
#5  0x5559d3bf in ?? ()
#6  0x77c13fd0 in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#7  0x77c1407d in __libc_start_main () from 
/lib/x86_64-linux-gnu/libc.so.6
#8  0x5559c515 in ?? ()

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Colin Watson]

I've tested manually on a staging lcy02 builder and it works fine there,
so worst case you should be able to retry until it happens to land on
lcy02.

I've reproduced the problem on a staging lgw01 builder.  I need ddebs to
get a useful backtrace, so I've filed
https://code.launchpad.net/~cjwatson/canonical-is-
firewalls/+git/firewall-configs/+merge/414372 to get access to those
from the relevant builder - I should be able to pick this up again once
that's merged.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Christian Ehrhardt ]

Hi Colin,
so far I've seen it only on lgw01, but I didn't mass-submit it yet to try the 
other builders.
Is there a better way than re-building/re-submitting to get onto the lcy02?

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Colin Watson]

Both the failures linked here were on lgw01.  Have you seen this on
lcy02 as well, or only lgw01?

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1958389] Re: Jammy builds of xen segfault, but only on launchpad x86 builders

[Christian Ehrhardt ]

FYI: I've seen some shortening of the reported crashes going on.
For example in journal it was "x86_64-linux-gn" and in the build log it was 
after "x86_64-linux-gnu-ld". The local (non fatal) crash I got eventually was 
in "x86_64-linux-gnu-ld.bfd".

This might or might not be the same crash on LP and locally, but as I
mentioned above one fails critically the other one is ignored.

Could someone run that build manually on LP and/or stop it before
cleanup to gather the crash from there for comparison?

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1958389

Title:
  Jammy builds of xen segfault, but only on launchpad x86 builders

To manage notifications about this bug go to:
https://bugs.launchpad.net/launchpad-buildd/+bug/1958389/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs