> Date: Fri, 24 Apr 2020 21:24:40 +0200
> From: Klemens Nanni <[email protected]>
>
> My primary domain paniced due to FFS/softdep while; after rebooting it
> i noticed one out of six guest domains having paniced as well.
>
> This paricular one is the only one having a PCI-E device passed through,
> namely one of the RAID controllers, see mpii0 in dmeg below.
>
> mpii0 exports four identical devices with 200G each, I am using those
> as RAID0 chunks.
>
> Complete `ldomctl console' log from DDB to reboot follow; the guest is
> running a snapshot from april, 20th.
Yes, rebooting the primary domain will reset any PCIe devices assigned
to guest domains. Nothing that can be done about this. As far as I
understand things this even happens with Solaris.
> ddb{5}> bt
> data_access_fault(40079db6360, 30, 1137b6c, 0, 0, 1) at
> data_access_fault+0x2f0
>
> sun4v_datatrap(4000cd1f780, 4000cd1f780, 4000cd1fa80, ec00, 200, 5) at
> sun4v_datatrap+0x210
> mpii_start(4000cd1ac00, 4000cd32490, 4000cd32490, 4, 0, 40079d58c40) at
> mpii_start+0x5c
> mpii_scsi_cmd(40079d58c00, 4000cde2e68, fffffffffffffff8, 0, 4000cd03800, 6)
> at mpii_scsi_cmd+0x214
> scsi_xs_exec(4000cd03800, 0, 3590, 0, 0, 3590) at scsi_xs_exec+0x30
> sdstart(0, 4000cd32490, 1, ce8f, 5d000000, 6) at sdstart+0x180
> scsi_xsh_ioh(4000cde2fb0, 4000cd32490, 3380, 2000, 400368f8000, 1001) at
> scsi_xsh_ioh+0x20
> scsi_iopool_run(4000cd1ae48, 4000cde5bd0, 40079db7068, 194f4d0, 0, 3) at
> scsi_iopool_run+0x58
> scsi_xsh_runqueue(4000cde5b00, 4000cde2f18, fffffffffffffff8, 0, 4000cd02cc0,
> 6) at scsi_xsh_runqueue+0x14c
> scsi_xsh_add(1, 4000cedb890, ce80, 0, 0, 734) at scsi_xsh_add+0x74
> sdstrategy(4000cde2e00, 4000ce62d00, 1, 0, 0, 6) at sdstrategy+0x110
> spec_strategy(0, 5, 2000, 11, ffffffffffffffff, 3b9ac800) at
> spec_strategy+0x64
>
> VOP_STRATEGY(1417180, 0, 17c3ba8, 40, 1ccb000, 194f4d0) at VOP_STRATEGY+0x4c
> sr_raid_startwu(4000ce62d00, 1, 18e73b8, ce8f, 5d000000, 0) at
> sr_raid_startwu+0x88
> sr_schedule_wu(0, 4000cedb890, 3380, 2000, 400368f8000, 1001) at
> sr_schedule_wu+0xa0
>
> ddb{5}> boot reboot
> rebooting
>
> NOTICE: Entering OpenBoot.
> NOTICE: Fetching Guest MD from HV.
> NOTICE: Starting additional cpus.
> NOTICE: Initializing LDC services.
> NOTICE: Probing PCI devices.
> NOTICE: Finished PCI probing.
>
> SPARC T4-2, No Keyboard
> Copyright (c) 1998, 2018, Oracle and/or its affiliates. All rights reserved.
> OpenBoot 4.38.16, 8.0000 GB memory available, Serial #83390594.
> Ethernet address 0:14:4f:f8:70:82, Host ID: 84f87082.
>
>
>
> Boot device: os File and args:
> OpenBSD IEEE 1275 Bootblock 2.0
> ..>> OpenBSD BOOT 1.17
>
> ERROR: /iscsi-hba: No iscsi-network-bootpath property
> Trying bsd...
> Booting /virtual-devices@100/channel-devices@200/disk@0/bsd
> 9748992@0x1000000+7680@0x194c200+196232@0x1c00000+3998072@0x1c2fe88
> symbols @ 0xfed64400 165+628248+431311 start=0x1000000
> [ using 1060752 bytes of bsd ELF symbol table ]
> console is /virtual-devices@100/console@1
> Copyright (c) 1982, 1986, 1989, 1991, 1993
> The Regents of the University of California. All rights reserved.
> Copyright (c) 1995-2020 OpenBSD. All rights reserved. https://www.OpenBSD.org
>
> OpenBSD 6.7-beta (GENERIC.MP) #289: Mon Apr 20 19:01:53 MDT 2020
> [email protected]:/usr/src/sys/arch/sparc64/compile/GENERIC.MP
> real mem = 8589934592 (8192MB)
> avail mem = 8412766208 (8023MB)
> mpath0 at root
> scsibus0 at mpath0: 256 targets
> mainbus0 at root: SPARC T4-2
> cpu0 at mainbus0: SPARC-T4 (rev 0.0) @ 2847.862 MHz
> cpu1 at mainbus0: SPARC-T4 (rev 0.0) @ 2847.862 MHz
> cpu2 at mainbus0: SPARC-T4 (rev 0.0) @ 2847.862 MHz
> cpu3 at mainbus0: SPARC-T4 (rev 0.0) @ 2847.862 MHz
> cpu4 at mainbus0: SPARC-T4 (rev 0.0) @ 2847.862 MHz
> cpu5 at mainbus0: SPARC-T4 (rev 0.0) @ 2847.862 MHz
> cpu6 at mainbus0: SPARC-T4 (rev 0.0) @ 2847.862 MHz
> cpu7 at mainbus0: SPARC-T4 (rev 0.0) @ 2847.862 MHz
> "reboot-memory" at mainbus0 not configured
> vbus0 at mainbus0
> "flashprom" at vbus0 not configured
> vrng0 at vbus0
> cbus0 at vbus0
> vdsk0 at cbus0 chan 0x2: ivec 0x4, 0x5
> scsibus1 at vdsk0: 2 targets
> sd0 at scsibus1 targ 0 lun 0: <SUN, Virtual Disk, 1.1>
> sd0: 20480MB, 512 bytes/sector, 41943040 sectors
> vdsk1 at cbus0 chan 0x3: ivec 0x6, 0x7
> scsibus2 at vdsk1: 2 targets
> sd1 at scsibus2 targ 0 lun 0: <SUN, Virtual Disk, 1.1>
> sd1: 3MB, 512 bytes/sector, 6400 sectors
> vnet0 at cbus0 chan 0x4: ivec 0x8, 0x9, address 00:14:4f:fb:1f:a3
> vnet1 at cbus0 chan 0x5: ivec 0xa, 0xb, address 00:14:4f:f9:3c:2d
> vcons0 at vbus0: ivec 0x8011, console
> vrtc0 at vbus0
> vpci0 at mainbus0: bus 0 to 255, dvma map 80000000-ffffffff
> pci0 at vpci0
> ppb0 at pci0 dev 1 function 0 "Sun SDIO PCIE" rev 0x01
> pci1 at ppb0 bus 1
> ppb1 at pci1 dev 0 function 0 "Sun SDIO PCIE" rev 0x01
> pci2 at ppb1 bus 2
> ppb2 at pci2 dev 0 function 0 "Sun SDIO PCIE" rev 0x01
> pci3 at ppb2 bus 3
> mpii0 at pci3 dev 0 function 0 "Symbios Logic SSS6200" rev 0x03
> [EOT]
>
>
