Hi, I'm experiencing the following problem with -stable, running pfsync over IPsec in an active-backup configuration. Having configured carp and tested it to be stable and working, I went and configured an IPsec tunnel between my two machines, ceti-a and ceti-b. I then brought up the pfsync interfaces on each side.
Since then, both machines have been extremely unstable - hangs and mysterious reboots. I caught the following error on the console of ceti-a about 90 seconds before a reboot: splassert: pfsync_update_state: want 64 have 48 and the following in dmesg on ceti-b: splassert: pfsync_update_state: want 64 have 48 pfsync: failed to receive bulk update aside from that, nothing in the logs or whatever. I'm running 4.7 -stable, plus the promiscuous patch I reported a few weeks ago. One of the machines also has the fix discussed at [1] for IBM x336 servers. ceti-a is an IBM x336 server, ceti-b is a VM running on VMware ESX 4.0. Config at [2], [3], [4]; dmesg at [5], [6]. Any ideas? Cheers, Patrick -- http://www.labyrinthdata.net.au - WA Backup, Web and VPS Hosting [1] http://kerneltrap.org/mailarchive/openbsd-misc/2010/3/12/6350403/thread [2] ipsec.conf (passwords changed, but the same length): # ceti-a ike passive esp from 2001:df0:49:7::1 to 2001:df0:49:7::2 psk xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx ike passive esp from 10.7.0.1 to 10.7.0.2 psk xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx -- # ceti-b ike passive esp from 2001:df0:49:7::2 to 2001:df0:49:7::1 psk xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx ike passive esp from 10.7.0.2 to 10.7.0.1 psk xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx [3] /etc/hostname.vlan7: # ceti-a inet 10.7.0.1 255.255.0.0 NONE vlan 7 vlandev em0 inet6 alias 2001:df0:49:7::1 64 -- # ceti-b inet 10.7.0.2 255.255.0.0 NONE vlan 7 vlandev em0 inet6 alias 2001:df0:49:7::2 64 [4] /etc/hostname.pfsync0 # ceti-a up syncdev vlan7 syncpeer 10.7.0.2 -- # ceti-b up syncdev vlan7 syncpeer 10.7.0.1 [5] dmesg for ceti-a (this machine has just decided to stop booting entirely, so this dmesg is a little old. I don't think this pfsync issues is related to the hardware fault here, though I'll post if that changes): OpenBSD 4.7 (GENERIC) #1: Wed Jun 16 15:19:31 WST 2010 r...@...:/usr/src/sys/arch/i386/compile/GENERIC cpu0: Intel(R) Xeon(TM) CPU 3.20GHz ("GenuineIntel" 686-class) 3.21 GHz cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,SBF,SSE3,MWAIT,DS-CPL,CNXT-ID,CX16,xTPR real mem = 2146832384 (2047MB) avail mem = 2071367680 (1975MB) mainbus0 at root bios0 at mainbus0: AT/286+ BIOS, date 07/19/05, BIOS32 rev. 0 @ 0xfd711, SMBIOS rev. 2.3 @ 0xf5faa (50 entries) bios0: vendor IBM version "-[APE128AUS-1.11]-" date 07/19/2005 bios0: IBM eserver xSeries 336 -[883725M]- acpi0 at bios0: rev 2 acpi0: tables DSDT FACP APIC MCFG acpi0: wakeup devices PCI0(S5) acpitimer0 at acpi0: 3579545 Hz, 24 bits acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat cpu0 at mainbus0: apid 0 (boot processor) cpu0: apic clock running at 200MHz cpu at mainbus0: not configured ioapic0 at mainbus0: apid 14 pa 0xfec00000, version 20, 24 pins ioapic1 at mainbus0: apid 13 pa 0xfec82000, version 20, 24 pins ioapic2 at mainbus0: apid 12 pa 0xfec82400, version 20, 24 pins acpiprt0 at acpi0: bus 4 (PCI2) acpiprt1 at acpi0: bus 5 (PCI3) acpiprt2 at acpi0: bus 1 (PCIS) acpiprt3 at acpi0: bus 0 (PCI0) acpicpu0 at acpi0 bios0: ROM list: 0xc0000/0xb000 0xcb000/0x4000 ipmi at mainbus0 not configured pci0 at mainbus0 bus 0: configuration mode 1 (bios) mem address conflict 0xff000000/0x1000 pchb0 at pci0 dev 0 function 0 "Intel E7520 Host" rev 0x0c "Intel E7520 Error Reporting" rev 0x0c at pci0 dev 0 function 1 not configured ppb0 at pci0 dev 2 function 0 "Intel E7520 PCIE" rev 0x0c pci1 at ppb0 bus 2 ppb1 at pci0 dev 4 function 0 "Intel E7520 PCIE" rev 0x0c pci2 at ppb1 bus 3 ppb2 at pci2 dev 0 function 0 "Intel PCIE-PCIE" rev 0x09 pci3 at ppb2 bus 4 mpi0 at pci3 dev 1 function 0 "Symbios Logic 53c1030" rev 0x08: apic 13 int 4 (irq 11) scsibus0 at mpi0: 16 targets, initiator 7 sd0 at scsibus0 targ 0 lun 0: <LSILOGIC, 1030 IM IM, 1000> SCSI2 0/direct fixed sd0: 139898MB, 512 bytes/sec, 286511104 sec total safte0 at scsibus0 targ 8 lun 0: <IBM, 25P3495a S320 1, 1> SCSI2 3/processor fixed mpi0: phys disk 0 Sync at 160MHz width 16bit offset 127 QAS 0 DT 1 IU 1 mpi0: phys disk 1 Sync at 160MHz width 16bit offset 80 QAS 0 DT 1 IU 1 ppb3 at pci2 dev 0 function 2 "Intel PCIE-PCIE" rev 0x09 pci4 at ppb3 bus 5 ppb4 at pci4 dev 1 function 0 "IBM 133 PCIX-PCIX" rev 0x02 pci5 at ppb4 bus 6 em0 at pci5 dev 4 function 0 "Intel PRO/1000MT QP (82546EB)" rev 0x01: apic 12 int 0 (irq 11), address 00:04:23:c9:bd:d0 em1 at pci5 dev 4 function 1 "Intel PRO/1000MT QP (82546EB)" rev 0x01: apic 12 int 1 (irq 11), address 00:04:23:c9:bd:d1 em2 at pci5 dev 6 function 0 "Intel PRO/1000MT QP (82546EB)" rev 0x01: apic 12 int 2 (irq 3), address 00:04:23:c9:bd:d2 em3 at pci5 dev 6 function 1 "Intel PRO/1000MT QP (82546EB)" rev 0x01: apic 12 int 3 (irq 3), address 00:04:23:c9:bd:d3 ppb5 at pci0 dev 6 function 0 "Intel E7520 PCIE" rev 0x0c pci6 at ppb5 bus 7 bge0 at pci6 dev 0 function 0 "Broadcom BCM5721" rev 0x11, BCM5750 B1 (0x4101): apic 14 int 16 (irq 11), address 00:14:5e:32:98:fa brgphy0 at bge0 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0 ppb6 at pci0 dev 7 function 0 "Intel E7520 PCIE" rev 0x0c pci7 at ppb6 bus 8 bge1 at pci7 dev 0 function 0 "Broadcom BCM5721" rev 0x11, BCM5750 B1 (0x4101): apic 14 int 16 (irq 11), address 00:14:5e:32:98:fb brgphy1 at bge1 phy 1: BCM5750 10/100/1000baseT PHY, rev. 0 "Intel E7520 Config" rev 0x0c at pci0 dev 8 function 0 not configured uhci0 at pci0 dev 29 function 0 "Intel 82801EB/ER USB" rev 0x02: apic 14 int 16 (irq 11) uhci1 at pci0 dev 29 function 1 "Intel 82801EB/ER USB" rev 0x02: apic 14 int 19 (irq 3) ehci0 at pci0 dev 29 function 7 "Intel 82801EB/ER USB2" rev 0x02: apic 14 int 23 (irq 3) usb0 at ehci0: USB revision 2.0 uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1 ppb7 at pci0 dev 30 function 0 "Intel 82801BA Hub-to-PCI" rev 0xc2 pci8 at ppb7 bus 1 vga1 at pci8 dev 1 function 0 "ATI Radeon VE" rev 0x00 wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) wsdisplay0: screen 1-5 added (80x25, vt100 emulation) radeondrm0 at vga1: apic 14 int 16 (irq 11) drm0 at radeondrm0 ichpcib0 at pci0 dev 31 function 0 "Intel 82801EB/ER LPC" rev 0x02 pciide0 at pci0 dev 31 function 2 "Intel 82801EB SATA" rev 0x02: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility atapiscsi0 at pciide0 channel 0 drive 0 scsibus1 at atapiscsi0: 2 targets cd0 at scsibus1 targ 0 lun 0: <HL-DT-ST, DVD-ROM GDR8083N, 0L02> ATAPI 5/cdrom removable cd0(pciide0:0:0): using PIO mode 4, Ultra-DMA mode 2 ichiic0 at pci0 dev 31 function 3 "Intel 82801EB/ER SMBus" rev 0x02: apic 14 int 17 (irq 11) iic0 at ichiic0 spdmem0 at iic0 addr 0x50: 512MB DDR2 SDRAM registered ECC PC2-3200CL5 spdmem1 at iic0 addr 0x51: 512MB DDR2 SDRAM registered ECC PC2-3200CL5 spdmem2 at iic0 addr 0x52: 512MB DDR2 SDRAM registered ECC PC2-3200CL3 spdmem3 at iic0 addr 0x53: 512MB DDR2 SDRAM registered ECC PC2-3200CL3 usb1 at uhci0: USB revision 1.0 uhub1 at usb1 "Intel UHCI root hub" rev 1.00/1.00 addr 1 usb2 at uhci1: USB revision 1.0 uhub2 at usb2 "Intel UHCI root hub" rev 1.00/1.00 addr 1 isa0 at ichpcib0 isadma0 at isa0 com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo pckbc0 at isa0 port 0x60/5 pcppi0 at isa0 port 0x61 midi0 at pcppi0: <PC speaker> spkr0 at pcppi0 npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16 mtrr: Pentium Pro MTRR support uhidev0 at uhub2 port 2 configuration 1 interface 0 "Manufacturer KA7175 Adapter" rev 2.00/1.00 addr 2 uhidev0: iclass 3/1 ukbd0 at uhidev0: 8 modifier keys, 6 key codes, country code 33 wskbd0 at ukbd0: console keyboard, using wsdisplay0 uhidev1 at uhub2 port 2 configuration 1 interface 1 "Manufacturer KA7175 Adapter" rev 2.00/1.00 addr 2 uhidev1: iclass 3/1 ums0 at uhidev1: 5 buttons, Z dir wsmouse0 at ums0 mux 0 vscsi0 at root scsibus2 at vscsi0: 256 targets softraid0 at root root on sd0a swap on sd0b dump on sd0b [6] dmesg for ceti-b (taken from /var/log/messages); Jul 22 19:44:03 ceti-b /bsd: OpenBSD 4.7-stable (GENERIC) #0: Fri Jul 16 18:10:44 WST 2010 Jul 22 19:44:03 ceti-b /bsd: [email protected]:/usr/src/sys/arch/i386/compile/GENERIC Jul 22 19:44:03 ceti-b /bsd: cpu0: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz ("GenuineIntel" 686-class) 2.50 GHz Jul 22 19:44:03 ceti-b /bsd: cpu0: FPU,V86,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,SSE3,CX16 Jul 22 19:44:03 ceti-b /bsd: real mem = 1073246208 (1023MB) Jul 22 19:44:03 ceti-b /bsd: avail mem = 1031172096 (983MB) Jul 22 19:44:03 ceti-b /bsd: mainbus0 at root Jul 22 19:44:03 ceti-b /bsd: bios0 at mainbus0: AT/286+ BIOS, date 09/22/09, BIOS32 rev. 0 @ 0xfd780, SMBIOS rev. 2.4 @ 0xe0010 (98 entries) Jul 22 19:44:03 ceti-b /bsd: bios0: vendor Phoenix Technologies LTD version "6.00" date 09/22/2009 Jul 22 19:44:03 ceti-b /bsd: bios0: VMware, Inc. VMware Virtual Platform Jul 22 19:44:03 ceti-b /bsd: acpi0 at bios0: rev 2 Jul 22 19:44:03 ceti-b /bsd: acpi0: tables DSDT FACP BOOT APIC MCFG SRAT Jul 22 19:44:03 ceti-b /bsd: acpi0: wakeup devices PCI0(S3) USB_(S1) P2P0(S3) S1F0(S3) S2F0(S3) S3F0(S3) S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) S9F0(S3) Z00P(S3) Z00Q(S3) Z00R(S3) Z00S(S3) Z00T(S3) Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) Z00Z(S3) Z010(S3) Z011(S3) Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) Z017(S3) Z018(S3) Z019(S3) Z01A(S3) Z01B(S3) P2P1(S3) S1F0(S3) S2F0(S3) S3F0(S3) S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) S9F0(S3) Z00P(S3) Z00Q(S3) Z00R(S3) Z00S(S3) Z00T(S3) Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) Z00Z(S3) Z010(S3) Z011(S3) Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) Z017(S3) Z018(S3) Z019(S3) Z01A(S3) Z01B(S3) P2P2(S3) S1F0(S3) S2F0(S3) S3F0(S3) S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) S9F0(S3) Z00P(S3) Z00Q(S3) Z00R(S3) Z00S(S3) Z00T(S3) Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) Z00Z(S3) Z010(S3) Z011(S3) Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) Z017(S3) Z018(S3) Z019(S3) Z01A(S3) Z01B(S3) P2P3(S3) S1F0(S3) S2F0(S3) S3F0(S3) S4F0(S3) S5F0(S3) S6F0(S3) S7F0(S3) S8F0(S3) S9F Jul 22 19:44:03 ceti-b /bsd: (S3) Z00P(S3) Z00Q(S3) Z00R(S3) Z00S(S3) Z00T(S3) Z00U(S3) Z00V(S3) Z00W(S3) Z00X(S3) Z00Y(S3) Z00Z(S3) Z010(S3) Z011(S3) Z012(S3) Z013(S3) Z014(S3) Z015(S3) Z016(S3) Z017(S3) Z018(S3) Z019(S3) Z01A(S3) Z01B(S3) PE40(S3) S1F0(S3) PE50(S3) S1F0(S3) PE60(S3) S1F0(S3) PE70(S3) S1F0(S3) PE80(S3) S1F0(S3) PE90(S3) S1F0(S3) PEA0(S3) S1F0(S3) PEB0(S3) S1F0(S3) PEC0(S3) S1F0(S3) PED0(S3) S1F0(S3) PEE0(S3) S1F0(S3) PE41(S3) S1F0(S3) PE42(S3) S1F0(S3) PE43(S3) S1F0(S3) PE44(S3) S1F0(S3) PE45(S3) S1F0(S3) PE46(S3) S1F0(S3) PE47(S3) S1F0(S3) PE51(S3) S1F0(S3) PE52(S3) S1F0(S3) PE53(S3) S1F0(S3) PE54(S3) S1F0(S3) PE55(S3) S1F0(S3) PE56(S3) S1F0(S3) PE57(S3) S1F0(S3) PE61(S3) S1F0(S3) PE62(S3) S1F0(S3) PE63(S3) S1F0(S3) PE64(S3) S1F0(S3) PE65(S3) S1F0(S3) PE66(S3) S1F0(S3) PE67(S3) S1F0(S3) PE71(S3) S1F0(S3) PE72(S3) S1F0(S3) PE73(S3) S1F0(S3) PE74(S3) S1F0(S3) PE75(S3) S1F0(S3) PE76(S3) S1F0(S3) PE77(S3) S1F0(S3) PE81(S3) S1F0(S3) PE82(S3) S1F0(S3) PE83(S3) S1F0(S3) PE84(S3) S1F0(S3) PE85(S3) S1F0(S3) PE86(S3) S1 Jul 22 19:44:03 ceti-b /bsd: 0(S3) PE87(S3) S1F0(S3) PE91(S3) S1F0(S3) PE92(S3) S1F0(S3) PE93(S3) S1F0(S3) PE94(S3) S1F0(S3) PE95(S3) S1F0(S3) PE96(S3) S1F0(S3) PE97(S3) S1F0(S3) PEA1(S3) S1F0(S3) PEA2(S3) S1F0(S3) PEA3(S3) S1F0(S3) PEA4(S3) S1F0(S3) PEA5(S3) S1F0(S3) PEA6(S3) S1F0(S3) PEA7(S3) S1F0(S3) PEB1(S3) S1F0(S3) PEB2(S3) S1F0(S3) PEB3(S3) S1F0(S3) PEB4(S3) S1F0(S3) PEB5(S3) S1F0(S3) PEB6(S3) S1F0(S3) PEB7(S3) S1F0(S3) SLPB(S4) Jul 22 19:44:03 ceti-b /bsd: acpitimer0 at acpi0: 3579545 Hz, 24 bits Jul 22 19:44:03 ceti-b /bsd: acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat Jul 22 19:44:03 ceti-b /bsd: cpu0 at mainbus0: apid 0 (boot processor) Jul 22 19:44:03 ceti-b /bsd: cpu0: apic clock running at 65MHz Jul 22 19:44:03 ceti-b /bsd: ioapic0 at mainbus0: apid 1 pa 0xfec00000, version 11, 24 pins Jul 22 19:44:03 ceti-b /bsd: acpiprt0 at acpi0: bus 0 (PCI0) Jul 22 19:44:03 ceti-b /bsd: acpicpu0 at acpi0 Jul 22 19:44:03 ceti-b /bsd: acpibat0 at acpi0: BAT1 not present Jul 22 19:44:03 ceti-b /bsd: acpibat1 at acpi0: BAT2 not present Jul 22 19:44:03 ceti-b /bsd: acpiac0 at acpi0: AC unit online Jul 22 19:44:03 ceti-b /bsd: acpibtn0 at acpi0: SLPB Jul 22 19:44:03 ceti-b /bsd: bios0: ROM list: 0xc0000/0x8000 0xc8000/0x1e00! 0xca000/0x1000 0xdc000/0x4000! 0xe0000/0x4000! Jul 22 19:44:03 ceti-b /bsd: pci0 at mainbus0 bus 0: configuration mode 1 (bios) Jul 22 19:44:03 ceti-b /bsd: pchb0 at pci0 dev 0 function 0 "Intel 82443BX AGP" rev 0x01 Jul 22 19:44:03 ceti-b /bsd: ppb0 at pci0 dev 1 function 0 "Intel 82443BX AGP" rev 0x01 Jul 22 19:44:03 ceti-b /bsd: pci1 at ppb0 bus 1 Jul 22 19:44:03 ceti-b /bsd: piixpcib0 at pci0 dev 7 function 0 "Intel 82371AB PIIX4 ISA" rev 0x08 Jul 22 19:44:03 ceti-b /bsd: pciide0 at pci0 dev 7 function 1 "Intel 82371AB IDE" rev 0x01: DMA, channel 0 configured to compatibility, channel 1 configured to compatibility Jul 22 19:44:03 ceti-b /bsd: pciide0: channel 0 ignored (disabled) Jul 22 19:44:03 ceti-b /bsd: atapiscsi0 at pciide0 channel 1 drive 0 Jul 22 19:44:03 ceti-b /bsd: scsibus0 at atapiscsi0: 2 targets Jul 22 19:44:03 ceti-b /bsd: cd0 at scsibus0 targ 0 lun 0: <NECVMWar, VMware IDE CDR10, 1.00> ATAPI 5/cdrom removable Jul 22 19:44:03 ceti-b /bsd: cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2 Jul 22 19:44:03 ceti-b /bsd: piixpm0 at pci0 dev 7 function 3 "Intel 82371AB Power" rev 0x08: SMBus disabled Jul 22 19:44:03 ceti-b /bsd: "VMware Virtual Machine Communication Interface" rev 0x10 at pci0 dev 7 function 7 not configured Jul 22 19:44:03 ceti-b /bsd: vga1 at pci0 dev 15 function 0 "VMware Virtual SVGA II" rev 0x00 Jul 22 19:44:03 ceti-b /bsd: wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation) Jul 22 19:44:03 ceti-b /bsd: wsdisplay0: screen 1-5 added (80x25, vt100 emulation) Jul 22 19:44:03 ceti-b /bsd: mpi0 at pci0 dev 16 function 0 "Symbios Logic 53c1030" rev 0x01: apic 1 int 17 (irq 11) Jul 22 19:44:03 ceti-b /bsd: scsibus1 at mpi0: 16 targets, initiator 7 Jul 22 19:44:03 ceti-b /bsd: sd0 at scsibus1 targ 0 lun 0: <VMware, Virtual disk, 1.0> SCSI2 0/direct fixed Jul 22 19:44:03 ceti-b /bsd: sd0: 30720MB, 512 bytes/sec, 62914560 sec total Jul 22 19:44:03 ceti-b /bsd: mpi0: target 0 Sync at 160MHz width 16bit offset 127 QAS 1 DT 1 IU 1 Jul 22 19:44:03 ceti-b /bsd: ppb1 at pci0 dev 17 function 0 "VMware Virtual PCI-PCI" rev 0x02 Jul 22 19:44:03 ceti-b /bsd: pci2 at ppb1 bus 2 Jul 22 19:44:03 ceti-b /bsd: em0 at pci2 dev 0 function 0 "Intel PRO/1000MT (82545EM)" rev 0x01: apic 1 int 18 (irq 10), address 00:50:56:96:3b:f3 Jul 22 19:44:03 ceti-b /bsd: ppb2 at pci0 dev 21 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:03 ceti-b /bsd: pci3 at ppb2 bus 3 Jul 22 19:44:03 ceti-b /bsd: ppb3 at pci0 dev 21 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:03 ceti-b /bsd: pci4 at ppb3 bus 4 Jul 22 19:44:03 ceti-b /bsd: ppb4 at pci0 dev 21 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:03 ceti-b /bsd: pci5 at ppb4 bus 5 Jul 22 19:44:03 ceti-b /bsd: ppb5 at pci0 dev 21 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:03 ceti-b /bsd: pci6 at ppb5 bus 6 Jul 22 19:44:04 ceti-b /bsd: ppb6 at pci0 dev 21 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci7 at ppb6 bus 7 Jul 22 19:44:04 ceti-b /bsd: ppb7 at pci0 dev 21 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci8 at ppb7 bus 8 Jul 22 19:44:04 ceti-b /bsd: ppb8 at pci0 dev 21 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci9 at ppb8 bus 9 Jul 22 19:44:04 ceti-b /bsd: ppb9 at pci0 dev 21 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci10 at ppb9 bus 10 Jul 22 19:44:04 ceti-b /bsd: ppb10 at pci0 dev 22 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci11 at ppb10 bus 11 Jul 22 19:44:04 ceti-b /bsd: ppb11 at pci0 dev 22 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci12 at ppb11 bus 12 Jul 22 19:44:04 ceti-b /bsd: ppb12 at pci0 dev 22 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci13 at ppb12 bus 13 Jul 22 19:44:04 ceti-b /bsd: ppb13 at pci0 dev 22 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci14 at ppb13 bus 14 Jul 22 19:44:04 ceti-b /bsd: ppb14 at pci0 dev 22 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci15 at ppb14 bus 15 Jul 22 19:44:04 ceti-b /bsd: ppb15 at pci0 dev 22 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci16 at ppb15 bus 16 Jul 22 19:44:04 ceti-b /bsd: ppb16 at pci0 dev 22 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci17 at ppb16 bus 17 Jul 22 19:44:04 ceti-b /bsd: ppb17 at pci0 dev 22 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci18 at ppb17 bus 18 Jul 22 19:44:04 ceti-b /bsd: ppb18 at pci0 dev 23 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci19 at ppb18 bus 19 Jul 22 19:44:04 ceti-b /bsd: ppb19 at pci0 dev 23 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci20 at ppb19 bus 20 Jul 22 19:44:04 ceti-b /bsd: ppb20 at pci0 dev 23 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci21 at ppb20 bus 21 Jul 22 19:44:04 ceti-b /bsd: ppb21 at pci0 dev 23 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci22 at ppb21 bus 22 Jul 22 19:44:04 ceti-b /bsd: ppb22 at pci0 dev 23 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci23 at ppb22 bus 23 Jul 22 19:44:04 ceti-b /bsd: ppb23 at pci0 dev 23 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci24 at ppb23 bus 24 Jul 22 19:44:04 ceti-b /bsd: ppb24 at pci0 dev 23 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci25 at ppb24 bus 25 Jul 22 19:44:04 ceti-b /bsd: ppb25 at pci0 dev 23 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci26 at ppb25 bus 26 Jul 22 19:44:04 ceti-b /bsd: ppb26 at pci0 dev 24 function 0 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci27 at ppb26 bus 27 Jul 22 19:44:04 ceti-b /bsd: ppb27 at pci0 dev 24 function 1 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci28 at ppb27 bus 28 Jul 22 19:44:04 ceti-b /bsd: ppb28 at pci0 dev 24 function 2 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci29 at ppb28 bus 29 Jul 22 19:44:04 ceti-b /bsd: ppb29 at pci0 dev 24 function 3 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci30 at ppb29 bus 30 Jul 22 19:44:04 ceti-b /bsd: ppb30 at pci0 dev 24 function 4 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci31 at ppb30 bus 31 Jul 22 19:44:04 ceti-b /bsd: ppb31 at pci0 dev 24 function 5 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci32 at ppb31 bus 32 Jul 22 19:44:04 ceti-b /bsd: ppb32 at pci0 dev 24 function 6 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci33 at ppb32 bus 33 Jul 22 19:44:04 ceti-b /bsd: ppb33 at pci0 dev 24 function 7 "VMware Virtual PCIE-PCIE" rev 0x01 Jul 22 19:44:04 ceti-b /bsd: pci34 at ppb33 bus 34 Jul 22 19:44:04 ceti-b /bsd: isa0 at piixpcib0 Jul 22 19:44:04 ceti-b /bsd: isadma0 at isa0 Jul 22 19:44:04 ceti-b /bsd: com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo Jul 22 19:44:04 ceti-b /bsd: com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo Jul 22 19:44:04 ceti-b /bsd: pckbc0 at isa0 port 0x60/5 Jul 22 19:44:04 ceti-b /bsd: pckbd0 at pckbc0 (kbd slot) Jul 22 19:44:04 ceti-b /bsd: pckbc0: using irq 1 for kbd slot Jul 22 19:44:04 ceti-b /bsd: wskbd0 at pckbd0: console keyboard, using wsdisplay0 Jul 22 19:44:04 ceti-b /bsd: pmsi0 at pckbc0 (aux slot) Jul 22 19:44:04 ceti-b /bsd: pckbc0: using irq 12 for aux slot Jul 22 19:44:04 ceti-b /bsd: wsmouse0 at pmsi0 mux 0 Jul 22 19:44:04 ceti-b /bsd: pcppi0 at isa0 port 0x61 Jul 22 19:44:04 ceti-b /bsd: midi0 at pcppi0: <PC speaker> Jul 22 19:44:04 ceti-b /bsd: spkr0 at pcppi0 Jul 22 19:44:04 ceti-b /bsd: lpt0 at isa0 port 0x378/4 irq 7 Jul 22 19:44:04 ceti-b /bsd: npx0 at isa0 port 0xf0/16: reported by CPUID; using exception 16 Jul 22 19:44:04 ceti-b /bsd: fdc0 at isa0 port 0x3f0/6 irq 6 drq 2 Jul 22 19:44:04 ceti-b /bsd: fd0 at fdc0 drive 0: 1.44MB 80 cyl, 2 head, 18 sec Jul 22 19:44:04 ceti-b /bsd: mtrr: Pentium Pro MTRR support Jul 22 19:44:04 ceti-b /bsd: vscsi0 at root Jul 22 19:44:04 ceti-b /bsd: scsibus2 at vscsi0: 256 targets Jul 22 19:44:04 ceti-b /bsd: softraid0 at root Jul 22 19:44:04 ceti-b /bsd: root on sd0a swap on sd0b dump on sd0b Jul 22 19:44:04 ceti-b /bsd: carp1: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp10: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp15: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp2: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp20: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp3: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp32: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp4: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp40: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp41: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp42: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp500: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp505: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp506: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp507: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp508: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp509: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp510: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp512: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp513: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp514: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp515: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp516: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp517: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp518: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp519: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp520: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp521: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp522: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp523: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp524: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp525: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp526: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp61: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp80: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b /bsd: carp85: state transition: BACKUP -> MASTER Jul 22 19:44:04 ceti-b savecore: no core dump
