On Tue, Jan 12, 2021 at 05:56:28PM +0100, Florian Obser wrote:
> On Tue, Jan 12, 2021 at 09:52:03AM -0700, Bob Beck wrote:
> > 
> > 
> > 
> > On Tue, Jan 12, 2021 at 05:47:36PM +0100, Florian Obser wrote:
> > > On Tue, Jan 12, 2021 at 09:40:51AM -0700, Bob Beck wrote:
> > > > 
> > > > On Tue, Jan 12, 2021 at 04:45:32PM +0100, Solene Rapenne wrote:
> > > > > Hello,
> > > > > 
> > > > > it seems www.openbsd.org is down since 14h46 UTC
> > > > > If I remember correctly you are the right person to tell about it.
> > > > > 
> > > > > Regards
> > > > > Sol??ne
> > > > 
> > > > Yes, It appears that httpd ran low on file descriptors, and decided to 
> > > > fix
> > > > that by exiting rather than murdering connections or refusing to 
> > > > service more. 
> > > > I'd probably say that's not optimal behaviour for httpd. (even closing 
> > > > all active
> > > > connections and restarting is preferable to just exiting).
> > > > 
> > > > ...
> > > > Jan 12 07:35:01 r230-1 httpd[57093]: ftp.openbsd.org 64.62.252.163 - - 
> > > > [12/Jan/2021:07:35:01 -0700] "GET 
> > > > /pub/OpenBSD/snapshots/packages/mips64/vlorb-1.2p0.tgz HTTP/1.1" 200 
> > > > 13103 "" "The Knowledge AI"
> > > > Jan 12 07:35:01 r230-1 httpd[57093]: ftp.openbsd.org 64.62.252.163 - - 
> > > > [12/Jan/2021:07:35:01 -0700] "GET 
> > > > /pub/OpenBSD/snapshots/packages/mips64/vmdktool-1.4.tgz HTTP/1.1" 200 
> > > > 15583 "" "The Knowledge AI"
> > > 
> > > What happened between 07:35:01 and 07:36:19?
> > 
> > Aha. well spotted..
> > 
> > This:
> > 
> > # Tuesday 7:35 AM reboot
> > 35      7       *       *       2       /sbin/reboot
> > 
> > which I have had to resort to since moving to 6.8 because of the previously
> > reported issues with the kernel.
> > 
> > So that failure was on startup.. interesting. 
> 
> Not really :(
> It's that stupid thing where it creates O(n^2) amount of FDs to pass
> between the children to create a full mesh.

But shouldn't that fail *consistently* then on startup given that I have
a fixed limit of 512 descriptors? 

Are we actually *taking* traffic before this is set up, causing us
to hit our fd limit on startup and hitting this failure case with a
combination of the n2 amount of fd's and the traffic hitting the
daemon? should we delay servicing responses until the mesh is setup?



> 
> > 
> > 
> > > 
> > > > Jan 12 07:36:19 r230-1 httpd[62909]: startup
> > > > Jan 12 07:36:19 r230-1 httpd[62909]: parent: proc_open: imsg_flush: Too 
> > > > many open files
> > > > Jan 12 07:36:19 r230-1 httpd[74776]: logger exiting, pid 74776
> > > > Jan 12 07:36:19 r230-1 httpd[42878]: server exiting, pid 42878
> > > > Jan 12 07:36:19 r230-1 httpd[88100]: server exiting, pid 88100
> > > > Jan 12 07:36:19 r230-1 httpd[57583]: server exiting, pid 57583
> > > > Jan 12 07:36:19 r230-1 httpd[15586]: server exiting, pid 15586
> > > > Jan 12 07:36:19 r230-1 httpd[6347]: server exiting, pid 6347
> > > > Jan 12 07:36:19 r230-1 httpd[68058]: server exiting, pid 68058
> > > > Jan 12 07:36:19 r230-1 httpd[36742]: server exiting, pid 36742
> > > > Jan 12 07:36:19 r230-1 httpd[69672]: server exiting, pid 69672
> > > > Jan 12 07:36:19 r230-1 httpd[50046]: server exiting, pid 50046
> > > > Jan 12 07:36:19 r230-1 httpd[42968]: server exiting, pid 42968
> > > > Jan 12 07:36:19 r230-1 httpd[40009]: server exiting, pid 40009
> > > > Jan 12 07:36:19 r230-1 httpd[34475]: server exiting, pid 34475
> > > > Jan 12 07:36:19 r230-1 httpd[56151]: server exiting, pid 56151
> > > > Jan 12 07:36:19 r230-1 httpd[42252]: server exiting, pid 42252
> > > > Jan 12 07:36:19 r230-1 httpd[49837]: server exiting, pid 49837
> > > > Jan 12 07:36:19 r230-1 httpd[70693]: server exiting, pid 70693
> > > > Jan 12 07:36:19 r230-1 httpd[37597]: server exiting, pid 37597
> > > > Jan 12 07:36:19 r230-1 httpd[78437]: server exiting, pid 78437
> > > > Jan 12 07:36:19 r230-1 httpd[39941]: server exiting, pid 39941
> > > > Jan 12 07:36:19 r230-1 httpd[64622]: server exiting, pid 64622
> > > > r230-1# 
> > > > 
> > > > r230-1# dmesg
> > > > OpenBSD 6.8 (GENERIC.MP) #84: Sat Sep 26 20:32:53 MDT 2020
> > > >     [email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
> > > > real mem = 17119961088 (16326MB)
> > > > avail mem = 16586063872 (15817MB)
> > > > random: good seed from bootblocks
> > > > mpath0 at root
> > > > scsibus0 at mpath0: 256 targets
> > > > mainbus0 at root
> > > > bios0 at mainbus0: SMBIOS rev. 2.8 @ 0x8ef68000 (43 entries)
> > > > bios0: vendor Dell Inc. version "1.4.5" date 08/09/2016
> > > > bios0: Dell Inc. PowerEdge R230
> > > > acpi0 at bios0: ACPI 5.0
> > > > acpi0: sleep states S0 S5
> > > > acpi0: tables DSDT FACP BOOT SSDT SLIC HPET LPIT APIC MCFG WDAT SSDT 
> > > > DBGP DBG2 SSDT SSDT SSDT SSDT DMAR SSDT SSDT PRAD HEST BERT ERST EINJ 
> > > > FPDT SPCR
> > > > acpi0: wakeup devices PEG0(S0) PEGP(S0) PEG1(S0) PEGP(S0) PEG2(S0) 
> > > > PEGP(S0) XHC_(S0) XDCI(S0) RP01(S0) PXSX(S0) RP02(S0) PXSX(S0) RP03(S0) 
> > > > PXSX(S0) RP04(S0) PXSX(S0) [...]
> > > > acpitimer0 at acpi0: 3579545 Hz, 24 bits
> > > > acpihpet0 at acpi0: 23999999 Hz
> > > > acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
> > > > cpu0 at mainbus0: apid 0 (boot processor)
> > > > cpu0: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3692.80 MHz, 06-5e-03
> > > > cpu0: 
> > > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > > > cpu0: 256KB 64b/line 8-way L2 cache
> > > > cpu0: smt 0, core 0, package 0
> > > > mtrr: Pentium Pro MTRR support, 10 var ranges, 88 fixed ranges
> > > > cpu0: apic clock running at 24MHz
> > > > cpu0: mwait min=64, max=64, C-substates=0.2.1.2.4.1, IBE
> > > > cpu1 at mainbus0: apid 2 (application processor)
> > > > cpu1: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.41 MHz, 06-5e-03
> > > > cpu1: 
> > > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > > > cpu1: 256KB 64b/line 8-way L2 cache
> > > > cpu1: smt 0, core 1, package 0
> > > > cpu2 at mainbus0: apid 4 (application processor)
> > > > cpu2: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.41 MHz, 06-5e-03
> > > > cpu2: 
> > > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > > > cpu2: 256KB 64b/line 8-way L2 cache
> > > > cpu2: smt 0, core 2, package 0
> > > > cpu3 at mainbus0: apid 6 (application processor)
> > > > cpu3: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.41 MHz, 06-5e-03
> > > > cpu3: 
> > > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > > > cpu3: 256KB 64b/line 8-way L2 cache
> > > > cpu3: smt 0, core 3, package 0
> > > > cpu4 at mainbus0: apid 1 (application processor)
> > > > cpu4: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.40 MHz, 06-5e-03
> > > > cpu4: 
> > > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > > > cpu4: 256KB 64b/line 8-way L2 cache
> > > > cpu4: smt 1, core 0, package 0
> > > > cpu5 at mainbus0: apid 3 (application processor)
> > > > cpu5: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.40 MHz, 06-5e-03
> > > > cpu5: 
> > > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > > > cpu5: 256KB 64b/line 8-way L2 cache
> > > > cpu5: smt 1, core 1, package 0
> > > > cpu6 at mainbus0: apid 5 (application processor)
> > > > cpu6: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.40 MHz, 06-5e-03
> > > > cpu6: 
> > > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > > > cpu6: 256KB 64b/line 8-way L2 cache
> > > > cpu6: smt 1, core 2, package 0
> > > > cpu7 at mainbus0: apid 7 (application processor)
> > > > cpu7: Intel(R) Xeon(R) CPU E3-1240 v5 @ 3.50GHz, 3691.40 MHz, 06-5e-03
> > > > cpu7: 
> > > > FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,DS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE,SSE3,PCLMUL,DTES64,MWAIT,DS-CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,DEADLINE,AES,XSAVE,AVX,F16C,RDRAND,NXE,PAGE1GB,RDTSCP,LONG,LAHF,ABM,3DNOWP,PERF,ITSC,FSGSBASE,TSC_ADJUST,SGX,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PT,MD_CLEAR,TSXFA,IBRS,IBPB,STIBP,L1DF,SSBD,SENSOR,ARAT,XSAVEOPT,XSAVEC,XGETBV1,XSAVES,MELTDOWN
> > > > cpu7: 256KB 64b/line 8-way L2 cache
> > > > cpu7: smt 1, core 3, package 0
> > > > ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 20, 24 pins
> > > > acpimcfg0 at acpi0
> > > > acpimcfg0: addr 0xe0000000, bus 0-255
> > > > acpiprt0 at acpi0: bus 0 (PCI0)
> > > > acpiprt0: no apic found for irq 32
> > > > acpiprt0: no apic found for irq 33
> > > > acpiprt0: no apic found for irq 34
> > > > acpiprt1 at acpi0: bus 1 (PEG0)
> > > > acpiprt2 at acpi0: bus 2 (PEG1)
> > > > acpiprt3 at acpi0: bus -1 (PEG2)
> > > > acpiprt4 at acpi0: bus -1 (RP01)
> > > > acpiprt5 at acpi0: bus -1 (RP02)
> > > > acpiprt6 at acpi0: bus -1 (RP03)
> > > > acpiprt7 at acpi0: bus -1 (RP04)
> > > > acpiprt8 at acpi0: bus -1 (RP05)
> > > > acpiprt9 at acpi0: bus -1 (RP06)
> > > > acpiprt10 at acpi0: bus -1 (RP07)
> > > > acpiprt11 at acpi0: bus -1 (RP08)
> > > > acpiprt12 at acpi0: bus 3 (RP09)
> > > > acpiprt13 at acpi0: bus -1 (RP10)
> > > > acpiprt14 at acpi0: bus 4 (RP11)
> > > > acpiprt15 at acpi0: bus -1 (RP12)
> > > > acpiprt16 at acpi0: bus -1 (RP13)
> > > > acpiprt17 at acpi0: bus -1 (RP14)
> > > > acpiprt18 at acpi0: bus -1 (RP15)
> > > > acpiprt19 at acpi0: bus -1 (RP16)
> > > > acpiprt20 at acpi0: bus -1 (RP17)
> > > > acpiprt21 at acpi0: bus -1 (RP18)
> > > > acpiprt22 at acpi0: bus -1 (RP19)
> > > > acpiprt23 at acpi0: bus -1 (RP20)
> > > > acpipci0 at acpi0 PCI0: 0x00000000 0x00000011 0x00000001
> > > > acpicmos0 at acpi0
> > > > acpibtn0 at acpi0: SLPB
> > > > "PNP0C14" at acpi0 not configured
> > > > "PNP0C33" at acpi0 not configured
> > > > acpicpu0 at acpi0: C1(@1 halt!)
> > > > acpicpu1 at acpi0: C1(@1 halt!)
> > > > acpicpu2 at acpi0: C1(@1 halt!)
> > > > acpicpu3 at acpi0: C1(@1 halt!)
> > > > acpicpu4 at acpi0: C1(@1 halt!)
> > > > acpicpu5 at acpi0: C1(@1 halt!)
> > > > acpicpu6 at acpi0: C1(@1 halt!)
> > > > acpicpu7 at acpi0: C1(@1 halt!)
> > > > acpivideo0 at acpi0: GFX0
> > > > acpivout0 at acpivideo0: DD1F
> > > > ipmi at mainbus0 not configured
> > > > cpu0: using VERW MDS workaround (except on vmm entry)
> > > > pci0 at mainbus0 bus 0
> > > > pchb0 at pci0 dev 0 function 0 "Intel Xeon E3-1200 v5 Host" rev 0x07
> > > > ppb0 at pci0 dev 1 function 0 "Intel Core 6G PCIE" rev 0x07: msi
> > > > pci1 at ppb0 bus 1
> > > > ppb1 at pci0 dev 1 function 1 "Intel Core 6G PCIE" rev 0x07: msi
> > > > pci2 at ppb1 bus 2
> > > > xhci0 at pci0 dev 20 function 0 "Intel 100 Series xHCI" rev 0x31: msi, 
> > > > xHCI 1.0
> > > > usb0 at xhci0: USB revision 3.0
> > > > uhub0 at usb0 configuration 1 interface 0 "Intel xHCI root hub" rev 
> > > > 3.00/1.00 addr 1
> > > > pchtemp0 at pci0 dev 20 function 2 "Intel 100 Series Thermal" rev 0x31
> > > > "Intel 100 Series MEI" rev 0x31 at pci0 dev 22 function 0 not configured
> > > > "Intel 100 Series MEI" rev 0x31 at pci0 dev 22 function 1 not configured
> > > > ahci0 at pci0 dev 23 function 0 "Intel 100 Series AHCI" rev 0x31: msi, 
> > > > AHCI 1.3.1
> > > > ahci0: port 4: 6.0Gb/s
> > > > scsibus1 at ahci0: 32 targets
> > > > sd0 at scsibus1 targ 4 lun 0: <ATA, Samsung SSD 860, RVQ0> 
> > > > naa.5002538e4964a3d0
> > > > sd0: 3815447MB, 512 bytes/sector, 7814037168 sectors, thin
> > > > ppb2 at pci0 dev 29 function 0 "Intel 100 Series PCIE" rev 0xf1: msi
> > > > pci3 at ppb2 bus 3
> > > > 3:0:0: rom address conflict 0xfffc0000/0x40000
> > > > 3:0:1: rom address conflict 0xfffc0000/0x40000
> > > > bge0 at pci3 dev 0 function 0 "Broadcom BCM5720" rev 0x00, BCM5720 A0 
> > > > (0x5720000), APE firmware NCSI 1.3.16.0: msi, address 10:98:36:ae:4d:c9
> > > > brgphy0 at bge0 phy 1: BCM5720C 10/100/1000baseT PHY, rev. 0
> > > > bge1 at pci3 dev 0 function 1 "Broadcom BCM5720" rev 0x00, BCM5720 A0 
> > > > (0x5720000), APE firmware NCSI 1.3.16.0: msi, address 10:98:36:ae:4d:ca
> > > > brgphy1 at bge1 phy 2: BCM5720C 10/100/1000baseT PHY, rev. 0
> > > > ppb3 at pci0 dev 29 function 2 "Intel 100 Series PCIE" rev 0xf1: msi
> > > > pci4 at ppb3 bus 4
> > > > ppb4 at pci4 dev 0 function 0 "Renesas SH7758 PCIE Switch" rev 0x00
> > > > pci5 at ppb4 bus 5
> > > > ppb5 at pci5 dev 0 function 0 "Renesas SH7758 PCIE Switch" rev 0x00
> > > > pci6 at ppb5 bus 6
> > > > ppb6 at pci6 dev 0 function 0 "Renesas SH7758 PCIE-PCI" rev 0x00
> > > > pci7 at ppb6 bus 7
> > > > vga1 at pci7 dev 0 function 0 "Matrox MGA G200eR" rev 0x01
> > > > wsdisplay at vga1 not configured
> > > > pcib0 at pci0 dev 31 function 0 "Intel C236 LPC" rev 0x31
> > > > "Intel 100 Series PMC" rev 0x31 at pci0 dev 31 function 2 not configured
> > > > ichiic0 at pci0 dev 31 function 4 "Intel 100 Series SMBus" rev 0x31: 
> > > > apic 2 int 16
> > > > iic0 at ichiic0
> > > > sdtemp0 at iic0 addr 0x19: tse2004gb2
> > > > spdmem0 at iic0 addr 0x51: 16GB DDR4 SDRAM ECC PC4-17000 with thermal 
> > > > sensor
> > > > isa0 at pcib0
> > > > isadma0 at isa0
> > > > com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
> > > > com0: console
> > > > com1 at isa0 port 0x2f8/8 irq 3: ns16550a, 16 byte fifo
> > > > pcppi0 at isa0 port 0x61
> > > > spkr0 at pcppi0
> > > > vmm0 at mainbus0: VMX/EPT
> > > > uhub1 at uhub0 port 3 configuration 1 interface 0 "no manufacturer 
> > > > Gadget USB HUB" rev 2.00/0.00 addr 2
> > > > vscsi0 at root
> > > > scsibus2 at vscsi0: 256 targets
> > > > softraid0 at root
> > > > scsibus3 at softraid0: 256 targets
> > > > root on sd0a (58ab553d2e2cd141.a) swap on sd0b dump on sd0b
> > > > carp1: state transition: BACKUP -> MASTER
> > > > carp0: state transition: BACKUP -> MASTER
> > > > 
> > > 
> > > -- 
> > > I'm not entirely sure you are real.
> > > 
> > 
> 
> -- 
> I'm not entirely sure you are real.
> 

Reply via email to