On 11/22/13 12:03, Stuart Henderson wrote:
> On 2013/11/22 08:47, RD Thrush wrote:
>> On 11/11/13 11:22, Stuart Henderson wrote:
>>> On 2013/11/11 09:53, RD Thrush wrote:
>>>>> Synopsis: Firewall panic with Nov 10 snapshot
>>>>> Category: kernel
>>>>> Environment:
>>>> System : OpenBSD 5.4
>>>> Details : OpenBSD 5.4-current (GENERIC) #142: Sun Nov 10 22:52:49
>>>> MST 2013
>>>>
>>>> [email protected]:/usr/src/sys/arch/i386/compile/GENERIC
>>>> Architecture: OpenBSD.i386
>>>> Machine : i386
>>>>> Description:
>>>> Soekris 5501 firewall panics an hour after booting new snapshot.
>>>> Appended is
>>>> some ddb info as well as normal sendbug details.
>>>>> How-To-Repeat:
>>>> Don't know.
>>>>> Fix:
>>>> Revert to Nov 7 kernel
>>>
>>> I've reverted the bpf commit for now, it looks like the change is
>>> invalidating
>>> assumptions of the conditional around bpf_read()'s tsleep in bpf.c:439 ..
>>
>> It appears this problem still exists. I've had panic's on 3 machines since
>> upgrading to the Nov 20 snap (2 amd64, 1 i386). I've attached the report
>> from
>> the x2 machine and am appending ddb's trace,ps,show registers and callout
>> from
>> all three. I have the full serial captures if more info is required.
>
> I've just updated things on my router at home and hit this (with
> ladvd), including with the bpf.c commits reverted.
>
> I'm using "ladvd -Lz" and hit the panic pretty much as soon as it starts.
This problem remains with amd64 -current in both sp and mp variants. In
previous panics, ddb panic'd during boot crash. I'm now able to get a crash
dump for further forensics.
The panic repeatably occurs after reboot by arranging to start the darkstat
package and ensuring one access to the darkstat port from a @reboot in a user
crontab. Here's what I did:
pkg_add darkstat
echo 'pkg_scripts="$pkg_scripts darkstat"' >>/etc/rc.conf.local
Add '@reboot echo quit | nc localhost 667' to a normal user's crontab
I've appended the tail of the startup, some ddb probing and the dmesg.
starting local daemons: apmd cron.
Sun Dec 8 09:20:40 EST 2013
panic: timeout_add: to_ticks (-1) < 0
Stopped at Debugger+0x5: leave
RUN AT LEAST 'trace' AND 'ps' AND INCLUDE OUTPUT WHEN REPORTING THIS PANIC!
IF RUNNING SMP, USE 'mach ddbcpu <#>' AND 'trace' ON OTHER PROCESSORS, TOO.
DO NOT EVEN BOTHER REPORTING THIS WITHOUT INCLUDING THAT INFORMATION!
ddb{0}> trace
Debugger() at Debugger+0x5
panic() at panic+0xee
timeout_add() at timeout_add+0xff
tsleep() at tsleep+0x87
bpfread() at bpfread+0x1a4
spec_read() at spec_read+0x2a8
VOP_READ() at VOP_READ+0x32
vn_read() at vn_read+0xa1
dofilereadv() at dofilereadv+0x18a
sys_read() at sys_read+0x8f
syscall() at syscall+0x249
--- syscall (number 3) ---
end of kernel
end trace frame: 0x7f7fffff0ca0, count: -11
0x14c99da021ba:
ddb{0}> ps
PID PPID PGRP UID S FLAGS WAIT COMMAND
20251 1 1 0 3 0x80 nanosleep init
24497 1 1 0 3 0x80 nanosleep init
1265 64 64 1000 3 0x82 poll nc
18514 1 1 0 3 0x80 nanosleep init
21959 1 1 0 3 0x80 nanosleep init
24307 1 1 0 3 0x80 nanosleep init
19833 1 1 0 3 0x80 nanosleep init
64 24397 64 1000 3 0x8a pause sh
24397 5817 5817 0 3 0x80 piperd cron
5817 1 5817 0 3 0x80 select cron
29113 1 29113 0 3 0x80 kqread apmd
11585 32262 5456 0 3 0x83 nanosleep sleep
32262 1 5456 0 3 0x89 pause sh
30685 28859 30685 587 3 0x90 netio darkstat
*28859 1 28859 587 7 0x10 bpf darkstat
30199 1 30199 99 3 0x90 poll sndiod
11396 1 11396 0 3 0x80 poll ftpd
27251 11728 11728 95 3 0x90 kqread smtpd
16104 11728 11728 95 3 0x90 kqread smtpd
10241 11728 11728 95 3 0x90 kqread smtpd
20043 11728 11728 95 3 0x90 kqread smtpd
25982 11728 11728 95 3 0x90 kqread smtpd
30826 11728 11728 95 3 0x90 kqread smtpd
21203 11728 11728 95 3 0x90 kqread smtpd
25756 11728 11728 95 3 0x90 kqread smtpd
11728 1 11728 0 3 0x80 kqread smtpd
32758 1 32758 0 3 0x80 select sshd
4779 0 0 0 3 0x100280 nfsidl nfsio
22212 0 0 0 3 0x100280 nfsidl nfsio
24949 0 0 0 3 0x100280 nfsidl nfsio
14000 0 0 0 3 0x100280 nfsidl nfsio
27381 1 27381 0 3 0x80 poll ntpd
8880 15963 8880 83 3 0x90 poll ntpd
15963 1 15963 83 3 0x90 poll ntpd
13109 18188 18188 74 3 0x90 bpf pflogd
18188 1 18188 0 3 0x80 netio pflogd
23767 15742 15742 73 3 0x90 poll syslogd
15742 1 15742 0 3 0x80 netio syslogd
10171 1 10171 77 3 0x90 poll dhclient
20522 1 20522 0 3 0x80 poll dhclient
15 0 0 0 3 0x100200 aiodoned aiodoned
14 0 0 0 3 0x100200 syncer update
13 0 0 0 3 0x100200 cleaner cleaner
12 0 0 0 3 0x100200 reaper reaper
11 0 0 0 3 0x100200 pgdaemon pagedaemon
10 0 0 0 3 0x100200 bored crypto
9 0 0 0 3 0x100200 pftm pfpurge
8 0 0 0 3 0x100200 usbtsk usbtask
7 0 0 0 3 0x100200 usbatsk usbatsk
6 0 0 0 3 0x40100200 acpi0 acpi0
5 0 0 0 7 0x40100200 idle1
4 0 0 0 3 0x100200 bored systq
3 0 0 0 3 0x100200 bored syswq
2 0 0 0 3 0x40100200 idle0
1 0 1 0 3 0x82 wait init
0 -1 0 0 3 0x200 scheduler swapper
ddb{0}> show registers
ds 0x292
es 0x7a50 acpi_pdirpa+0x34f0
fs 0x7a70 acpi_pdirpa+0x3510
gs 0x1e66
rdi 0x1
rsi 0x292
rbp 0xffff800007307a40
rbx 0xffffffff81782d20 addrmask+0x1260
rdx 0xc
rcx 0xffffffff819ee920 cpu_info_primary
rax 0x1
r8 0xffff800007307960
r9 0
r10 0x2d
r11 0xffffffff8108f6e0 comcnputc
r12 0x100
r13 0xffff800007307a50
r14 0
r15 0xffff800007307db0
rip 0xffffffff8133d965 Debugger+0x5
cs 0x8
rflags 0x202
rsp 0xffff800007307a40
ss 0x10
Debugger+0x5: leave
ddb{0}> callout
ticks now: 1711
ticks wheel arg func
2035 4d/1024d 0xfffffe800c5582a8 endtsleep
720000 4d/1024d 0xfffffe800c619238 tcp_timer_keep
720000 4d/1024d 0xfffffe800c619468 tcp_timer_keep
0 4d/1024d 0xfffffe800c3bb000 syn_cache_reaper
84 0d/3 d 0xfffffe800c9649d8 endtsleep
95 0d/14 d 0xfffffe800f5bb9b0 endtsleep
95 0d/14 d 0xffffffff81cd9440 if_slowtimo
1 0d/176 d 0x0 m_cltick
9 0d/184 d 0xfffffe800d0ac030 endtsleep
9 0d/184 d 0xfffffe800e13f760 endtsleep
9 0d/184 d 0xfffffe800d0ac298 endtsleep
9 0d/184 d 0xfffffe800d0ac768 endtsleep
9 0d/184 d 0xfffffe800d0ac500 endtsleep
17 0d/192 d 0xffffffff81cd9340 pffasttimo
23 0d/198 d 0xffffffff81d2bb00 pckbc_poll
23 0d/198 d 0x0 nd6_timer
23 0d/198 d 0xffffffff81cd9560 rt_timer_timer
23 0d/198 d 0xffffffff81cd9000 schedcpu
23 0d/198 d 0xffffffff81cd9300 pfslowtimo
23 0d/198 d 0xfffffe800ecb94e8 endtsleep
27 0d/202 d 0xfffffe800f62a4d8 endtsleep
28 0d/203 d 0xfffffe800e344288 endtsleep
50 0d/225 d 0xfffffe800c558040 endtsleep
55 0d/230 d 0xfffffe800c558778 endtsleep
59 0d/234 d 0xfffffe800c5589e0 endtsleep
60 0d/235 d 0xfffffe800c3c0048 endtsleep
60 0d/235 d 0xfffffe800e13f9c8 endtsleep
60 0d/235 d 0xfffffe800c3c02b0 endtsleep
77 0d/252 d 0xfffffe800e13fc30 endtsleep
79 0d/254 d 0xfffffe800c3c0780 endtsleep
289 1d/263 d 0xffff8000000ff400 acpi_poll
1948 1d/270 d 0xfffffe800e541248 realitexpire
5090 1d/282 d 0xfffffe800f5b06a0 realitexpire
5787 1d/285 d 0xfffffe800d0ac9d0 endtsleep
28845 1d/375 d 0xffffffff81cd95a0 arptimer
58289 1d/490 d 0x0 arc4_reinit
358290 2d/517 d 0x0 nd6_slowtimo
8639044 2d/643 d 0xfffffe800ecb9280 endtsleep
ddb{0}> show extents
extent `swap0x0001' (0x0 - 0x3fb18), flags=0
0x0 - 0x0
extent `swap0x0000' (0x0 - 0x90079), flags=0
0x0 - 0x0
0x90078 - 0x90078
extent `swapmap' (0x1 - 0x7fffffff), flags=0
0x1 - 0xcfb93
extent `pcibus' (0x0 - 0xff), flags=0
0x0 - 0x0
extent `pcimem' (0x0 - 0xffffffffffffffff), flags=0
0x0 - 0xfffffff
0xe0000000 - 0xe0ffffff
0xf0000000 - 0xf0407fff
0xfffc0000 - 0xffffffff
0x1000000000 - 0xffffffffffffffff
extent `pciio' (0x0 - 0xffffffff), flags=0
0xd000 - 0xd00f
0xd020 - 0xd05f
0xd100 - 0xd249
0xd250 - 0xd259
0xd260 - 0xd26f
0x10000 - 0xffffffff
extent `iomem' (0x0 - 0xffffffffffff), flags=3<NOCOALESCE,FIXED>
0x14000 - 0x9efff
0xa0000 - 0xbffff
0x100000 - 0xffffff
0x1000000 - 0xffeffff
0xf0404000 - 0xf0404fff
0xf0405000 - 0xf0405fff
0xf0406000 - 0xf0407fff
extent `ioport' (0x0 - 0xffff), flags=3<NOCOALESCE,FIXED>
0x0 - 0xb
0x40 - 0x43
0x60 - 0x60
0x61 - 0x61
0x64 - 0x64
0x80 - 0x8e
0xc0 - 0xd7
0x170 - 0x177
0x1f0 - 0x1f7
0x376 - 0x376
0x3c0 - 0x3cf
0x3d0 - 0x3df
0x3f6 - 0x3f6
0x3f8 - 0x3ff
0x4000 - 0x4001
0x4002 - 0x4003
0x4004 - 0x4005
0x4008 - 0x400b
0x4020 - 0x4020
0x4021 - 0x4021
0x442e - 0x442e
0xd000 - 0xd00f
0xd020 - 0xd03f
0xd100 - 0xd1ff
0xd200 - 0xd23f
ddb{0}> show uvmexp
Current UVM status:
pagesize=4096 (0x1000), pagemask=0xfff, pageshift=12
59887 VM pages: 3821 active, 1046 inactive, 1 wired, 44002 free
min 10% (25) anon, 10% (25) vnode, 5% (12) vtext
pages 0 anon, 0 vnode, 0 vtext
freemin=1996, free-target=2661, inactive-target=0, wired-max=19962
faults=54284, traps=54050, intrs=1260, ctxswitch=5111 fpuswitch=15
softint=1912, syscalls=79357, kmapent=13
fault counts:
noram=0, noanon=0, pgwait=0, pgrele=0
ok relocks(total)=2030(2030), anget(retries)=33167(0), amapcopy=22923
neighbor anon/obj pg=2851/28169, gets(lock/unlock)=11676/2030
cases: anon=25726, anoncow=7441, obj=10458, prcopy=1218, przero=9441
daemon and swap counts:
woke=0, revs=0, scans=0, obscans=0, anscans=0
busy=0, freed=0, reactivate=0, deactivate=0
pageouts=0, pending=0, nswget=0
nswapdev=2, nanon=0, nanonneeded=0 nfreeanon=0
swpages=850833, swpginuse=0, swpgonly=0 paging=0
kernel pointers:
objs(kern)=0xffffffff81cfdf20
ddb{0}> show all pools
Name Size Requests Fail Releases Pgreq Pgrel Npage Hiwat Minpg Maxpg Idle
inpcbpl 360 72 0 49 3 0 3 3 0 8 0
plimitpl 152 20 0 4 1 0 1 1 0 8 0
synpl 248 1 0 0 1 0 1 1 0 8 0
tcpcbpl 560 11 0 1 2 0 2 2 0 8 0
rtentpl 200 33 0 0 2 0 2 2 0 8 0
pfosfp 40 840 0 420 5 0 5 5 0 8 0
pfosfpen 112 1420 0 710 34 13 21 21 0 8 0
pfstateitempl 24 26 0 0 1 0 1 1 0 8 0
pfstatekeypl 104 26 0 0 1 0 1 1 0 8 0
pfstatepl 312 26 0 0 2 0 2 2 0 8 0
pfrulepl 1328 14 0 10 5 0 5 5 0 8 2
nfsnodepl 472 3 0 0 1 0 1 1 0 8 0
dirhash 1024 31 0 0 8 0 8 8 0 8 0
dirrempl 64 33 0 4 1 0 1 1 0 8 0
mkdirpl 56 14 0 3 1 0 1 1 0 8 0
diraddpl 56 44 0 4 1 0 1 1 0 8 0
freefilepl 48 1 0 1 1 0 1 1 0 8 1
freeblkspl 192 8 0 7 1 0 1 1 0 8 0
freefragpl 64 2 0 2 1 0 1 1 0 8 1
allocindirpl 104 82 0 0 3 0 3 3 0 8 0
indirdeppl 56 1 0 0 1 0 1 1 0 8 0
allocdirectpl 128 58 0 13 2 0 2 2 0 8 0
bmsafemappl 64 13 0 7 1 0 1 1 0 8 0
newblkpl 64 140 0 140 1 0 1 1 0 8 1
inodedeppl 152 75 0 6 3 0 3 3 0 8 0
pagedeppl 128 23 0 0 1 0 1 1 0 8 0
dino1pl 128 1975 0 2 64 0 64 64 0 8 0
ffsino 216 1975 0 2 110 0 110 110 0 8 0
nchpl 144 3057 0 66 111 0 111 111 0 8 0
vnodes 264 1996 0 0 134 0 134 134 0 8 0
namei 1024 6208 0 6208 1 0 1 1 0 8 1
nfsreqpl 96 6 0 6 1 0 1 1 0 8 1
scxspl 192 1758 0 1758 2 0 2 2 0 8 2
wdcspl 176 12 0 12 1 0 1 1 0 8 1
ifaddritempl 64 10 0 0 1 0 1 1 0 8 0
wqtasks 40 5 0 5 1 0 1 1 0 8 1
sigapl 432 344 0 307 5 0 5 5 0 8 0
knotepl 112 625 0 551 3 0 3 3 0 8 0
kqueuepl 320 10 0 0 1 0 1 1 0 8 0
pipepl 120 300 0 296 1 0 1 1 0 8 0
fdescpl 440 345 0 307 5 0 5 5 0 8 0
filepl 120 2654 0 2511 5 0 5 5 0 8 0
lockfpl 88 15 0 14 1 0 1 1 0 8 0
pcredpl 24 362 0 307 1 0 1 1 0 8 0
sessionpl 64 20 0 2 1 0 1 1 0 8 0
pgrppl 40 20 0 2 1 0 1 1 0 8 0
ucredpl 80 274 0 246 1 0 1 1 0 8 0
zombiepl 144 307 0 307 1 0 1 1 0 8 1
processpl 560 362 0 307 9 0 9 9 0 8 0
procpl 616 362 0 307 10 0 10 10 0 8 0
sockpl 472 223 0 125 16 0 16 16 0 8 0
mcl2k 2048 170 0 164 41 0 41 41 4 3072 37
mtagpl 72 1 0 1 1 0 1 1 0 8 1
mbpl 256 746 0 724 6 0 6 6 1 384 4
bufpl 272 1636 0 227 94 0 94 94 0 8 0
anonpl 16 18100 0 15262 12 0 12 12 0 15 0
amappl 72 15951 0 14699 24 0 24 24 0 75 0
dma4096 4096 3 0 3 1 0 1 1 0 8 1
dma512 512 8 0 5 1 0 1 1 0 8 0
dma256 256 21 0 21 1 0 1 1 0 8 1
dma128 128 3 0 3 1 0 1 1 0 8 1
dma64 64 9 0 9 1 0 1 1 0 8 1
dma32 32 18 0 18 1 0 1 1 0 8 1
dma16 16 3 0 3 1 0 1 1 0 8 1
aobjpl 64 1 0 0 1 0 1 1 0 8 0
uaddrrnd 40 345 0 307 1 0 1 1 0 8 0
uaddrbestfit 32 2 0 0 1 0 1 1 0 8 0
uaddr 24 345 0 307 1 0 1 1 0 8 0
vmmpekpl 168 1081 0 1070 1 0 1 1 0 8 0
vmmpepl 168 31258 0 28625 120 0 120 120 0 357 2
vmsppl 224 344 0 307 3 0 3 3 0 8 0
pdppl 4096 344 0 307 40 0 40 40 0 8 3
pvpl 32 66233 0 58386 69 0 69 69 0 265 1
pmappl 152 344 0 307 2 0 2 2 0 8 0
extentpl 40 61 0 36 1 0 1 1 0 8 0
phpool 104 434 0 0 12 0 12 12 0 8 0
ddb{0}> show proc
PROC (darkstat) pid=28859 stat=onproc
flags process=10<SUGID> proc=0
pri=26, usrpri=67, nice=20
forw=0x0, list=0xfffffe800c9642a0,0xfffffe800c964780
process=0xfffffe800c963490 user=0xffff800007303000, vmspace=0xfffffe800d3bd
468
estcpu=17, cpticks=0, pctcpu=0.0, swtime=2
user=0, sys=0, intr=0
ddb{0}> show bcstats
Current Buffer Cache status:
numbufs 1409 busymapped 1, delwri 147
kvaslots 748 avail kva slots 747
bufpages 5508, dirtypages 580
pendingreads 0, pendingwrites 0
ddb{0}> boot crash
### dmesg ###
booting hd0a:bsd.mp: 6535564+1646892+1080208+0+620384
[80+553608+368896]=0xe4ee38
entry point at 0x10001e0 [7205c766, 34000004, 24448b12, 5958a304]
[ using 923352 bytes of bsd ELF symbol table ]
Copyright (c) 1982, 1986, 1989, 1991, 1993
The Regents of the University of California. All rights reserved.
Copyright (c) 1995-2013 OpenBSD. All rights reserved. http://www.OpenBSD.org
OpenBSD 5.4-current (GENERIC.MP) #187: Sat Dec 7 18:40:28 MST 2013
[email protected]:/usr/src/sys/arch/amd64/compile/GENERIC.MP
real mem = 251592704 (239MB)
avail mem = 236879872 (225MB)
mainbus0 at root
bios0 at mainbus0: SMBIOS rev. 2.5 @ 0xe1000 (10 entries)
bios0: vendor innotek GmbH version "VirtualBox" date 12/01/2006
bios0: innotek GmbH VirtualBox
acpi0 at bios0: rev 2
acpi0: sleep states S0 S5
acpi0: tables DSDT FACP APIC SSDT
acpi0: wakeup devices
acpitimer0 at acpi0: 3579545 Hz, 32 bits
acpimadt0 at acpi0 addr 0xfee00000: PC-AT compat
cpu0 at mainbus0: apid 0 (boot processor)
cpu0: Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz, 3299.32 MHz
cpu0:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,SSSE3,NXE,LONG,LAHF,PERF
cpu0: 256KB 64b/line 8-way L2 cache
cpu0: smt 0, core 0, package 0
cpu0: apic clock running at 1000MHz
cpu1 at mainbus0: apid 1 (application processor)
cpu1: Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz, 3298.96 MHz
cpu1:
FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CFLUSH,MMX,FXSR,SSE,SSE2,HTT,SSE3,SSSE3,NXE,LONG,LAHF,PERF
cpu1: 256KB 64b/line 8-way L2 cache
cpu1: smt 0, core 1, package 0
ioapic0 at mainbus0: apid 2 pa 0xfec00000, version 11, 24 pins
acpiprt0 at acpi0: bus 0 (PCI0)
acpicpu0 at acpi0
acpicpu1 at acpi0
acpibat0 at acpi0: BAT0 not present
acpiac0 at acpi0: AC unit online
pci0 at mainbus0 bus 0
pchb0 at pci0 dev 0 function 0 "Intel 82441FX" rev 0x02
pcib0 at pci0 dev 1 function 0 "Intel 82371SB ISA" rev 0x00
pciide0 at pci0 dev 1 function 1 "Intel 82371AB IDE" rev 0x01: DMA, channel 0
configured to compatibility, channel 1 configured to compatibility
pciide0: channel 0 disabled (no drives)
atapiscsi0 at pciide0 channel 1 drive 0
scsibus0 at atapiscsi0: 2 targets
cd0 at scsibus0 targ 0 lun 0: <VBOX, CD-ROM, 1.0> ATAPI 5/cdrom removable
cd0(pciide0:1:0): using PIO mode 4, Ultra-DMA mode 2
vga1 at pci0 dev 2 function 0 "InnoTek VirtualBox Graphics Adapter" rev 0x00
wsdisplay0 at vga1 mux 1: console (80x25, vt100 emulation)
wsdisplay0: screen 1-5 added (80x25, vt100 emulation)
virtio0 at pci0 dev 3 function 0 "Qumranet Virtio Network" rev 0x00: Virtio
Network Device
vio0 at virtio0: address 08:00:27:06:9c:b4
virtio0: apic 2 int 19
"InnoTek VirtualBox Guest Service" rev 0x00 at pci0 dev 4 function 0 not
configured
auich0 at pci0 dev 5 function 0 "Intel 82801AA AC97" rev 0x01: apic 2 int 21,
ICH AC97
ac97: codec id 0x83847600 (SigmaTel STAC9700)
audio0 at auich0
ohci0 at pci0 dev 6 function 0 "Apple Intrepid USB" rev 0x00: apic 2 int 22,
version 1.0
piixpm0 at pci0 dev 7 function 0 "Intel 82371AB Power" rev 0x08: SMBus disabled
ehci0 at pci0 dev 11 function 0 "Intel 82801FB USB" rev 0x00: apic 2 int 19
usb0 at ehci0: USB revision 2.0
uhub0 at usb0 "Intel EHCI root hub" rev 2.00/1.00 addr 1
ahci0 at pci0 dev 13 function 0 "Intel 82801HBM AHCI" rev 0x02: apic 2 int 21,
AHCI 1.1
ahci0: device on port 0 didn't come ready, TFD: 0x171<ERR>
ahci0: device on port 1 didn't come ready, TFD: 0x171<ERR>
ahci0: device on port 2 didn't come ready, TFD: 0x171<ERR>
scsibus1 at ahci0: 32 targets
sd0 at scsibus1 targ 0 lun 0: <ATA, VBOX HARDDISK, 1.0> SCSI3 0/direct fixed
t10.ATA_VBOX_HARDDISK_VBbcc99a08-744eefa6_
sd0: 12288MB, 512 bytes/sector, 25165824 sectors
sd1 at scsibus1 targ 1 lun 0: <ATA, VBOX HARDDISK, 1.0> SCSI3 0/direct fixed
t10.ATA_VBOX_HARDDISK_VB9da9db2b-7414c638_
sd1: 20480MB, 512 bytes/sector, 41943040 sectors
sd2 at scsibus1 targ 2 lun 0: <ATA, VBOX HARDDISK, 1.0> SCSI3 0/direct fixed
t10.ATA_VBOX_HARDDISK_VBdaa85231-cc9edc4a_
sd2: 511978MB, 512 bytes/sector, 1048530944 sectors
isa0 at pcib0
isadma0 at isa0
com0 at isa0 port 0x3f8/8 irq 4: ns16550a, 16 byte fifo
com0: console
pckbc0 at isa0 port 0x60/5
pckbd0 at pckbc0 (kbd slot)
pckbc0: using irq 1 for kbd slot
wskbd0 at pckbd0: console keyboard, using wsdisplay0
pms0 at pckbc0 (aux slot)
pckbc0: using irq 12 for aux slot
wsmouse0 at pms0 mux 0
pcppi0 at isa0 port 0x61
spkr0 at pcppi0
usb1 at ohci0: USB revision 1.0
uhub1 at usb1 "Apple OHCI root hub" rev 1.00/1.00 addr 1
mtrr: CPU supports MTRRs but not enabled by BIOS
vscsi0 at root
scsibus2 at vscsi0: 256 targets
softraid0 at root
scsibus3 at softraid0: 256 targets
root on sd0a (81831238603d6adb.a) swap on sd0b dump on sd0b
WARNING: / was not properly unmounted
