On 2012/02/21 17:05, Ted Unangst wrote:
> On Tue, Feb 21, 2012, Stuart Henderson wrote:
> > Box running pf/ospf/bgp/relayd entered ddb with "Stopped at
> > cpu_idle_cycle+0xe: hlt".
> >
> > Various of these seen in 'sh all pools':-
> >
> > mcl9k: pool(0xd0a2df78:mcl9k): page inconsistency: page 0xd1cc6000; item
> > ordinal 0; addr 0xd1cc6018 (p 0xd1cc4000)
> > mcl9k: pool(0xd0a2df78:mcl9k): page inconsistency: page 0xd1cc2000; item
> > ordinal 0; addr 0xd1cc2014 (p 0xd1cc0000)
> >
> > Various pieces of ddb output below followed by a dmesg.
> > Running i386 GENERIC from 9 Feb.
> >
> > Anyone have ideas or requests for more info to collect if it recurs?
>
> Turn off jumbos? Pool corruption in one pool means the consumers are
> doing it wrong. But the 9k pools are also the special bigger than one
> page pools, which aren't used as much, so the bug could be in there.
Thanks Ted. I'm not using jumbos though the bge interfaces do
have 9k pools allocated.
There are some carp-on-vlan-on-trunk.
IFACE LIVELOCKS SIZE ALIVE LWM HWM CWM
System 0 256 125 12
2k 48 40
9k 34 42
lo0
em0 2k 14 4 256 14
em1
bge0 2k 17 17 512 17
9k 17 17 256 17
bge1 2k 17 17 512 17
9k 17 17 256 17
The only if's with mtu other than 1500 are lo0, lo1, pflog0.
<root@br1-pl7:/root:9># ifconfig -A | grep mtu
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 33196
em0: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu
1500
em1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> mtu 1500
bge0: flags=8b43<UP,BROADCAST,RUNNING,PROMISC,ALLMULTI,SIMPLEX,MULTICAST> mtu
1500
bge1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
lo1: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> mtu 33196
trunk0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan129: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan168: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan169: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan209: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan410: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan411: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan413: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan42: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan43: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan431: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan432: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan436: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan51: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan52: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan700: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
vlan721: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan80: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan81: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
vlan881: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> mtu 1500
pfsync0: flags=41<UP,RUNNING> mtu 1500
pflog0: flags=141<UP,RUNNING,PROMISC> mtu 33196
carp129: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp168: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp169: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp193: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp209: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp410: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp411: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp413: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp42: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp43: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp431: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp432: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp436: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp51: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp52: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp721: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp81: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
carp881: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> mtu 1500
