I'm using the Vyatta "kenwood" Linux distribution, which is currently
at 2.6.31-1. I upgraded to their latest version, and began seeing kernel
panics shortly after starting to use ssh/scp on the network connected to
an e100 NIC. I was able to reproduce the problem immediately after
booting up - sometimes it even crashed during the boot.
One of the crash logs is attached.
Since the problem seemed to be related to e100.c, I reverted the two
commits to e100.c that had taken place since I last built the kernel
for this box:
Author: Roger Oksanen <[email protected]>
Date: Fri Dec 18 20:18:21 2009 -0800
e100: Fix broken cbs accounting due to missing memset.
Author: Roger Oksanen <[email protected]>
Date: Sun Nov 29 17:17:29 2009 -0800
e100: Use pci pool to work around GFP_ATOMIC order 5 memory allocation failu
I rebuilt the kernel and it's not panicking anymore.
[ 849.707104] BUG: unable to handle kernel NULL pointer dereference at 00000002
[ 849.711050] IP: [<f7ca63e0>] e100_exec_cb+0x6b/0xd8 [e100]
[ 849.711050] *pde = 00000000
[ 849.711050] Thread overran stack, or stack corrupted
[ 849.711050] Oops: 0002 [#1] SMP
[ 849.711050] last sysfs file: /sys/class/i2c-adapter/i2c-0/name
[ 849.711050] Modules linked in: ip_gre xt_comment unionfs iptable_nat
iptable_filter ip6table_filter ip6table_raw ip6_tables xt_NOTRACK iptable_raw
ip_tables x_tables nf_nat_pptp nf_conntrack_pptp nf_conntrack_proto_gre
nf_nat_h323 nf_conntrack_h323 nf_nat_sip nf_conntrack_sip nf_nat_proto_gre
nf_nat_tftp nf_nat_ftp nf_nat nf_conntrack_ipv4 nf_defrag_ipv4
nf_conntrack_tftp nf_conntrack_ftp nf_conntrack ipv6 evdev serio_raw parport_pc
pcspkr parport processor button i2c_viapro shpchp i2c_core pci_hotplug via_agp
agpgart ext3 jbd mbcache raid6_pq async_xor async_memcpy async_tx xor md_mod sg
usb_storage sr_mod cdrom sd_mod crc_t10dif pata_acpi ata_generic
pata_pdc202xx_old pata_via uhci_hcd libata usbcore nls_base e1000 e100 mii
scsi_mod thermal fan thermal_sys [last unloaded: raid10]
[ 849.711050]
[ 849.711050] Pid: 0, comm: swapper Tainted: G W (2.6.31-1-586-vyatta
#1) System Name
[ 849.711050] EIP: 0060:[<f7ca63e0>] EFLAGS: 00010006 CPU: 0
[ 849.711050] EIP is at e100_exec_cb+0x6b/0xd8 [e100]
[ 849.711050] EAX: 00000000 EBX: f67dffe0 ECX: 000004ce EDX: 36697510
[ 849.711050] ESI: f6d8e340 EDI: 00000000 EBP: f67310c0 ESP: c12d1ca0
[ 849.711050] DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068
[ 849.711050] Process swapper (pid: 0, ti=c12d0000 task=c12febc0
task.ti=c12d0000)
[ 849.711050] Stack:
[ 849.711050] f7ca5190 f6d8e380 00000286 f6d8e000 f6d8e340 f67310c0 f6d8e000
f7ca68a5
[ 849.711050] <0> 00000000 f67310c0 c132d150 c11a3bb8 f64b9b80 f7ca83b8
00000004 00000000
[ 849.711050] <0> f64b9b80 f66b4100 f67310c0 c11b14a3 000218d2 f66b415c
f6d8e000 f64b9b80
[ 849.711050] Call Trace:
[ 849.711050] [<f7ca5190>] ? e100_xmit_prepare+0x0/0x97 [e100]
[ 849.711050] [<f7ca68a5>] ? e100_xmit_frame+0x5b/0xd9 [e100]
[ 849.711050] [<c11a3bb8>] ? dev_hard_start_xmit+0x205/0x298
[ 849.711050] [<c11b14a3>] ? __qdisc_run+0xbd/0x196
[ 849.711050] [<c11a3f6d>] ? dev_queue_xmit+0x243/0x336
[ 849.711050] [<c11c2098>] ? ip_finish_output2+0x189/0x1c4
[ 849.711050] [<c11c15d8>] ? ip_local_out+0x15/0x17
[ 849.711050] [<c11c1d8f>] ? ip_queue_xmit+0x2f4/0x338
[ 849.711050] [<c101c15f>] ? activate_task+0x1c/0x21
[ 849.711050] [<c1026086>] ? try_to_wake_up+0x193/0x19d
[ 849.711050] [<c10a4a2e>] ? pollwake+0x5d/0x67
[ 849.711050] [<c11d3c46>] ? tcp_v4_send_check+0x7a/0xb0
[ 849.711050] [<c11d0833>] ? tcp_transmit_skb+0x5c9/0x602
[ 849.711050] [<c11d09d8>] ? tcp_send_ack+0xcf/0xd3
[ 849.711050] [<c11cef3d>] ? tcp_rcv_established+0x383/0x4cd
[ 849.711050] [<c11d50a2>] ? tcp_v4_do_rcv+0x151/0x2a1
[ 849.711050] [<c11d5592>] ? tcp_v4_rcv+0x3a0/0x594
[ 849.711050] [<c11be22e>] ? ip_local_deliver_finish+0xca/0x14e
[ 849.711050] [<c11bdeb5>] ? ip_rcv_finish+0x295/0x2a9
[ 849.711050] [<c11a3168>] ? netif_receive_skb+0x3cb/0x3e6
[ 849.711050] [<f7ca7afb>] ? e100_poll+0x184/0x29d [e100]
[ 849.711050] [<c11a36b9>] ? net_rx_action+0x91/0x173
[ 849.711050] [<c102e431>] ? __do_softirq+0xa5/0x147
[ 849.711050] [<c102e4f6>] ? do_softirq+0x23/0x27
[ 849.711050] [<c102e5d3>] ? irq_exit+0x26/0x53
[ 849.711050] [<c10043fd>] ? do_IRQ+0x78/0x89
[ 849.711050] [<c1002fe9>] ? common_interrupt+0x29/0x30
[ 849.711050] [<c10085ae>] ? default_idle+0x3e/0x5c
[ 849.711050] [<c1001c5c>] ? cpu_idle+0x41/0x5d
[ 849.711050] [<c132e744>] ? start_kernel+0x29c/0x29f
[ 849.711050] Code: 89 86 8c 00 00 00 89 f0 89 ab 2c 02 00 00 83 7e 50 01 19
ff 83 e7 e4 ff 14 24 66 81 4b 02 00 40 0f ae f8 8b c0 8b 83 24 02 00 00 <66> 81
60 02 ff bf eb 40 8b 88 28 02 00 00 89 f0 0f b6 56 4c e8
[ 849.711050] EIP: [<f7ca63e0>] e100_exec_cb+0x6b/0xd8 [e100] SS:ESP
0068:c12d1ca0
[ 849.711050] CR2: 0000000000000002
[ 849.711050] ---[ end trace 4eaa2a86a8e2da24 ]---
[ 849.711050] Kernel panic - not syncing: Fatal exception in interrupt
[ 849.711050] Pid: 0, comm: swapper Tainted: G D W 2.6.31-1-586-vyatta #1
[ 849.711050] Call Trace:
[ 849.711050] [<c120bee2>] ? panic+0x38/0xd1
[ 849.711050] [<c100581c>] ? oops_end+0x6c/0x76
[ 849.711050] [<c1017f6a>] ? no_context+0x105/0x10e
[ 849.711050] [<c101809b>] ? __bad_area_nosemaphore+0x128/0x133
[ 849.711050] [<c101c15f>] ? activate_task+0x1c/0x21
[ 849.711050] [<f7f3f5de>] ? ipt_do_table+0x4b2/0x4f0 [ip_tables]
[ 849.711050] [<f7ca5e09>] ? e100_exec_cmd+0x7f/0x88 [e100]
[ 849.711050] [<f7ca6443>] ? e100_exec_cb+0xce/0xd8 [e100]
[ 849.711050] [<c10181ce>] ? do_page_fault+0x0/0x270
[ 849.711050] [<c10180b0>] ? bad_area_nosemaphore+0xa/0xc
[ 849.711050] [<c120dac6>] ? error_code+0x66/0x70
[ 849.711050] [<c10181ce>] ? do_page_fault+0x0/0x270
[ 849.711050] [<f7ca63e0>] ? e100_exec_cb+0x6b/0xd8 [e100]
[ 849.711050] [<f7ca5190>] ? e100_xmit_prepare+0x0/0x97 [e100]
[ 849.711050] [<f7ca68a5>] ? e100_xmit_frame+0x5b/0xd9 [e100]
[ 849.711050] [<c11a3bb8>] ? dev_hard_start_xmit+0x205/0x298
[ 849.711050] [<c11b14a3>] ? __qdisc_run+0xbd/0x196
[ 849.711050] [<c11a3f6d>] ? dev_queue_xmit+0x243/0x336
[ 849.711050] [<c11c2098>] ? ip_finish_output2+0x189/0x1c4
[ 849.711050] [<c11c15d8>] ? ip_local_out+0x15/0x17
[ 849.711050] [<c11c1d8f>] ? ip_queue_xmit+0x2f4/0x338
[ 849.711050] [<c101c15f>] ? activate_task+0x1c/0x21
[ 849.711050] [<c1026086>] ? try_to_wake_up+0x193/0x19d
[ 849.711050] [<c10a4a2e>] ? pollwake+0x5d/0x67
[ 849.711050] [<c11d3c46>] ? tcp_v4_send_check+0x7a/0xb0
[ 849.711050] [<c11d0833>] ? tcp_transmit_skb+0x5c9/0x602
[ 849.711050] [<c11d09d8>] ? tcp_send_ack+0xcf/0xd3
[ 849.711050] [<c11cef3d>] ? tcp_rcv_established+0x383/0x4cd
[ 849.711050] [<c11d50a2>] ? tcp_v4_do_rcv+0x151/0x2a1
[ 849.711050] [<c11d5592>] ? tcp_v4_rcv+0x3a0/0x594
[ 849.711050] [<c11be22e>] ? ip_local_deliver_finish+0xca/0x14e
[ 849.711050] [<c11bdeb5>] ? ip_rcv_finish+0x295/0x2a9
[ 849.711050] [<c11a3168>] ? netif_receive_skb+0x3cb/0x3e6
[ 849.711050] [<f7ca7afb>] ? e100_poll+0x184/0x29d [e100]
[ 849.711050] [<c11a36b9>] ? net_rx_action+0x91/0x173
[ 849.711050] [<c102e431>] ? __do_softirq+0xa5/0x147
[ 849.711050] [<c102e4f6>] ? do_softirq+0x23/0x27
[ 849.711050] [<c102e5d3>] ? irq_exit+0x26/0x53
[ 849.711050] [<c10043fd>] ? do_IRQ+0x78/0x89
[ 849.711050] [<c1002fe9>] ? common_interrupt+0x29/0x30
[ 849.711050] [<c10085ae>] ? default_idle+0x3e/0x5c
[ 849.711050] [<c1001c5c>] ? cpu_idle+0x41/0x5d
[ 849.711050] [<c132e744>] ? start_kernel+0x29c/0x29f
[ 849.711050] Rebooting in 60 seconds..
------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
E1000-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel® Ethernet, visit
http://communities.intel.com/community/wired