PowerPC kernel linux-2.6.29.6 crashes at mm/slab.c for ipsec application
Hi all, Here is kernel bug for linux-2.6.29.6 for PowerPC (ppc440) target, while running ipsec application it is observed that kernel oops'es oftenly as show below : r...@powerpc:~# ./ipsec [ cut here ] kernel BUG at mm/slab.c:3002! Oops: Exception in kernel mode, sig: 5 [#1] PREEMPT LTT NESTING LEVEL : 0 Xilinx Virtex440 Modules linked in: nls_iso8859_1 nfsd NIP: c00a1e94 LR: c00a1d3c CTR: 000b REGS: ce8c9d20 TRAP: 0700 Not tainted (2.6.29.6.xilinx-ml507.0908010910-ipsec) MSR: 00021000 ME,CE CR: 22024428 XER: 0005 TASK = cfa2a430[974] 'watchdog' THREAD: ce8c8000 GPR00: 0028 ce8c9dd0 cfa2a430 cf802ea8 cf9e001c 000a cf9e GPR08: 0d80 0001 000a 0028 cf802ea0 1002b58c c0547bd0 c0547bd4 GPR16: c0547ba0 c050dd78 c050e60c 00d0 00200200 00100100 0001 GPR24: ce8c8034 ce8c8000 c052 cf802eb0 cf807560 cf809e00 NIP [c00a1e94] cache_alloc_refill+0x138/0x630 LR [c00a1d3c] kmem_cache_alloc+0x80/0xa0 Call Trace: [ce8c9dd0] [c050e60c] 0xc050e60c (unreliable) [ce8c9e30] [c00a1d3c] kmem_cache_alloc+0x80/0xa0 [ce8c9e50] [c00534ec] prepare_creds+0x3c/0xcc [ce8c9e70] [c005382c] copy_creds+0xa0/0x12c [ce8c9e80] [c00307dc] copy_process+0x1c0/0xe20 [ce8c9ee0] [c00314b8] do_fork+0x7c/0x338 [ce8c9f20] [c00065b4] sys_clone+0x58/0x88 [ce8c9f40] [c000e164] ret_from_syscall+0x0/0x3c Instruction dump: 2f8a 3bac0010 386c0008 409d0104 80cc 7f8c3000 419e00e8 81660010 801e001c 7d205810 3920 7d294914 0f09 7f8b0040 7d455378 409c0074 ---[ end trace b098f3001b420338 ]--- note: watchdog[974] exited with preempt_count 1 BUG: scheduling while atomic: watchdog/974/0x1002 Modules linked in: nls_iso8859_1 nfsd Call Trace: [ce8c99e0] [c0006184] show_stack+0x40/0x15c (unreliable) [ce8c9a10] [c002bab4] __schedule_bug+0x68/0x6c [ce8c9a20] [c03d5138] schedule+0x2bc/0x36c [ce8c9a70] [c002bae0] __cond_resched+0x28/0x54 [ce8c9a80] [c03d5304] _cond_resched+0x50/0x58 [ce8c9a90] [c00925c8] __mlock_vma_pages_range+0x84/0x2c4 [ce8c9b20] [c0094084] exit_mmap+0x60/0x1b0 [ce8c9b50] [c002fe64] mmput+0x50/0x114 [ce8c9b60] [c0034120] exit_mm+0x130/0x14c [ce8c9b90] [c0035db4] do_exit+0xd0/0x6b8 [ce8c9be0] [c000c234] die+0x1b0/0x1b8 [ce8c9c10] [c000c554] _exception+0x1d4/0x2b4 [ce8c9d10] [c000e78c] ret_from_except_full+0x0/0x4c [ce8c9dd0] [c050e60c] 0xc050e60c [ce8c9e30] [c00a1d3c] kmem_cache_alloc+0x80/0xa0 [ce8c9e50] [c00534ec] prepare_creds+0x3c/0xcc [ce8c9e70] [c005382c] copy_creds+0xa0/0x12c [ce8c9e80] [c00307dc] copy_process+0x1c0/0xe20 [ce8c9ee0] [c00314b8] do_fork+0x7c/0x338 [ce8c9f20] [c00065b4] sys_clone+0x58/0x88 [ce8c9f40] [c000e164] ret_from_syscall+0x0/0x3c BUG: scheduling while atomic: watchdog/974/0x1002 Modules linked in: nls_iso8859_1 nfsd Call Trace: [ce8c99e0] [c0006184] show_stack+0x40/0x15c (unreliable) [ce8c9a10] [c002bab4] __schedule_bug+0x68/0x6c [ce8c9a20] [c03d5138] schedule+0x2bc/0x36c [ce8c9a70] [c002bae0] __cond_resched+0x28/0x54 [ce8c9a80] [c03d5304] _cond_resched+0x50/0x58 [ce8c9a90] [c00925c8] __mlock_vma_pages_range+0x84/0x2c4 [ce8c9b20] [c0094084] exit_mmap+0x60/0x1b0 [ce8c9b50] [c002fe64] mmput+0x50/0x114 [ce8c9b60] [c0034120] exit_mm+0x130/0x14c [ce8c9b90] [c0035db4] do_exit+0xd0/0x6b8 [ce8c9be0] [c000c234] die+0x1b0/0x1b8 [ce8c9c10] [c000c554] _exception+0x1d4/0x2b4 [ce8c9d10] [c000e78c] ret_from_except_full+0x0/0x4c [ce8c9dd0] [c050e60c] 0xc050e60c [ce8c9e30] [c00a1d3c] kmem_cache_alloc+0x80/0xa0 [ce8c9e50] [c00534ec] prepare_creds+0x3c/0xcc [ce8c9e70] [c005382c] copy_creds+0xa0/0x12c [ce8c9e80] [c00307dc] copy_process+0x1c0/0xe20 [ce8c9ee0] [c00314b8] do_fork+0x7c/0x338 [ce8c9f20] [c00065b4] sys_clone+0x58/0x88 [ce8c9f40] [c000e164] ret_from_syscall+0x0/0x3c r...@inson:~# r...@inson:~# [ cut here ] kernel BUG at mm/slab.c:3002! Oops: Exception in kernel mode, sig: 5 [#2] PREEMPT LTT NESTING LEVEL : 0 Xilinx Virtex440 Modules linked in: nls_iso8859_1 nfsd NIP: c00a1e94 LR: c00a1d3c CTR: 000a REGS: ce9cbd20 TRAP: 0700 Tainted: G D (2.6.29.6.xilinx-ml507.0908010910-ipsec) MSR: 00021000 ME,CE CR: 22424848 XER: 0001 TASK = ce8fe030[1400] 'mvtsd.py' THREAD: ce9ca000 GPR00: 0028 ce9cbdd0 ce8fe030 cf802ea8 cf9e001c 0009 cf9e GPR08: 0d20 0001 0009 0028 cf802ea0 10018a3c c0547bd0 c0547bd4 GPR16: c0547ba0 c050dd78 c050e60c 00d0 00200200 00100100 0001 GPR24: ce9ca034 ce9ca000 c052 cf802eb0 cf807560 cf809e00 NIP [c00a1e94] cache_alloc_refill+0x138/0x630 LR [c00a1d3c] kmem_cache_alloc+0x80/0xa0 Call Trace: [ce9cbdd0] [c050e60c] 0xc050e60c (unreliable) [ce9cbe30] [c00a1d3c] kmem_cache_alloc+0x80/0xa0 [ce9cbe50] [c00534ec] prepare_creds+0x3c/0xcc [ce9cbe70] [c005382c] copy_creds+0xa0/0x12c [ce9cbe80] [c00307dc] copy_process+0x1c0/0xe20 [ce9cbee0] [c00314b8] do_fork+0x7c/0x338 [ce9cbf20] [c00065b4] sys_clone+0x58/0x88 [ce9cbf40] [c000e164] ret_from_syscall+0x0/0x3c Instruction dump: 2f8a
Re: PowerPC kernel linux-2.6.29.6 crashes at mm/slab.c for ipsec application
On Thu, Aug 06, 2009 at 06:46:26PM +0530, srikanth krishnakar wrote: Hi all, Here is kernel bug for linux-2.6.29.6 for PowerPC (ppc440) target, while running ipsec application it is observed that kernel oops'es oftenly as show below : r...@powerpc:~# ./ipsec [ cut here ] kernel BUG at mm/slab.c:3002! Oops: Exception in kernel mode, sig: 5 [#1] PREEMPT LTT NESTING LEVEL : 0 LTT? Any Clue or any bugs found in mm/slab.c for linux-2.6.29.6 while running IPSEC applications ? Do you have CONFIG_PREEMPT set? The oops output seems to think so. Also, seeing the LTT makes me wonder if you have added custom patches to your kernel? Do you have a simple testcase that could be run to recreate this? If so, could you provide it somewhere and perhaps your .config? josh ___ Linuxppc-dev mailing list Linuxppc-dev@lists.ozlabs.org https://lists.ozlabs.org/listinfo/linuxppc-dev
Re: PowerPC kernel linux-2.6.29.6 crashes at mm/slab.c for ipsec application
Yes, You are right. CONFIG_PREEMPT is enabled in the kernel config. Attached is the config. Thanks -Srikanth On Thu, Aug 6, 2009 at 7:56 PM, Josh Boyer jwbo...@linux.vnet.ibm.comwrote: On Thu, Aug 06, 2009 at 06:46:26PM +0530, srikanth krishnakar wrote: Hi all, Here is kernel bug for linux-2.6.29.6 for PowerPC (ppc440) target, while running ipsec application it is observed that kernel oops'es oftenly as show below : r...@powerpc:~# ./ipsec [ cut here ] kernel BUG at mm/slab.c:3002! Oops: Exception in kernel mode, sig: 5 [#1] PREEMPT LTT NESTING LEVEL : 0 LTT? Any Clue or any bugs found in mm/slab.c for linux-2.6.29.6 while running IPSEC applications ? Do you have CONFIG_PREEMPT set? The oops output seems to think so. Also, seeing the LTT makes me wonder if you have added custom patches to your kernel? Do you have a simple testcase that could be run to recreate this? If so, could you provide it somewhere and perhaps your .config? josh -- The Good You Do, The Best You GET Regards Srikanth Krishnakar ** # # Automatically generated make config: don't edit # Linux kernel version: 2.6.29.6 # Mon Aug 3 20:22:33 2009 # # CONFIG_PPC64 is not set # # Processor support # # CONFIG_6xx is not set # CONFIG_PPC_85xx is not set # CONFIG_PPC_8xx is not set # CONFIG_40x is not set CONFIG_44x=y # CONFIG_E200 is not set CONFIG_PPC_FPU=y CONFIG_4xx=y CONFIG_BOOKE=y CONFIG_PTE_64BIT=y CONFIG_PHYS_64BIT=y CONFIG_PPC_MMU_NOHASH=y # CONFIG_PPC_MM_SLICES is not set CONFIG_NOT_COHERENT_CACHE=y CONFIG_PPC32=y CONFIG_WORD_SIZE=32 CONFIG_ARCH_PHYS_ADDR_T_64BIT=y CONFIG_MMU=y CONFIG_GENERIC_CMOS_UPDATE=y CONFIG_GENERIC_TIME=y CONFIG_GENERIC_TIME_VSYSCALL=y CONFIG_GENERIC_CLOCKEVENTS=y CONFIG_GENERIC_HARDIRQS=y # CONFIG_HAVE_SETUP_PER_CPU_AREA is not set CONFIG_IRQ_PER_CPU=y CONFIG_STACKTRACE_SUPPORT=y CONFIG_HAVE_LATENCYTOP_SUPPORT=y CONFIG_LOCKDEP_SUPPORT=y CONFIG_RWSEM_XCHGADD_ALGORITHM=y CONFIG_ARCH_HAS_ILOG2_U32=y CONFIG_GENERIC_HWEIGHT=y CONFIG_GENERIC_CALIBRATE_DELAY=y CONFIG_GENERIC_FIND_NEXT_BIT=y CONFIG_GENERIC_GPIO=y # CONFIG_ARCH_NO_VIRT_TO_BUS is not set CONFIG_PPC=y CONFIG_EARLY_PRINTK=y CONFIG_GENERIC_NVRAM=y CONFIG_SCHED_OMIT_FRAME_POINTER=y CONFIG_ARCH_MAY_HAVE_PC_FDC=y CONFIG_PPC_OF=y CONFIG_OF=y CONFIG_PPC_UDBG_16550=y # CONFIG_GENERIC_TBSYNC is not set CONFIG_AUDIT_ARCH=y CONFIG_GENERIC_BUG=y # CONFIG_DEFAULT_UIMAGE is not set CONFIG_PPC_DCR_NATIVE=y CONFIG_PPC_DCR_MMIO=y CONFIG_PPC_DCR=y CONFIG_DEFCONFIG_LIST=/lib/modules/$UNAME_RELEASE/.config # # General setup # CONFIG_EXPERIMENTAL=y CONFIG_BROKEN_ON_SMP=y CONFIG_LOCK_KERNEL=y CONFIG_INIT_ENV_ARG_LIMIT=32 CONFIG_LOCALVERSION=-ipsec # CONFIG_LOCALVERSION_AUTO is not set CONFIG_SWAP=y CONFIG_SYSVIPC=y CONFIG_SYSVIPC_SYSCTL=y CONFIG_POSIX_MQUEUE=y # CONFIG_BSD_PROCESS_ACCT is not set # CONFIG_TASKSTATS is not set # CONFIG_AUDIT is not set # # RCU Subsystem # CONFIG_CLASSIC_RCU=y # CONFIG_TREE_RCU is not set # CONFIG_PREEMPT_RCU is not set # CONFIG_TREE_RCU_TRACE is not set # CONFIG_PREEMPT_RCU_TRACE is not set CONFIG_IKCONFIG=y CONFIG_IKCONFIG_PROC=y CONFIG_LOG_BUF_SHIFT=14 # CONFIG_HAVE_GET_CYCLES is not set CONFIG_HAVE_TRACE_CLOCK=y # CONFIG_HAVE_TRACE_CLOCK_GENERIC is not set # CONFIG_HAVE_TRACE_CLOCK_32_TO_64 is not set # CONFIG_HAVE_UNSYNCHRONIZED_TSC is not set # CONFIG_GROUP_SCHED is not set # CONFIG_CGROUPS is not set CONFIG_SYSFS_DEPRECATED=y CONFIG_SYSFS_DEPRECATED_V2=y CONFIG_RELAY=y CONFIG_NAMESPACES=y # CONFIG_UTS_NS is not set # CONFIG_IPC_NS is not set # CONFIG_USER_NS is not set # CONFIG_PID_NS is not set # CONFIG_NET_NS is not set CONFIG_BLK_DEV_INITRD=y CONFIG_INITRAMFS_SOURCE= # CONFIG_CC_OPTIMIZE_FOR_SIZE is not set CONFIG_SYSCTL=y CONFIG_ANON_INODES=y # CONFIG_EMBEDDED is not set CONFIG_SYSCTL_SYSCALL=y CONFIG_KALLSYMS=y # CONFIG_KALLSYMS_EXTRA_PASS is not set CONFIG_HOTPLUG=y CONFIG_PRINTK=y CONFIG_BUG=y CONFIG_ELF_CORE=y CONFIG_BASE_FULL=y CONFIG_FUTEX=y CONFIG_EPOLL=y CONFIG_SIGNALFD=y CONFIG_TIMERFD=y CONFIG_EVENTFD=y CONFIG_SHMEM=y CONFIG_AIO=y CONFIG_VM_EVENT_COUNTERS=y CONFIG_PCI_QUIRKS=y CONFIG_COMPAT_BRK=y CONFIG_SLAB=y # CONFIG_SLUB is not set # CONFIG_SLOB is not set CONFIG_PROFILING=y CONFIG_TRACEPOINTS=y CONFIG_MARKERS=y CONFIG_OPROFILE=m CONFIG_HAVE_OPROFILE=y CONFIG_KPROBES=y CONFIG_HAVE_EFFICIENT_UNALIGNED_ACCESS=y CONFIG_KRETPROBES=y CONFIG_HAVE_IOREMAP_PROT=y CONFIG_HAVE_KPROBES=y CONFIG_HAVE_KRETPROBES=y CONFIG_HAVE_ARCH_TRACEHOOK=y CONFIG_LTT=y CONFIG_LTT_FILTER=m # CONFIG_HAVE_LTT_DUMP_TABLES is not set CONFIG_LTT_RELAY_ALLOC=y CONFIG_LTT_RELAY_LOCKLESS=y # CONFIG_LTT_RELAY_IRQOFF is not set # CONFIG_LTT_RELAY_LOCKED is not set CONFIG_LTT_SERIALIZE=m CONFIG_LTT_FAST_SERIALIZE=y CONFIG_LTT_TRACEPROBES=m CONFIG_LTT_TRACE_CONTROL=m CONFIG_LTT_TRACER=y CONFIG_LTT_ALIGNMENT=y CONFIG_LTT_CHECK_ARCH_EFFICIENT_UNALIGNED_ACCESS=y # CONFIG_LTT_DEBUG_EVENT_SIZE is not set CONFIG_LTT_USERSPACE_EVENT=m CONFIG_LTT_VMCORE=y CONFIG_LTT_KPROBES=y
