Package: munin Version: 1.4.4-1 Severity: normal Tags: squeeze I have logged 4 kernel general protection faults from 2010.03.04 through 2010.06.09 which all seem to have a pattern of being triggered by munin-graph runs. This is a testing (Squeeze) box updated daily with no other issues - I've run a few cycles of memtest and cpuburn over the past few months to see if hardware was a problem, which all pass. The munin versions may vary between the above dates and the fault logs are dated-timed. I'd be happy to provide any additional information or try any other testing - this one is a bit of a mystery to me, but due to the process pattern during the fault, I'm opening under munin.
Kind regards, Michael Shuler -- System Information: Debian Release: squeeze/sid APT prefers testing APT policy: (700, 'testing'), (300, 'unstable') Architecture: amd64 (x86_64) Kernel: Linux 2.6.32-5-amd64 (SMP w/4 CPU cores) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8) Shell: /bin/sh linked to /bin/dash Versions of packages munin depends on: ii adduser 3.112 add and remove users and groups ii cron 3.0pl1-111 process scheduling daemon pn libdigest-md5-perl <none> (no description available) ii libhtml-template-perl 2.9-1 HTML::Template : A module for usin ii liblog-log4perl-perl 1.28-1 A Perl port of the widely popular ii librrds-perl 1.4.3-1 time-series data storage and displ pn libstorable-perl <none> (no description available) ii munin-common 1.4.4-1 network-wide graphing framework (c ii perl [libtime-hires-perl] 5.10.1-12 Larry Wall's Practical Extraction ii perl-modules 5.10.1-12 Core Perl modules ii rrdtool 1.4.3-1 time-series data storage and displ ii ttf-dejavu 2.30-2 Metapackage to pull in ttf-dejavu- Versions of packages munin recommends: ii libdate-manip-perl 6.07-2 module for manipulating dates ii munin-node 1.4.4-1 network-wide graphing framework (n Versions of packages munin suggests: ii epiphany-browser [www-browser 2.30.2-2 Intuitive GNOME web browser ii iceweasel [www-browser] 3.5.9-3 Web browser based on Firefox ii nginx [httpd] 0.7.65-6 small, but very powerful and effic ii w3m [www-browser] 0.5.2-4 WWW browsable pager with excellent -- no debconf information
# This fault resulted in many hung 'ps' processes started by subsequent munin # runs after the fault and load of 50+ when rebooted @21:31:26. Sorry no # additional data - box was pretty unresponsive, and I needed to get some work # done ;) Mar 24 19:40:01 gaea /USR/SBIN/CRON[25777]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) Mar 24 19:40:01 gaea /USR/SBIN/CRON[25779]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) Mar 24 19:45:01 gaea /USR/SBIN/CRON[27516]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) Mar 24 19:45:01 gaea /USR/SBIN/CRON[27517]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 24 19:45:01 gaea /USR/SBIN/CRON[27518]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) Mar 24 19:45:13 gaea kernel: [43448.696729] general protection fault: 0000 [#1] SMP Mar 24 19:45:13 gaea kernel: [43448.696733] last sysfs file: /sys/devices/system/cpu/cpu3/cpufreq/stats/time_in_state Mar 24 19:45:13 gaea kernel: [43448.696735] CPU 1 Mar 24 19:45:13 gaea kernel: [43448.696736] Modules linked in: ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 ppdev lp parport sco bridge stp bnep rfcomm l2cap crc16 bluetooth rfkill sit tunnel4 tun xt_multiport iptable_filter ip_tables x_tables vboxnetflt vboxnetadp vboxdrv powernow_k8 cpufreq_powersave cpufreq_userspace cpufreq_stats cpufreq_conservative binfmt_misc fuse nfsd nfs lockd fscache nfs_acl auth_rpcgss sunrpc it87 hwmon_vid loop firewire_sbp2 xfs exportfs snd_hda_codec_realtek snd_hda_intel snd_hda_codec snd_hwdep snd_pcm_oss snd_mixer_oss snd_pcm snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_timer snd_seq_device i2c_piix4 xhci snd edac_core i2c_core pcspkr evdev edac_mce_amd soundcore snd_page_alloc processor ext3 jbd mbcache raid456 async_raid6_recov async_pq usbhid hid raid6_pq async_xor xor async_memcpy async_tx raid1 md_mod ide_cd_mod cdrom ohci_hcd ata_generic ide_pci_generic firewire_ohci firewire_core sg sd_mod c rc_t10dif pata_jmicron ehci_hcd crc Mar 24 19:45:13 gaea kernel: _itu_t r8169 mii atiixp ide_core ahci usbcore nls_base libata button scsi_mod thermal fan thermal_sys [last unloaded: scsi_wait_scan] Mar 24 19:45:13 gaea kernel: [43448.696786] Pid: 28208, comm: munin-graph Not tainted 2.6.32-3-amd64 #1 GA-790XTA-UD4 Mar 24 19:45:13 gaea kernel: [43448.696787] RIP: 0010:[<ffffffff810d00b9>] [<ffffffff810d00b9>] do_munmap+0x284/0x30e Mar 24 19:45:13 gaea kernel: [43448.696793] RSP: 0018:ffff8801f6741f08 EFLAGS: 00010286 Mar 24 19:45:13 gaea kernel: [43448.696795] RAX: ffff88010bb61c60 RBX: ffff88010bb61d10 RCX: 0000000000000000 Mar 24 19:45:13 gaea kernel: [43448.696796] RDX: f7ffffff810ce9e2 RSI: 00007f4a03e4f000 RDI: ffff880214854700 Mar 24 19:45:13 gaea kernel: [43448.696798] RBP: ffff880214854700 R08: ffff88010bb61c90 R09: 00000000ffffffff Mar 24 19:45:13 gaea kernel: [43448.696799] R10: 000000004baab338 R11: 0000000000000246 R12: ffff8801b6463bc8 Mar 24 19:45:13 gaea kernel: [43448.696801] R13: ffff88010bb61d10 R14: ffff8801b6463bb0 R15: 00007f4a03e4f000 Mar 24 19:45:13 gaea kernel: [43448.696803] FS: 00007f4a03fd46f0(0000) GS:ffff880008c80000(0000) knlGS:0000000000000000 Mar 24 19:45:13 gaea kernel: [43448.696804] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Mar 24 19:45:13 gaea kernel: [43448.696806] CR2: 00007f4a03e45000 CR3: 000000013f630000 CR4: 00000000000006e0 Mar 24 19:45:13 gaea kernel: [43448.696808] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Mar 24 19:45:13 gaea kernel: [43448.696809] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Mar 24 19:45:13 gaea kernel: [43448.696811] Process munin-graph (pid: 28208, threadinfo ffff8801f6740000, task ffff880214bef810) Mar 24 19:45:13 gaea kernel: [43448.696812] Stack: Mar 24 19:45:13 gaea kernel: [43448.696813] ffff880214854700 00007f4a03e42000 ffff880214854708 ffff880214854700 Mar 24 19:45:13 gaea kernel: [43448.696816] <0> 0000000002357f30 ffff880214854760 00007f4a03e42000 000000000000c688 Mar 24 19:45:13 gaea kernel: [43448.696818] <0> 00000000000000f0 ffffffff810d0183 0000000002357f30 00000000023579d0 Mar 24 19:45:13 gaea kernel: [43448.696821] Call Trace: Mar 24 19:45:13 gaea kernel: [43448.696823] [<ffffffff810d0183>] ? sys_munmap+0x40/0x5a Mar 24 19:45:13 gaea kernel: [43448.696827] [<ffffffff81010b42>] ? system_call_fastpath+0x16/0x1b Mar 24 19:45:13 gaea kernel: [43448.696828] Code: 00 48 8b 55 20 48 81 fa ef ed 0c 81 75 0b 4d 85 f6 74 11 49 8b 76 10 eb 0f 48 85 c0 74 06 48 8b 70 08 eb 04 48 8b 75 28 48 89 ef <ff> d2 48 c7 45 10 00 00 00 00 48 8b 4c 24 08 4d 89 f8 4c 89 f2 Mar 24 19:45:13 gaea kernel: [43448.696844] RIP [<ffffffff810d00b9>] do_munmap+0x284/0x30e Mar 24 19:45:13 gaea kernel: [43448.696846] RSP <ffff8801f6741f08> Mar 24 19:45:13 gaea kernel: [43448.696848] ---[ end trace d2df439feca95fdf ]--- Mar 24 19:50:01 gaea /USR/SBIN/CRON[28282]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) Mar 24 19:50:01 gaea /USR/SBIN/CRON[28283]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi)
# This fault resulted in: # # root 1795 0.0 0.0 22160 1052 ? Ss Mar25 0:00 /usr/sbin/cron # root 11568 0.0 0.0 45284 1420 ? S 03:05 0:00 \_ /USR/SBIN/CRON # munin 11590 0.0 0.0 3888 560 ? Ss 03:05 0:00 \_ /bin/sh -c if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi # munin 11593 0.0 0.0 3888 548 ? S 03:05 0:00 \_ /bin/sh /usr/bin/munin-cron # munin 12250 0.0 0.0 0 0 ? DN 03:05 0:00 \_ [munin-graph] # munin 12251 0.0 0.0 5896 524 ? S 03:05 0:00 \_ fgrep -v *** attempt to put segment in horiz list twice # # load was only 1+ and box was otherwise responsive, but rebooted @08:40 Mar 27 03:00:01 gaea /USR/SBIN/CRON[10818]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) Mar 27 03:00:01 gaea /USR/SBIN/CRON[10819]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) Mar 27 03:05:01 gaea /USR/SBIN/CRON[11590]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) Mar 27 03:05:01 gaea /USR/SBIN/CRON[11591]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) Mar 27 03:05:01 gaea /USR/SBIN/CRON[11592]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Mar 27 03:05:13 gaea kernel: [158179.364930] general protection fault: 0000 [#1] SMP Mar 27 03:05:13 gaea kernel: [158179.364942] last sysfs file: /sys/devices/system/cpu/cpu3/cpufreq/stats/time_in_state Mar 27 03:05:13 gaea kernel: [158179.364948] CPU 1 Mar 27 03:05:13 gaea kernel: [158179.364953] Modules linked in: ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_conntrack nf_defrag_ipv4 ppdev lp parport sco bridge stp bnep rfcomm l2cap crc16 bluetooth rfkill sit tunnel4 xt_multiport iptable_filter ip_tables x_tables tun vboxnetflt vboxnetadp vboxdrv powernow_k8 cpufreq_powersave cpufreq_userspace cpufreq_stats cpufreq_conservative binfmt_misc fuse nfsd nfs lockd fscache nfs_acl auth_rpcgss sunrpc it87 hwmon_vid loop firewire_sbp2 xfs exportfs snd_hda_codec_realtek snd_hda_intel snd_hda_codec snd_hwdep i2c_piix4 i2c_core snd_pcm_oss snd_mixer_oss snd_pcm snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq edac_core edac_mce_amd xhci pcspkr snd_timer snd_seq_device evdev snd soundcore snd_page_alloc processor ext3 jbd mbcache raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid1 md_mod ide_cd_mod cdrom ata_generic usbhid hid sg sd_mod ide_pci_generic crc_t10dif firewire_ohci atiixp firew ire_core crc_itu_t button ohci_hcd Mar 27 03:05:13 gaea kernel: ehci_hcd ide_core ahci pata_jmicron r8169 usbcore mii nls_base libata scsi_mod thermal fan thermal_sys [last unloaded: scsi_wait_scan] Mar 27 03:05:13 gaea kernel: [158179.365123] Pid: 12250, comm: munin-graph Not tainted 2.6.32-3-amd64 #1 GA-790XTA-UD4 Mar 27 03:05:13 gaea kernel: [158179.365130] RIP: 0010:[<ffffffff810ee49d>] [<ffffffff810ee49d>] __fput+0xef/0x1ae Mar 27 03:05:13 gaea kernel: [158179.365147] RSP: 0018:ffff88016b691df8 EFLAGS: 00010282 Mar 27 03:05:13 gaea kernel: [158179.365153] RAX: f7ffffffa01ecc20 RBX: 0000000000000010 RCX: 0000000000000003 Mar 27 03:05:13 gaea kernel: [158179.365159] RDX: ffff8801afc7cc00 RSI: 0000000000000010 RDI: ffff8801afc7cc00 Mar 27 03:05:13 gaea kernel: [158179.365165] RBP: ffff8801afc7cc00 R08: 0000000000000000 R09: 0000000000000000 Mar 27 03:05:13 gaea kernel: [158179.365171] R10: ffff8801afc7c3c0 R11: 0000000000000001 R12: ffff880229714840 Mar 27 03:05:13 gaea kernel: [158179.365177] R13: ffff88022975e900 R14: ffff88022975e900 R15: ffff88022c051700 Mar 27 03:05:13 gaea kernel: [158179.365185] FS: 00007f6c74f296f0(0000) GS:ffff880008c80000(0000) knlGS:0000000000000000 Mar 27 03:05:13 gaea kernel: [158179.365191] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Mar 27 03:05:13 gaea kernel: [158179.365197] CR2: 00007f6c6ebd1980 CR3: 0000000001001000 CR4: 00000000000006e0 Mar 27 03:05:13 gaea kernel: [158179.365203] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Mar 27 03:05:13 gaea kernel: [158179.365209] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Mar 27 03:05:13 gaea kernel: [158179.365216] Process munin-graph (pid: 12250, threadinfo ffff88016b690000, task ffff8801fa09e2e0) Mar 27 03:05:13 gaea kernel: [158179.365222] Stack: Mar 27 03:05:13 gaea kernel: [158179.365225] ffff880229714840 ffff88019a7efdc0 ffff88019a5918f0 ffff88019a7efdc0 Mar 27 03:05:13 gaea kernel: [158179.365234] <0> ffff88020cacce60 0000000000000000 0000000000000001 ffffffff810cf03b Mar 27 03:05:13 gaea kernel: [158179.365243] <0> ffff88020cacce60 ffff880008c8e870 ffff88020cacce00 ffffffff810cf199 Mar 27 03:05:13 gaea kernel: [158179.365253] Call Trace: Mar 27 03:05:13 gaea kernel: [158179.365263] [<ffffffff810cf03b>] ? remove_vma+0x3d/0x72 Mar 27 03:05:13 gaea kernel: [158179.365271] [<ffffffff810cf199>] ? exit_mmap+0x129/0x148 Mar 27 03:05:13 gaea kernel: [158179.365281] [<ffffffff812ef010>] ? __down_read+0x15/0xab Mar 27 03:05:13 gaea kernel: [158179.365290] [<ffffffff8104b926>] ? mmput+0x3c/0xd3 Mar 27 03:05:13 gaea kernel: [158179.365297] [<ffffffff8104f572>] ? exit_mm+0x102/0x10d Mar 27 03:05:13 gaea kernel: [158179.365305] [<ffffffff81050f74>] ? do_exit+0x1e7/0x6b5 Mar 27 03:05:13 gaea kernel: [158179.365313] [<ffffffff810514b8>] ? do_group_exit+0x76/0x9d Mar 27 03:05:13 gaea kernel: [158179.365321] [<ffffffff810514f1>] ? sys_exit_group+0x12/0x16 Mar 27 03:05:13 gaea kernel: [158179.365332] [<ffffffff81010b42>] ? system_call_fastpath+0x16/0x1b Mar 27 03:05:13 gaea kernel: [158179.365337] Code: 20 74 1f 48 8b 45 20 48 85 c0 74 16 48 8b 80 88 00 00 00 48 85 c0 74 0a 31 d2 48 89 ee 83 cf ff ff d0 48 8b 45 20 48 85 c0 74 11 <48> 8b 40 70 48 85 c0 74 08 48 89 ee 4c 89 f7 ff d0 48 89 ef e8 Mar 27 03:05:13 gaea kernel: [158179.365400] RIP [<ffffffff810ee49d>] __fput+0xef/0x1ae Mar 27 03:05:13 gaea kernel: [158179.365409] RSP <ffff88016b691df8> Mar 27 03:05:13 gaea kernel: [158179.365415] ---[ end trace 0dc2abad4f3a8341 ]--- Mar 27 03:05:13 gaea kernel: [158179.365420] Fixing recursive fault but reboot is needed! Mar 27 03:09:24 gaea smartd[1954]: Device: /dev/sdf [SAT], SMART Usage Attribute: 190 Airflow_Temperature_Cel changed from 65 to 64 Mar 27 03:09:24 gaea smartd[1954]: Device: /dev/sdf [SAT], SMART Usage Attribute: 194 Temperature_Celsius changed from 35 to 36 Mar 27 03:10:01 gaea /USR/SBIN/CRON[12355]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) Mar 27 03:10:01 gaea /USR/SBIN/CRON[12356]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi)
# This fault seems to have no residual issues; no hung processes, etc. May 17 09:25:01 gaea /USR/SBIN/CRON[27099]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) May 17 09:25:01 gaea /USR/SBIN/CRON[27100]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) May 17 09:25:01 gaea /USR/SBIN/CRON[27101]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) May 17 09:30:01 gaea /USR/SBIN/CRON[27826]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) May 17 09:30:01 gaea /USR/SBIN/CRON[27827]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) May 17 09:30:13 gaea kernel: [87324.146877] general protection fault: 0000 [#1] SMP May 17 09:30:13 gaea kernel: [87324.146881] last sysfs file: /sys/devices/system/cpu/cpu3/cpufreq/stats/time_in_state May 17 09:30:13 gaea kernel: [87324.146883] CPU 1 May 17 09:30:13 gaea kernel: [87324.146884] Modules linked in: vboxnetadp vboxnetflt vboxdrv ppdev lp parport sit tunnel4 xt_multiport iptable_filter ip_tables x_tables tun powernow_k8 cpufreq_powersave cpufreq_userspace cpufreq_stats cpufreq_conservative binfmt_misc fuse nfsd nfs lockd fscache nfs_acl auth_rpcgss sunrpc xfs exportfs it87 hwmon_vid loop firewire_sbp2 snd_hda_codec_realtek snd_hda_intel snd_hda_codec snd_hwdep snd_pcm_oss snd_mixer_oss snd_pcm snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_timer snd_seq_device i2c_piix4 nouveau ttm drm_kms_helper drm snd i2c_algo_bit i2c_core soundcore edac_core edac_mce_amd xhci tpm_tis tpm tpm_bios snd_page_alloc evdev pcspkr processor ext3 jbd mbcache raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid1 md_mod fan sr_mod usbhid hid cdrom sd_mod sg crc_t10dif ata_generic ohci_hcd ehci_hcd pata_atiixp pata_jmicron ahci r8169 mii usbcore nls_base firewire_ohci firewire_core crc_itu_t t hermal thermal_sys libata scsi_mod May 17 09:30:13 gaea kernel: button [last unloaded: scsi_wait_scan] May 17 09:30:13 gaea kernel: [87324.146929] Pid: 28500, comm: munin-graph Tainted: G B 2.6.32-5-amd64 #1 GA-790XTA-UD4 May 17 09:30:13 gaea kernel: [87324.146931] RIP: 0010:[<ffffffff810e6684>] [<ffffffff810e6684>] kfree+0x86/0xcb May 17 09:30:13 gaea kernel: [87324.146938] RSP: 0018:ffff8800cebcde98 EFLAGS: 00010086 May 17 09:30:13 gaea kernel: [87324.146939] RAX: 0000000000000001 RBX: 0000000000000286 RCX: ffffffffa01ddb68 May 17 09:30:13 gaea kernel: [87324.146941] RDX: ffff88022d80b800 RSI: ffff880008c91f00 RDI: ffffea0004afc760 May 17 09:30:13 gaea kernel: [87324.146942] RBP: ffff880156cb4000 R08: 0000000000000000 R09: f7ffffff81445930 May 17 09:30:13 gaea kernel: [87324.146944] R10: 0000000000000000 R11: 0000000000000246 R12: ffffffffa01ddb68 May 17 09:30:13 gaea kernel: [87324.146945] R13: 0000000000000000 R14: ffff8800cf21d100 R15: ffff88022b689900 May 17 09:30:13 gaea kernel: [87324.146947] FS: 00007f2b6c3f26f0(0000) GS:ffff880008c80000(0000) knlGS:0000000000000000 May 17 09:30:13 gaea kernel: [87324.146949] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 May 17 09:30:13 gaea kernel: [87324.146950] CR2: 00000000018d8028 CR3: 00000000ceaf4000 CR4: 00000000000006e0 May 17 09:30:13 gaea kernel: [87324.146951] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 May 17 09:30:13 gaea kernel: [87324.146953] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 May 17 09:30:13 gaea kernel: [87324.146955] Process munin-graph (pid: 28500, threadinfo ffff8800cebcc000, task ffff88021e1e0000) May 17 09:30:13 gaea kernel: [87324.146956] Stack: May 17 09:30:13 gaea kernel: [87324.146957] 0000000000000000 ffff8800cf21d008 ffff880156cb4008 ffffffffa01ddb68 May 17 09:30:13 gaea kernel: [87324.146959] <0> ffff8800cf21d100 ffff8800cf31a9c0 ffff880225087d80 ffff880225119a10 May 17 09:30:13 gaea kernel: [87324.146961] <0> ffff880225119a10 ffffffffa01ddbbc 0000000040000010 ffffffffa01ddbda May 17 09:30:13 gaea kernel: [87324.146964] Call Trace: May 17 09:30:13 gaea kernel: [87324.146971] [<ffffffffa01ddb68>] ? free_rb_tree_fname+0x3c/0x87 [ext3] May 17 09:30:13 gaea kernel: [87324.146975] [<ffffffffa01ddbbc>] ? ext3_htree_free_dir_info+0x9/0x12 [ext3] May 17 09:30:13 gaea kernel: [87324.146979] [<ffffffffa01ddbda>] ? ext3_release_dir+0x15/0x19 [ext3] May 17 09:30:13 gaea kernel: [87324.146982] [<ffffffff810eef6d>] ? __fput+0x100/0x1af May 17 09:30:13 gaea kernel: [87324.146985] [<ffffffff810ec3d2>] ? filp_close+0x5b/0x62 May 17 09:30:13 gaea kernel: [87324.146986] [<ffffffff810ec46d>] ? sys_close+0x94/0xcd May 17 09:30:13 gaea kernel: [87324.146990] [<ffffffff81010b42>] ? system_call_fastpath+0x16/0x1b May 17 09:30:13 gaea kernel: [87324.146991] Code: 41 5c e9 c8 59 fd ff 48 8b 4c 24 18 4c 8b 4f 10 9c 58 66 66 90 66 90 48 89 c3 fa 66 66 90 66 66 90 65 8b 04 25 a8 e3 00 00 48 98 <49> 8b b4 c1 f0 02 00 00 48 3b 7e 08 75 16 83 7e 10 00 78 10 8b May 17 09:30:13 gaea kernel: [87324.147007] RIP [<ffffffff810e6684>] kfree+0x86/0xcb May 17 09:30:13 gaea kernel: [87324.147009] RSP <ffff8800cebcde98> May 17 09:30:13 gaea kernel: [87324.147011] ---[ end trace e4f63ad9042da036 ]--- May 17 09:35:01 gaea /USR/SBIN/CRON[28547]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) May 17 09:35:01 gaea /USR/SBIN/CRON[28548]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) May 17 09:35:01 gaea /USR/SBIN/CRON[28549]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) May 17 09:40:01 gaea /USR/SBIN/CRON[29284]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) May 17 09:40:01 gaea /USR/SBIN/CRON[29285]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi)
# This fault seems to have no residual issues; no hung processes, etc. Jun 8 23:45:01 gaea /USR/SBIN/CRON[30267]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) Jun 8 23:45:01 gaea /USR/SBIN/CRON[30268]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Jun 8 23:45:01 gaea /USR/SBIN/CRON[30269]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) Jun 8 23:50:01 gaea /USR/SBIN/CRON[31019]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) Jun 8 23:50:01 gaea /USR/SBIN/CRON[31021]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) Jun 8 23:50:13 gaea kernel: [333813.257920] general protection fault: 0000 [#1] SMP Jun 8 23:50:13 gaea kernel: [333813.257924] last sysfs file: /sys/devices/system/cpu/cpu3/cpufreq/stats/time_in_state Jun 8 23:50:13 gaea kernel: [333813.257926] CPU 1 Jun 8 23:50:13 gaea kernel: [333813.257927] Modules linked in: tun sit tunnel4 xt_multiport ppdev iptable_filter ip_tables lp x_tables parport powernow_k8 cpufreq_powersave cpufreq_userspace cpufreq_stats cpufreq_conservative vboxnetadp vboxnetflt vboxdrv binfmt_misc fuse nfsd nfs lockd fscache nfs_acl auth_rpcgss sunrpc xfs exportfs it87 hwmon_vid loop firewire_sbp2 snd_hda_codec_realtek snd_hda_intel snd_hda_codec snd_hwdep snd_pcm_oss snd_mixer_oss snd_pcm snd_seq_midi snd_rawmidi snd_seq_midi_event snd_seq snd_timer snd_seq_device snd soundcore snd_page_alloc nouveau ttm drm_kms_helper tpm_tis drm i2c_algo_bit i2c_piix4 i2c_core pcspkr edac_core edac_mce_amd evdev xhci button tpm processor tpm_bios ext3 jbd mbcache raid456 async_raid6_recov async_pq raid6_pq async_xor xor async_memcpy async_tx raid1 md_mod usbhid hid sr_mod cdrom sd_mod crc_t10dif ata_generic firewire_ohci sg pata_atiixp ohci_hcd firewire_core pata_jmicron ahci crc_itu_t libata r8169 mii ehci_hcd thermal thermal_sys usbcore nls_base scsi_ Jun 8 23:50:13 gaea kernel: mod [last unloaded: scsi_wait_scan] Jun 8 23:50:13 gaea kernel: [333813.257969] Pid: 31674, comm: munin-graph Not tainted 2.6.32-5-amd64 #1 GA-790XTA-UD4 Jun 8 23:50:13 gaea kernel: [333813.257970] RIP: 0010:[<ffffffff810d0945>] [<ffffffff810d0945>] do_munmap+0x284/0x30e Jun 8 23:50:13 gaea kernel: [333813.257976] RSP: 0018:ffff880051263f08 EFLAGS: 00010286 Jun 8 23:50:13 gaea kernel: [333813.257978] RAX: ffff8800b8a0b8f0 RBX: ffff8800342079a0 RCX: 0000000000000000 Jun 8 23:50:13 gaea kernel: [333813.257979] RDX: f7ffffff810cf26e RSI: 00007ff344d4c000 RDI: ffff8800c5dee300 Jun 8 23:50:13 gaea kernel: [333813.257981] RBP: ffff8800c5dee300 R08: ffff8800b8a0b920 R09: 00000000ffffffff Jun 8 23:50:13 gaea kernel: [333813.257982] R10: 0000000000000000 R11: 0000000000000206 R12: ffff880194282228 Jun 8 23:50:13 gaea kernel: [333813.257983] R13: ffff8800342079a0 R14: ffff880194282210 R15: 0000000001d94000 Jun 8 23:50:13 gaea kernel: [333813.257985] FS: 00007ff34b8de6f0(0000) GS:ffff880008c80000(0000) knlGS:00000000f0bfab70 Jun 8 23:50:13 gaea kernel: [333813.257987] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jun 8 23:50:13 gaea kernel: [333813.257988] CR2: 0000000001d30000 CR3: 00000001e1317000 CR4: 00000000000006e0 Jun 8 23:50:13 gaea kernel: [333813.257990] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jun 8 23:50:13 gaea kernel: [333813.257991] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Jun 8 23:50:13 gaea kernel: [333813.257993] Process munin-graph (pid: 31674, threadinfo ffff880051262000, task ffff88002a004db0) Jun 8 23:50:13 gaea kernel: [333813.257994] Stack: Jun 8 23:50:13 gaea kernel: [333813.257995] 0000000001d30199 0000000001d50000 ffff8800c5dee308 0000000000044000 Jun 8 23:50:13 gaea kernel: [333813.257997] <0> 0000000001d50000 ffff8800c5dee300 0000000001d50000 ffff8800c5dee360 Jun 8 23:50:13 gaea kernel: [333813.257999] <0> 0000000000000000 ffffffff810d12f0 0000000001d94000 fffffffffffbc000 Jun 8 23:50:13 gaea kernel: [333813.258002] Call Trace: Jun 8 23:50:13 gaea kernel: [333813.258004] [<ffffffff810d12f0>] ? sys_brk+0xaa/0x105 Jun 8 23:50:13 gaea kernel: [333813.258008] [<ffffffff81010b42>] ? system_call_fastpath+0x16/0x1b Jun 8 23:50:13 gaea kernel: [333813.258010] Code: 00 48 8b 55 20 48 81 fa 7b f6 0c 81 75 0b 4d 85 f6 74 11 49 8b 76 10 eb 0f 48 85 c0 74 06 48 8b 70 08 eb 04 48 8b 75 28 48 89 ef <ff> d2 48 c7 45 10 00 00 00 00 48 8b 4c 24 08 4d 89 f8 4c 89 f2 Jun 8 23:50:13 gaea kernel: [333813.258025] RIP [<ffffffff810d0945>] do_munmap+0x284/0x30e Jun 8 23:50:13 gaea kernel: [333813.258027] RSP <ffff880051263f08> Jun 8 23:50:13 gaea kernel: [333813.258029] ---[ end trace a174d72e963ac9d5 ]--- Jun 8 23:55:01 gaea /USR/SBIN/CRON[31764]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 1 1) Jun 8 23:55:01 gaea /USR/SBIN/CRON[31765]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) Jun 8 23:55:01 gaea /USR/SBIN/CRON[31766]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi) Jun 8 23:59:01 gaea /USR/SBIN/CRON[32503]: (root) CMD (command -v debian-sa1 > /dev/null && debian-sa1 60 2) Jun 9 00:00:01 gaea /USR/SBIN/CRON[32513]: (root) CMD (if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi) Jun 9 00:00:01 gaea /USR/SBIN/CRON[32514]: (munin) CMD (if [ -x /usr/bin/munin-cron ]; then /usr/bin/munin-cron; fi)
