Public bug reported:
5.542790] usb 3-1: new full speed USB device using uhci_hcd and address 2
[ 5.611076] IRQ 56/cciss0: IRQF_DISABLED is not guaranteed on shared IRQs
[ 5.611095] cciss0: <0x323a> at PCI 0000:06:00.0 IRQ 56 using DAC
[ 5.612430] blocks= 4294967296 block_size= 512
[ 5.612482] blocks= 19534817456 block_size= 512
[ 5.612576] heads=255, sectors=32, cylinders=2393973
[ 5.612577]
[ 5.612808] blocks= 19534817456 block_size= 512
[ 5.612931] heads=255, sectors=32, cylinders=2393973
[ 5.612932]
[ 5.612937] cciss/c0d0: p1 p2 p3
[ 5.669925] blocks= 2929987952 block_size= 512
[ 5.669988] heads=255, sectors=32, cylinders=359068
[ 5.669990]
[ 5.670238] blocks= 2929987952 block_size= 512
[ 5.670292] heads=255, sectors=32, cylinders=359068
[ 5.670293]
[ 5.670296] cciss/c0d1: p1
[ 5.705314] usb 3-1: configuration #1 chosen from 1 choice
[ 5.711257] usbcore: registered new interface driver hiddev
[ 5.716401] input: ServerEngines SE USB Device as
/devices/pci0000:00/0000:00:1a.0/usb3/3-1/3-1:1.0/input/input3
[ 5.716438] generic-usb 0003:0000:0000.0001: input,hidraw0: USB HID v1.11
Keyboard [ServerEngines SE USB Device] on usb-0000:00:1a.0-1/input0
[ 5.720332] input: ServerEngines SE USB Device as
/devices/pci0000:00/0000:00:1a.0/usb3/3-1/3-1:1.1/input/input4
[ 5.720376] generic-usb 0003:0000:0000.0002: input,hidraw1: USB HID v1.11
Mouse [ServerEngines SE USB Device] on usb-0000:00:1a.0-1/input1
[ 5.720385] usbcore: registered new interface driver usbhid
[ 5.720387] usbhid: v2.6:USB HID core driver
[ 5.753734] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection
[ 5.753737] igb 0000:07:00.0: eth0: (PCIe:2.5Gb/s:Width x4) 00:26:55:86:0b:5c
[ 5.753814] igb 0000:07:00.0: eth0: PBA No: ffffff-0ff
[ 5.753816] igb 0000:07:00.0: Using MSI-X interrupts. 4 rx queue(s), 4 tx
queue(s)
[ 5.754004] alloc irq_desc for 40 on node 0
[ 5.754006] alloc kstat_irqs on node 0
[ 5.754014] igb 0000:07:00.1: PCI INT B -> GSI 40 (level, low) -> IRQ 40
[ 5.754038] igb 0000:07:00.1: setting latency timer to 64
[ 5.754373] alloc irq_desc for 67 on node 0
[ 5.754375] alloc kstat_irqs on node 0
[ 5.754379] igb 0000:07:00.1: irq 67 for MSI/MSI-X
[ 5.754380] alloc irq_desc for 68 on node 0
[ 5.754381] alloc kstat_irqs on node 0
[ 5.754383] igb 0000:07:00.1: irq 68 for MSI/MSI-X
[ 5.754385] alloc irq_desc for 69 on node 0
[ 5.754386] alloc kstat_irqs on node 0
[ 5.754388] igb 0000:07:00.1: irq 69 for MSI/MSI-X
[ 5.754389] alloc irq_desc for 70 on node 0
[ 5.754391] alloc kstat_irqs on node 0
[ 5.754393] igb 0000:07:00.1: irq 70 for MSI/MSI-X
[ 5.754394] alloc irq_desc for 71 on node 0
[ 5.754396] alloc kstat_irqs on node 0
[ 5.754398] igb 0000:07:00.1: irq 71 for MSI/MSI-X
[ 5.754399] alloc irq_desc for 72 on node 0
[ 5.754400] alloc kstat_irqs on node 0
[ 5.754402] igb 0000:07:00.1: irq 72 for MSI/MSI-X
[ 5.754404] alloc irq_desc for 73 on node 0
[ 5.754405] alloc kstat_irqs on node 0
[ 5.754407] igb 0000:07:00.1: irq 73 for MSI/MSI-X
[ 5.754408] alloc irq_desc for 74 on node 0
[ 5.754410] alloc kstat_irqs on node 0
[ 5.754412] igb 0000:07:00.1: irq 74 for MSI/MSI-X
[ 5.754413] alloc irq_desc for 75 on node 0
[ 5.754414] alloc kstat_irqs on node 0
[ 5.754416] igb 0000:07:00.1: irq 75 for MSI/MSI-X
[ 5.990683] usb 5-1: new low speed USB device using uhci_hcd and address 2
[ 5.993425] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection
[ 5.993428] igb 0000:07:00.1: eth1: (PCIe:2.5Gb/s:Width x4) 00:26:55:86:0b:5d
[ 5.993505] igb 0000:07:00.1: eth1: PBA No: ffffff-0ff
[ 5.993507] igb 0000:07:00.1: Using MSI-X interrupts. 4 rx queue(s), 4 tx
queue(s)
[ 6.153403] PM: Starting manual resume from disk
[ 6.153406] PM: Resume from partition 104:2
[ 6.153408] PM: Checking hibernation image.
[ 6.153502] PM: Resume from disk failed.
[ 6.155819] EXT4-fs (cciss!c0d0p1): INFO: recovery required on readonly
filesystem
[ 6.155823] EXT4-fs (cciss!c0d0p1): write access will be enabled during
recovery
[ 6.166540] EXT4-fs (cciss!c0d0p1): barriers enabled
[ 6.181911] usb 5-1: configuration #1 chosen from 1 choice
[ 6.214935] input: USBPS2 as
/devices/pci0000:00/0000:00:1d.1/usb5/5-1/5-1:1.0/input/input5
[ 6.214974] generic-usb 0003:0D3D:0001.0003: input,hidraw2: USB HID v1.00
Keyboard [USBPS2] on usb-0000:00:1d.1-1/input0
[ 6.245961] input: USBPS2 as
/devices/pci0000:00/0000:00:1d.1/usb5/5-1/5-1:1.1/input/input6
[ 6.246008] generic-usb 0003:0D3D:0001.0004: input,hidraw3: USB HID v1.00
Mouse [USBPS2] on usb-0000:00:1d.1-1/input1
[ 6.836404] kjournald2 starting: pid 502, dev cciss!c0d0p1:8, commit
interval 5 seconds
[ 6.836414] EXT4-fs (cciss!c0d0p1): delayed allocation enabled
[ 6.836419] EXT4-fs: file extents enabled
[ 6.837884] EXT4-fs: mballoc enabled
[ 6.837894] EXT4-fs (cciss!c0d0p1): orphan cleanup on readonly fs
[ 6.837900] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 643
[ 6.855310] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 137730
[ 6.856563] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 135490
[ 6.856615] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 137586
[ 6.856645] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 137498
[ 6.856664] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 140871
[ 6.856677] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 140870
[ 6.856683] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 140860
[ 6.856689] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 140858
[ 6.856695] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 140851
[ 6.873360] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 131097
[ 6.901642] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 1609
[ 6.901668] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 1606
[ 6.901687] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 1605
[ 6.901705] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 1604
[ 6.902440] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 665
[ 6.902465] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 663
[ 6.902484] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 662
[ 6.902500] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 661
[ 6.902781] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 635
[ 6.902806] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 632
[ 6.902824] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 631
[ 6.902841] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 629
[ 6.902882] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 340
[ 6.902901] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 135470
[ 6.902914] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 135501
[ 6.902924] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 135485
[ 6.902944] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 135456
[ 6.910435] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 133314
[ 6.910462] EXT4-fs (cciss!c0d0p1): ext4_orphan_cleanup: deleting
unreferenced inode 133308
[ 6.910483] EXT4-fs (cciss!c0d0p1): 30 orphan inodes deleted
[ 6.910487] EXT4-fs (cciss!c0d0p1): recovery complete
[ 6.910889] JBD: barrier-based sync failed on cciss!c0d0p1:8 - disabling
barriers
[ 6.919758] EXT4-fs (cciss!c0d0p1): mounted filesystem with ordered data mode
[ 7.773124] Adding 7812492k swap on /dev/cciss/c0d0p2. Priority:-1
extents:1 across:7812492k
[ 7.888519] EXT4-fs (cciss!c0d0p1): internal journal on cciss!c0d0p1:8
[ 7.944778] udev: starting version 147
[ 7.988490] EXT4-fs (dm-0): barriers enabled
[ 8.027984] kjournald2 starting: pid 690, dev dm-0:8, commit interval 60
seconds
[ 8.028060] EXT4-fs (dm-0): internal journal on dm-0:8
[ 8.028065] EXT4-fs (dm-0): delayed allocation enabled
[ 8.028069] EXT4-fs: file extents enabled
[ 8.093140] EXT4-fs: mballoc enabled
[ 8.093153] EXT4-fs (dm-0): recovery complete
[ 8.093326] EXT4-fs (dm-0): mounted filesystem with writeback data mode
[ 8.236434] EXT4-fs (dm-1): barriers enabled
[ 8.273501] kjournald2 starting: pid 773, dev dm-1:8, commit interval 60
seconds
[ 8.273595] EXT4-fs (dm-1): internal journal on dm-1:8
[ 8.273600] EXT4-fs (dm-1): delayed allocation enabled
[ 8.273603] EXT4-fs: file extents enabled
[ 8.279364] ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 8.324810] EXT4-fs: mballoc enabled
[ 8.324825] EXT4-fs (dm-1): recovery complete
[ 8.324830] EXT4-fs (dm-1): mounted filesystem with writeback data mode
[ 8.327775] RPC: Registered udp transport module.
[ 8.327777] RPC: Registered tcp transport module.
[ 8.441944] lp: driver loaded but no devices found
[ 8.491390] EXT4-fs (dm-2): barriers enabled
[ 8.501552] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 8.686658] igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[ 8.687108] ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[ 8.747197] Installing knfsd (copyright (C) 1996 [email protected]).
[ 8.956607] kjournald2 starting: pid 896, dev dm-2:8, commit interval 60
seconds
[ 8.956671] EXT4-fs (dm-2): internal journal on dm-2:8
[ 8.956676] EXT4-fs (dm-2): delayed allocation enabled
[ 8.956679] EXT4-fs: file extents enabled
[ 9.053694] EXT4-fs: mballoc enabled
[ 9.053707] EXT4-fs (dm-2): recovery complete
[ 9.053803] EXT4-fs (dm-2): mounted filesystem with writeback data mode
[ 9.107354] EXT4-fs (dm-3): barriers enabled
[ 12.016354] JBD: barrier-based sync failed on cciss!c0d0p1:8 - disabling
barriers
[ 12.655424] svc: failed to register lockdv1 RPC service (errno 97).
[ 12.656195] NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery
directory
[ 12.662520] NFSD: starting 90-second grace period
[ 13.086070] kjournald2 starting: pid 1339, dev dm-3:8, commit interval 60
seconds
[ 13.086199] EXT4-fs (dm-3): internal journal on dm-3:8
[ 13.086204] EXT4-fs (dm-3): delayed allocation enabled
[ 13.086207] EXT4-fs: file extents enabled
[ 13.146772] EXT4-fs: mballoc enabled
[ 13.146783] EXT4-fs (dm-3): recovery complete
[ 13.146878] EXT4-fs (dm-3): mounted filesystem with writeback data mode
[ 13.606075] EXT4-fs (dm-4): barriers enabled
[ 14.162296] kjournald2 starting: pid 1341, dev dm-4:8, commit interval 60
seconds
[ 14.162420] EXT4-fs (dm-4): internal journal on dm-4:8
[ 14.162424] EXT4-fs (dm-4): delayed allocation enabled
[ 14.162427] EXT4-fs: file extents enabled
[ 14.192453] EXT4-fs: mballoc enabled
[ 14.192463] EXT4-fs (dm-4): recovery complete
[ 14.192610] EXT4-fs (dm-4): mounted filesystem with writeback data mode
[ 14.275172] EXT4-fs (dm-5): barriers enabled
[ 19.228186] eth0: no IPv6 routers present
[ 20.086918] kjournald2 starting: pid 1343, dev dm-5:8, commit interval 60
seconds
[ 20.086996] EXT4-fs (dm-5): internal journal on dm-5:8
[ 20.087001] EXT4-fs (dm-5): delayed allocation enabled
[ 20.087004] EXT4-fs: file extents enabled
[ 20.159720] EXT4-fs: mballoc enabled
[ 20.159732] EXT4-fs (dm-5): recovery complete
[ 20.159822] EXT4-fs (dm-5): mounted filesystem with writeback data mode
[362512.181148] INFO: task kjournald2:1341 blocked for more than 120 seconds.
[362512.181173] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[362512.181202] kjournald2 D 0000000000000000 0 1341 2 0x00000000
[362512.181207] ffff880132d49c10 0000000000000046 ffff880132d49bc0
0000000000015880
[362512.181212] ffff880132fbc7c0 0000000000015880 0000000000015880
0000000000015880
[362512.181216] 0000000000015880 ffff880132fbc7c0 0000000000015880
0000000000015880
[362512.181220] Call Trace:
[362512.181230] [<ffffffff811458c0>] ? sync_buffer+0x0/0x50
[362512.181236] [<ffffffff815255f8>] io_schedule+0x28/0x40
[362512.181239] [<ffffffff811458fb>] sync_buffer+0x3b/0x50
[362512.181243] [<ffffffff81525b17>] __wait_on_bit+0x57/0x80
[362512.181247] [<ffffffff811458c0>] ? sync_buffer+0x0/0x50
[362512.181251] [<ffffffff81525bb3>] out_of_line_wait_on_bit+0x73/0x90
[362512.181257] [<ffffffff81078650>] ? wake_bit_function+0x0/0x40
[362512.181261] [<ffffffff811458b6>] __wait_on_buffer+0x26/0x30
[362512.181266] [<ffffffff811eb91f>]
jbd2_journal_commit_transaction+0x5ef/0x10f0
[362512.181270] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[362512.181275] [<ffffffff811f13f3>] kjournald2+0x103/0x270
[362512.181278] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[362512.181282] [<ffffffff811f12f0>] ? kjournald2+0x0/0x270
[362512.181285] [<ffffffff81078226>] kthread+0xa6/0xb0
[362512.181290] [<ffffffff810130aa>] child_rip+0xa/0x20
[362512.181293] [<ffffffff81078180>] ? kthread+0x0/0xb0
[362512.181297] [<ffffffff810130a0>] ? child_rip+0x0/0x20
[362512.181300] INFO: task mysqld:24813 blocked for more than 120 seconds.
[362512.181322] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[362512.181350] mysqld D 0000000000000000 0 24813 24562 0x00000000
[362512.181354] ffff8801149edc78 0000000000000086 ffff8801149edc48
0000000000015880
[362512.181358] ffff88013403b110 0000000000015880 0000000000015880
0000000000015880
[362512.181362] 0000000000015880 ffff88013403b110 0000000000015880
0000000000015880
[362512.181366] Call Trace:
[362512.181370] [<ffffffff811f0c05>] jbd2_log_wait_commit+0xb5/0x140
[362512.181374] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[362512.181380] [<ffffffff811e91eb>] jbd2_journal_stop+0x27b/0x2c0
[362512.181384] [<ffffffff811e9ace>] ? jbd2_journal_start+0xae/0x100
[362512.181388] [<ffffffff811e9b42>] jbd2_journal_force_commit+0x22/0x30
[362512.181393] [<ffffffff811c2c22>] ext4_force_commit+0x22/0x40
[362512.181397] [<ffffffff811aff24>] ext4_write_inode+0x34/0x50
[362512.181400] [<ffffffff8113ea0c>] writeback_single_inode+0x2dc/0x450
[362512.181404] [<ffffffff8113ebae>] sync_inode+0x2e/0x50
[362512.181410] [<ffffffff811ad1c0>] ext4_sync_file+0x100/0x190
[362512.181415] [<ffffffff810e31b8>] ? do_writepages+0x28/0x50
[362512.181419] [<ffffffff81142f26>] vfs_fsync+0x86/0xf0
[362512.181423] [<ffffffff81142fc9>] do_fsync+0x39/0x60
[362512.181426] [<ffffffff81142ffe>] sys_fdatasync+0xe/0x20
[362512.181432] [<ffffffff81011fc2>] system_call_fastpath+0x16/0x1b
[362512.181435] INFO: task mysqld:24814 blocked for more than 120 seconds.
[362512.181456] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[362512.181485] mysqld D 0000000000000000 0 24814 24562 0x00000000
[362512.181489] ffff8801149159c8 0000000000000086 0000000000000001
0000000000015880
[362512.181493] ffff88013409b110 0000000000015880 0000000000015880
0000000000015880
[362512.181497] 0000000000015880 ffff88013409b110 0000000000015880
0000000000015880
[362512.181501] Call Trace:
[362512.181504] [<ffffffff811ea325>] do_get_write_access+0x305/0x5d0
[362512.181508] [<ffffffff810129ce>] ? common_interrupt+0xe/0x13
[362512.181512] [<ffffffff81078650>] ? wake_bit_function+0x0/0x40
[362512.181516] [<ffffffff811ea77c>] jbd2_journal_get_write_access+0x2c/0x50
[362512.181522] [<ffffffff811d3070>] __ext4_journal_get_write_access+0x30/0x70
[362512.181526] [<ffffffff811b23cb>] ext4_reserve_inode_write+0x6b/0x90
[362512.181529] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[362512.181533] [<ffffffff811b242c>] ext4_mark_inode_dirty+0x3c/0x1c0
[362512.181537] [<ffffffff811c4161>] ? ext4_journal_start_sb+0x1/0x90
[362512.181540] [<ffffffff811b2722>] ext4_dirty_inode+0x62/0xb0
[362512.181544] [<ffffffff8113f606>] __mark_inode_dirty+0x36/0x130
[362512.181549] [<ffffffff81133aeb>] file_update_time+0xeb/0x120
[362512.181553] [<ffffffff810dc1c0>]
__generic_file_aio_write_nolock+0x210/0x470
[362512.181557] [<ffffffff81133b53>] ? touch_atime+0x33/0x150
[362512.181561] [<ffffffff810dc540>] generic_file_aio_write+0x70/0xf0
[362512.181565] [<ffffffff810129ce>] ? common_interrupt+0xe/0x13
[362512.181569] [<ffffffff811acfa9>] ext4_file_write+0x49/0x160
[362512.181575] [<ffffffff8111e6b2>] do_sync_write+0xf2/0x130
[362512.181579] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[362512.181583] [<ffffffff81010664>] ? __switch_to+0x114/0x370
[362512.181587] [<ffffffff8104f025>] ? finish_task_switch+0x65/0x120
[362512.181593] [<ffffffff8121f321>] ? security_file_permission+0x11/0x20
[362512.181597] [<ffffffff8111e998>] vfs_write+0xb8/0x1a0
[362512.181601] [<ffffffff8111f55a>] sys_pwrite64+0x7a/0x90
[362512.181605] [<ffffffff81011fc2>] system_call_fastpath+0x16/0x1b
[367184.325486] INFO: task kjournald2:1341 blocked for more than 120 seconds.
[367184.325512] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[367184.325571] kjournald2 D 00000000ffffffff 0 1341 2 0x00000000
[367184.325577] ffff880132d49c10 0000000000000046 ffff880132d49bc0
0000000000015880
[367184.325581] ffff880132fbc7c0 0000000000015880 0000000000015880
0000000000015880
[367184.325585] 0000000000015880 ffff880132fbc7c0 0000000000015880
0000000000015880
[367184.325590] Call Trace:
[367184.325600] [<ffffffff811458c0>] ? sync_buffer+0x0/0x50
[367184.325606] [<ffffffff815255f8>] io_schedule+0x28/0x40
[367184.325610] [<ffffffff811458fb>] sync_buffer+0x3b/0x50
[367184.325613] [<ffffffff81525b17>] __wait_on_bit+0x57/0x80
[367184.325617] [<ffffffff811458c0>] ? sync_buffer+0x0/0x50
[367184.325621] [<ffffffff81525bb3>] out_of_line_wait_on_bit+0x73/0x90
[367184.325627] [<ffffffff81078650>] ? wake_bit_function+0x0/0x40
[367184.325631] [<ffffffff811458b6>] __wait_on_buffer+0x26/0x30
[367184.325636] [<ffffffff811eb91f>]
jbd2_journal_commit_transaction+0x5ef/0x10f0
[367184.325641] [<ffffffff811f13f3>] kjournald2+0x103/0x270
[367184.325645] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[367184.325649] [<ffffffff811f12f0>] ? kjournald2+0x0/0x270
[367184.325652] [<ffffffff81078226>] kthread+0xa6/0xb0
[367184.325657] [<ffffffff810130aa>] child_rip+0xa/0x20
[367184.325660] [<ffffffff81078180>] ? kthread+0x0/0xb0
[367184.325663] [<ffffffff810130a0>] ? child_rip+0x0/0x20
[367184.325667] INFO: task mysqld:24813 blocked for more than 120 seconds.
[367184.325719] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[367184.325802] mysqld D 0000000000000000 0 24813 24562 0x00000000
[367184.325806] ffff8801149edc78 0000000000000086 ffff8801149edc48
0000000000015880
[367184.325811] ffff88013403b110 0000000000015880 0000000000015880
0000000000015880
[367184.325814] 0000000000015880 ffff88013403b110 0000000000015880
0000000000015880
[367184.325818] Call Trace:
[367184.325822] [<ffffffff811f0c05>] jbd2_log_wait_commit+0xb5/0x140
[367184.325826] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[367184.325832] [<ffffffff811e91eb>] jbd2_journal_stop+0x27b/0x2c0
[367184.325836] [<ffffffff811e9ace>] ? jbd2_journal_start+0xae/0x100
[367184.325840] [<ffffffff811e9b42>] jbd2_journal_force_commit+0x22/0x30
[367184.325845] [<ffffffff811c2c22>] ext4_force_commit+0x22/0x40
[367184.325849] [<ffffffff811aff24>] ext4_write_inode+0x34/0x50
[367184.325853] [<ffffffff8113ea0c>] writeback_single_inode+0x2dc/0x450
[367184.325857] [<ffffffff8113ebae>] sync_inode+0x2e/0x50
[367184.325862] [<ffffffff811ad1c0>] ext4_sync_file+0x100/0x190
[367184.325867] [<ffffffff810e31b8>] ? do_writepages+0x28/0x50
[367184.325872] [<ffffffff81142f26>] vfs_fsync+0x86/0xf0
[367184.325875] [<ffffffff81142fc9>] do_fsync+0x39/0x60
[367184.325879] [<ffffffff81142ffe>] sys_fdatasync+0xe/0x20
[367184.325884] [<ffffffff81011fc2>] system_call_fastpath+0x16/0x1b
[367184.325887] INFO: task mysqld:24814 blocked for more than 120 seconds.
[367184.325939] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[367184.326022] mysqld D 0000000000000000 0 24814 24562 0x00000000
[367184.326026] ffff8801149159c8 0000000000000086 0000000000015880
0000000000015880
[367184.326030] ffff88013409b110 0000000000015880 0000000000015880
0000000000015880
[367184.326034] 0000000000015880 ffff88013409b110 0000000000015880
0000000000015880
[367184.326038] Call Trace:
[367184.326041] [<ffffffff811ea325>] do_get_write_access+0x305/0x5d0
[367184.326045] [<ffffffff81078650>] ? wake_bit_function+0x0/0x40
[367184.326049] [<ffffffff811ea77c>] jbd2_journal_get_write_access+0x2c/0x50
[367184.326055] [<ffffffff811d3070>] __ext4_journal_get_write_access+0x30/0x70
[367184.326058] [<ffffffff811b23cb>] ext4_reserve_inode_write+0x6b/0x90
[367184.326062] [<ffffffff811b242c>] ext4_mark_inode_dirty+0x3c/0x1c0
[367184.326066] [<ffffffff811b2722>] ext4_dirty_inode+0x62/0xb0
[367184.326069] [<ffffffff8113f606>] __mark_inode_dirty+0x36/0x130
[367184.326074] [<ffffffff81133aeb>] file_update_time+0xeb/0x120
[367184.326078] [<ffffffff810dc1c0>]
__generic_file_aio_write_nolock+0x210/0x470
[367184.326082] [<ffffffff81133b53>] ? touch_atime+0x33/0x150
[367184.326086] [<ffffffff810dc540>] generic_file_aio_write+0x70/0xf0
[367184.326090] [<ffffffff811acfa9>] ext4_file_write+0x49/0x160
[367184.326095] [<ffffffff8111e6b2>] do_sync_write+0xf2/0x130
[367184.326098] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[367184.326103] [<ffffffff8141e611>] ? apparmor_file_permission+0x1/0xd0
[367184.326108] [<ffffffff8121f321>] ? security_file_permission+0x11/0x20
[367184.326112] [<ffffffff8111e998>] vfs_write+0xb8/0x1a0
[367184.326116] [<ffffffff8111f55a>] sys_pwrite64+0x7a/0x90
[367184.326121] [<ffffffff81011fc2>] system_call_fastpath+0x16/0x1b
[380841.362877] INFO: task kjournald2:1341 blocked for more than 120 seconds.
[380841.362933] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[380841.363016] kjournald2 D 0000000000000000 0 1341 2 0x00000000
[380841.363021] ffff880132d49d10 0000000000000046 0000000000000000
0000000000015880
[380841.363026] ffff880132fbc7c0 0000000000015880 0000000000015880
0000000000015880
[380841.363030] 0000000000015880 ffff880132fbc7c0 0000000000015880
0000000000015880
[380841.363034] Call Trace:
[380841.363043] [<ffffffff811eb4da>]
jbd2_journal_commit_transaction+0x1aa/0x10f0
[380841.363050] [<ffffffff81010735>] ? __switch_to+0x1e5/0x370
[380841.363055] [<ffffffff8104f025>] ? finish_task_switch+0x65/0x120
[380841.363060] [<ffffffff815271ea>] ? _spin_lock_irqsave+0x2a/0x40
[380841.363065] [<ffffffff8106ac67>] ? lock_timer_base+0x37/0x70
[380841.363070] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[380841.363075] [<ffffffff811f13f3>] kjournald2+0x103/0x270
[380841.363079] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[380841.363083] [<ffffffff811f12f0>] ? kjournald2+0x0/0x270
[380841.363086] [<ffffffff81078226>] kthread+0xa6/0xb0
[380841.363090] [<ffffffff810130aa>] child_rip+0xa/0x20
[380841.363093] [<ffffffff81078180>] ? kthread+0x0/0xb0
[380841.363096] [<ffffffff810130a0>] ? child_rip+0x0/0x20
[380841.363100] INFO: task mysqld:24813 blocked for more than 120 seconds.
[380841.363153] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[380841.363235] mysqld D 0000000000000000 0 24813 24562 0x00000000
[380841.363239] ffff8801149ed998 0000000000000086 ffff8801149ed948
0000000000015880
[380841.363244] ffff88013403b110 0000000000015880 0000000000015880
0000000000015880
[380841.363247] 0000000000015880 ffff88013403b110 0000000000015880
0000000000015880
[380841.363251] Call Trace:
[380841.363257] [<ffffffff811e96b3>] start_this_handle+0x243/0x4a0
[380841.363261] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[380841.363265] [<ffffffff811e9ace>] jbd2_journal_start+0xae/0x100
[380841.363270] [<ffffffff811c41b8>] ext4_journal_start_sb+0x58/0x90
[380841.363275] [<ffffffff811b5b01>] ext4_da_write_begin+0xd1/0x260
[380841.363279] [<ffffffff810d9b52>] generic_perform_write+0xb2/0x1d0
[380841.363283] [<ffffffff811dfa1b>] ? ext4_xattr_get+0x5b/0x90
[380841.363288] [<ffffffff810da983>] generic_file_buffered_write+0x83/0x140
[380841.363292] [<ffffffff810dc1f0>]
__generic_file_aio_write_nolock+0x240/0x470
[380841.363297] [<ffffffff81426f44>] ? sock_common_recvmsg+0x34/0x50
[380841.363301] [<ffffffff810dc540>] generic_file_aio_write+0x70/0xf0
[380841.363306] [<ffffffff811acfa9>] ext4_file_write+0x49/0x160
[380841.363310] [<ffffffff8142793a>] ? release_sock+0xba/0xd0
[380841.363316] [<ffffffff8111e6b2>] do_sync_write+0xf2/0x130
[380841.363321] [<ffffffff810e44e0>] ? pagevec_lookup_tag+0x20/0x30
[380841.363325] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[380841.363329] [<ffffffff810129ce>] ? common_interrupt+0xe/0x13
[380841.363336] [<ffffffff8121f321>] ? security_file_permission+0x11/0x20
[380841.363340] [<ffffffff8111e998>] vfs_write+0xb8/0x1a0
[380841.363344] [<ffffffff8111f41c>] sys_write+0x4c/0x80
[380841.363348] [<ffffffff8112d32b>] ? sys_fcntl+0x6b/0x90
[380841.363352] [<ffffffff81011fc2>] system_call_fastpath+0x16/0x1b
[380841.363355] INFO: task mysqld:24814 blocked for more than 120 seconds.
[380841.363407] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[380841.363490] mysqld D 0000000000000000 0 24814 24562 0x00000000
[380841.363494] ffff880114915868 0000000000000086 ffff880114915898
0000000000015880
[380841.363498] ffff88013409b110 0000000000015880 0000000000015880
0000000000015880
[380841.363502] 0000000000015880 ffff88013409b110 0000000000015880
0000000000015880
[380841.363505] Call Trace:
[380841.363511] [<ffffffff811458c0>] ? sync_buffer+0x0/0x50
[380841.363515] [<ffffffff815255f8>] io_schedule+0x28/0x40
[380841.363519] [<ffffffff811458fb>] sync_buffer+0x3b/0x50
[380841.363522] [<ffffffff81525b17>] __wait_on_bit+0x57/0x80
[380841.363526] [<ffffffff811458c0>] ? sync_buffer+0x0/0x50
[380841.363530] [<ffffffff81525bb3>] out_of_line_wait_on_bit+0x73/0x90
[380841.363534] [<ffffffff81078650>] ? wake_bit_function+0x0/0x40
[380841.363538] [<ffffffff811458b6>] __wait_on_buffer+0x26/0x30
[380841.363541] [<ffffffff811479b2>] __block_prepare_write+0x362/0x570
[380841.363545] [<ffffffff811b35f0>] ? ext4_da_get_block_prep+0x0/0x100
[380841.363549] [<ffffffff81147d4f>] block_write_begin+0x5f/0x100
[380841.363552] [<ffffffff811b5b5d>] ext4_da_write_begin+0x12d/0x260
[380841.363556] [<ffffffff811b35f0>] ? ext4_da_get_block_prep+0x0/0x100
[380841.363561] [<ffffffff8104a76e>] ? __wake_up+0x4e/0x70
[380841.363565] [<ffffffff810d9b52>] generic_perform_write+0xb2/0x1d0
[380841.363569] [<ffffffff810da983>] generic_file_buffered_write+0x83/0x140
[380841.363573] [<ffffffff810dc1f0>]
__generic_file_aio_write_nolock+0x240/0x470
[380841.363577] [<ffffffff81133b53>] ? touch_atime+0x33/0x150
[380841.363581] [<ffffffff810dc540>] generic_file_aio_write+0x70/0xf0
[380841.363585] [<ffffffff810129ce>] ? common_interrupt+0xe/0x13
[380841.363589] [<ffffffff811acfa9>] ext4_file_write+0x49/0x160
[380841.363593] [<ffffffff8111e6b2>] do_sync_write+0xf2/0x130
[380841.363597] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[380841.363601] [<ffffffff810129ce>] ? common_interrupt+0xe/0x13
[380841.363606] [<ffffffff8121f321>] ? security_file_permission+0x11/0x20
[380841.363610] [<ffffffff8111e998>] vfs_write+0xb8/0x1a0
[380841.363613] [<ffffffff810129ce>] ? common_interrupt+0xe/0x13
[380841.363617] [<ffffffff8111f55a>] sys_pwrite64+0x7a/0x90
[380841.363621] [<ffffffff81011fc2>] ? system_call_fastpath+0x16/0x1b
[380841.363625] [<ffffffff81011fc2>] system_call_fastpath+0x16/0x1b
[386711.492959] INFO: task kjournald2:1341 blocked for more than 120 seconds.
[386711.493015] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables
this message.
[386711.493099] kjournald2 D 00000000ffffffff 0 1341 2 0x00000000
[386711.493104] ffff880132d49c10 0000000000000046 ffff880132d49bc0
0000000000015880
[386711.493108] ffff880132fbc7c0 0000000000015880 0000000000015880
0000000000015880
[386711.493112] 0000000000015880 ffff880132fbc7c0 0000000000015880
0000000000015880
[386711.493117] Call Trace:
[386711.493127] [<ffffffff811458c0>] ? sync_buffer+0x0/0x50
[386711.493133] [<ffffffff815255f8>] io_schedule+0x28/0x40
[386711.493137] [<ffffffff811458fb>] sync_buffer+0x3b/0x50
[386711.493141] [<ffffffff81525b17>] __wait_on_bit+0x57/0x80
[386711.493145] [<ffffffff811458c0>] ? sync_buffer+0x0/0x50
[386711.493149] [<ffffffff81525bb3>] out_of_line_wait_on_bit+0x73/0x90
[386711.493154] [<ffffffff81078650>] ? wake_bit_function+0x0/0x40
[386711.493158] [<ffffffff811458b6>] __wait_on_buffer+0x26/0x30
[386711.493163] [<ffffffff811eb91f>]
jbd2_journal_commit_transaction+0x5ef/0x10f0
[386711.493169] [<ffffffff811f13f3>] kjournald2+0x103/0x270
[386711.493172] [<ffffffff81078610>] ? autoremove_wake_function+0x0/0x40
[386711.493176] [<ffffffff811f12f0>] ? kjournald2+0x0/0x270
[386711.493179] [<ffffffff81078226>] kthread+0xa6/0xb0
[386711.493184] [<ffffffff810130aa>] child_rip+0xa/0x20
[386711.493187] [<ffffffff81078180>] ? kthread+0x0/0xb0
[386711.493190] [<ffffffff810130a0>] ? child_rip+0x0/0x20
[1166985.387557] SGI XFS with ACLs, security attributes, realtime, large
block/inode numbers, no debug enabled
[1166985.389803] SGI XFS Quota Management subsystem
[1166985.410348] JFS: nTxBlock = 8192, nTxLock = 65536
[1166985.445314] NTFS driver 2.1.29 [Flags: R/O MODULE].
[1166985.484103] QNX4 filesystem 0.2.3 registered.
[1166985.905925] EXT4-fs (cciss!c0d1p1): barriers enabled
[1166985.921693] kjournald2 starting: pid 18490, dev cciss!c0d1p1:8, commit
interval 5 seconds
[1166985.921708] EXT4-fs (cciss!c0d1p1): delayed allocation enabled
[1166985.921711] EXT4-fs: file extents enabled
[1166986.022744] EXT4-fs: mballoc enabled
[1166986.022759] EXT4-fs (cciss!c0d1p1): mounted filesystem with ordered data
mode
[1166986.065401] EXT4-fs: mballoc: 0 blocks 0 reqs (0 success)
[1166986.065403] EXT4-fs: mballoc: 0 extents scanned, 0 goal hits, 0 2^N hits,
0 breaks, 0 lost
[1166986.065405] EXT4-fs: mballoc: 0 generated and it took 0
[1166986.065407] EXT4-fs: mballoc: 0 preallocated, 0 discarded
r...@backuper:~# lspci
00:00.0 Host bridge: Intel Corporation 5520 I/O Hub to ESI Port (rev 13)
00:01.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root
Port 1 (rev 13)
00:03.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root
Port 3 (rev 13)
00:07.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root
Port 7 (rev 13)
00:09.0 PCI bridge: Intel Corporation 5520/5500/X58 I/O Hub PCI Express Root
Port 9 (rev 13)
00:14.0 PIC: Intel Corporation 5520/5500/X58 I/O Hub System Management
Registers (rev 13)
00:14.1 PIC: Intel Corporation 5520/5500/X58 I/O Hub GPIO and Scratch Pad
Registers (rev 13)
00:14.2 PIC: Intel Corporation 5520/5500/X58 I/O Hub Control Status and RAS
Registers (rev 13)
00:1a.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI
Controller #4
00:1a.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI
Controller #2
00:1c.0 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Port 1
00:1c.4 PCI bridge: Intel Corporation 82801JI (ICH10 Family) PCI Express Port 5
00:1d.0 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI
Controller #1
00:1d.1 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI
Controller #2
00:1d.2 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB UHCI
Controller #3
00:1d.7 USB Controller: Intel Corporation 82801JI (ICH10 Family) USB2 EHCI
Controller #1
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev 90)
00:1f.0 ISA bridge: Intel Corporation 82801JIR (ICH10R) LPC Interface Controller
00:1f.2 IDE interface: Intel Corporation 82801JI (ICH10 Family) 4 port SATA IDE
Controller
00:1f.5 IDE interface: Intel Corporation 82801JI (ICH10 Family) 2 port SATA IDE
Controller
02:00.0 VGA compatible controller: Matrox Graphics, Inc. MGA G200e [Pilot]
ServerEngines (SEP1) (rev 02)
06:00.0 RAID bus controller: Hewlett-Packard Company Smart Array G6 controllers
(rev 01)
07:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection
(rev 01)
07:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection
(rev 01)
r...@backuper:~# uptime
08:42:23 up 23 days, 14:54, 1 user, load average: 0.00, 0.00, 0.00
r...@backuper:~# mount
/dev/cciss/c0d0p1 on / type ext4 (rw,noatime,errors=remount-ro)
proc on /proc type proc (rw)
none on /sys type sysfs (rw,noexec,nosuid,nodev)
none on /sys/fs/fuse/connections type fusectl (rw)
none on /sys/kernel/debug type debugfs (rw)
none on /sys/kernel/security type securityfs (rw)
udev on /dev type tmpfs (rw,mode=0755)
none on /dev/pts type devpts (rw,noexec,nosuid,gid=5,mode=0620)
none on /dev/shm type tmpfs (rw,nosuid,nodev)
none on /var/run type tmpfs (rw,nosuid,mode=0755)
none on /var/lock type tmpfs (rw,noexec,nosuid,nodev)
none on /lib/init/rw type tmpfs (rw,nosuid,mode=0755)
/dev/mapper/vg5-mysqlbackup on /media/mysqlbackup type ext4
(rw,noatime,nodiratime,errors=remount-ro,commit=60,data=writeback)
/dev/mapper/vg5-statica on /media/statica type ext4
(rw,noatime,nodiratime,errors=remount-ro,commit=60,data=writeback)
rpc_pipefs on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
/dev/mapper/vg5-big on /media/big type ext4
(rw,noatime,nodiratime,errors=remount-ro,commit=60,data=writeback)
nfsd on /proc/fs/nfsd type nfsd (rw)
/dev/mapper/vg5-incoming on /media/incoming type ext4
(rw,noatime,nodiratime,errors=remount-ro,commit=60,data=writeback)
/dev/mapper/vg5-replica on /media/replica type ext4
(rw,noatime,nodiratime,errors=remount-ro,commit=60,data=writeback)
/dev/mapper/vg5-binlogs on /media/binlogs type ext4
(rw,noatime,nodiratime,errors=remount-ro,commit=60,data=writeback)
r...@backuper:~#
** Affects: ubuntu
Importance: Undecided
Status: New
--
kernel bug 2.6.31-17-server with hung_task_timeout_secs
https://bugs.launchpad.net/bugs/522014
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
--
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
