Hi Tom,
I have both nfsrdma client and server on 2.6.29-rc5 kernel,
nfs-utils-1.1.4. I'm using both Infinihost III (ib_mthca) and ConnectX
(mlx4_ib) HCAs
I have seen several problems during my testing at NFS Connectathon 2009
1. When I used ConnectX (mlx4_ib) HCAs on both client and server, the
client can not mount. Talking to Tom Talpey and scanning the code, I saw
that xprtrdma module is using ib_reg_phys_mr() and mlx4_ib verbs
provider does not have the implementation for this verb.
If I have client on mlx4_ib and server on ib_mthca, I hit the following
crash because of bad error handling in xprtrdma (see file attached -
mlx4_mount_problem.log)
Because of this problem, I use InfiniHost III (ib_mthca) for all of my
tests at Connectathon
2. Testing Linux nfsrdma client against both Linux and OpenSolaris
nfsrdma servers, I hit the process hung problem during the
connectathon's lock test (seeing sync_page_1.log and sync_page_2.log
attached files). I can only reproduce it when I ran connectathon more
than 500 iterations (-N 1000)
I can NOT reproduce the problem with nfs client/server over IPoIB
3. Testing openSolaris nfsrdma client against linux nfsrdma server, I
hit the following BUG_ON() right away(see file attached - svcrdma_send.log)
thanks,
-vu
Feb 19 09:22:05 vlab-004 kernel: RPC: 4 xprt_connect xprt ffff88006046f000
is not connected
Feb 19 09:22:10 vlab-004 kernel: rpcrdma: connection to 11.20.1.9:20049 closed
(-103)
Feb 19 09:22:10 vlab-004 kernel: rpcrdma: connection to 11.20.1.9:20049 on
mlx4_0, memreg 5 slots 32 ird 4
Feb 19 09:22:10 vlab-004 kernel: RPC: 4 xprt_connect_status: connection
established
Feb 19 09:22:10 vlab-004 kernel: RPC: 4 xprt_prepare_transmit
Feb 19 09:22:10 vlab-004 kernel: RPC: 4 xprt_transmit(40)
Feb 19 09:22:10 vlab-004 kernel: RPC: 4 xmit complete
Feb 19 09:22:10 vlab-004 kernel: ------------[ cut here ]------------
Feb 19 09:22:10 vlab-004 kernel: WARNING: at kernel/softirq.c:124
local_bh_enable_ip+0x40/0x96()
Feb 19 09:22:10 vlab-004 kernel: Hardware name: PDSMU
Feb 19 09:22:10 vlab-004 kernel: Modules linked in: nfs lockd nfs_acl
auth_rpcgss xprtrdma rdma_cm iw_cm ib_addr ib_ipoib ib_cm ib_sa inet_lro
ipt_REJECT xt_tcpudp iptable_filter ip_tables x_tables bridge stp ipv6 autofs4
hidp rfcomm l2cap bluetooth sunrpc iscsi_tcp libiscsi_tcp libiscsi
scsi_transport_iscsi dm_multipath sbs sbshc battery acpi_memhotplug ac
parport_pc lp parport mlx4_ib ib_mad ib_core mlx4_core sg ide_cd_mod cdrom
button serio_raw shpchp i2c_i801 i3000_edac i2c_core pcspkr rtc_cmos rtc_core
rtc_lib edac_core dm_snapshot dm_zero dm_mirror dm_region_hash dm_log dm_mod
ahci ata_piix libata sd_mod scsi_mod ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last
unloaded: microcode]
Feb 19 09:22:10 vlab-004 kernel: Pid: 4465, comm: mount.nfs Not tainted
2.6.29-rc5 #1
Feb 19 09:22:10 vlab-004 kernel: Call Trace:
Feb 19 09:22:10 vlab-004 kernel: <IRQ> [<ffffffff80239023>]
warn_slowpath+0xd8/0xf5
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff803c5939>]
e1000_maybe_stop_tx+0x1d/0x64
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8021104d>] nommu_map_single+0x0/0x4e
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff803c882e>]
e1000_xmit_frame+0xa45/0xa8c
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8022f09b>]
enqueue_task_fair+0x169/0x18c
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8022cb8f>] enqueue_task+0x48/0x51
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8022cbb2>] activate_task+0x1a/0x20
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff80486599>]
bictcp_cong_avoid+0xb/0x13e
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff804b7412>] _spin_lock_bh+0x9/0x1f
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8023d45d>]
local_bh_enable_ip+0x40/0x96
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0323f99>]
rpcrdma_conn_func+0x6d/0x7c [xprtrdma]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa03262e1>]
rpcrdma_qp_async_error_upcall+0x45/0x5a [xprtrdma]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0196f5e>]
mlx4_ib_qp_event+0xaf/0xb4 [mlx4_ib]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0164b4a>] mlx4_qp_event+0x8a/0xad
[mlx4_core]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa015d40f>] mlx4_eq_int+0x59/0x27b
[mlx4_core]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa015d640>]
mlx4_msi_x_interrupt+0xf/0x16 [mlx4_core]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8026792d>]
handle_IRQ_event+0x25/0x53
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff802690b8>]
handle_edge_irq+0xd4/0x114
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8020e0dd>] do_IRQ+0xd8/0x14f
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8020c893>] ret_from_intr+0x0/0xa
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff80267922>]
handle_IRQ_event+0x1a/0x53
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff802690b8>]
handle_edge_irq+0xd4/0x114
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8020e0dd>] do_IRQ+0xd8/0x14f
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8020c893>] ret_from_intr+0x0/0xa
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8023d77c>] __do_softirq+0x53/0x13d
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8020cfbc>] call_softirq+0x1c/0x28
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8020de78>] do_softirq+0x2c/0x6c
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8021da87>]
smp_apic_timer_interrupt+0x93/0xac
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8020c9f3>]
apic_timer_interrupt+0x13/0x20
Feb 19 09:22:10 vlab-004 kernel: <EOI> [<ffffffff8033a971>] delay_tsc+0x0/0x2e
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff80239b7e>] vprintk+0x2a0/0x2b2
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0196ea1>]
mlx4_ib_post_recv+0x152/0x160 [mlx4_ib]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa01977fd>]
mlx4_ib_post_send+0x89a/0x8ac [mlx4_ib]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff80239bde>] printk+0x4e/0x56
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa03268c0>]
rpcrdma_ep_post+0x1a6/0x1d9 [xprtrdma]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0323342>]
xprt_rdma_send_request+0xbd/0xf2 [xprtrdma]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0224982>]
xprt_transmit+0x105/0x1ba [sunrpc]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa02236a2>]
call_transmit+0x200/0x241 [sunrpc]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa02285f4>] __rpc_execute+0x73/0x207
[sunrpc]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa022298f>] rpc_run_task+0x4f/0x56
[sunrpc]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0222a2b>] rpc_call_sync+0x3e/0x5b
[sunrpc]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0222a87>] rpc_ping+0x3f/0x55
[sunrpc]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0223d59>] rpc_create+0x3e3/0x449
[sunrpc]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff80299c33>] cache_grow+0x1c9/0x206
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0229ef8>]
generic_create_cred+0x46/0xb5 [sunrpc]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa034fcc4>]
nfs_create_rpc_client+0xb5/0xfd [nfs]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa03505f9>]
nfs_create_server+0x141/0x552 [nfs]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0222c9f>]
rpc_shutdown_client+0xc7/0xd2 [sunrpc]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0222a40>] rpc_call_sync+0x53/0x5b
[sunrpc]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa0361473>] nfs_mount+0x10f/0x1a9
[nfs]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffffa03598ae>] nfs_get_sb+0x605/0x8f3
[nfs]
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff802a12dd>] vfs_kern_mount+0x90/0x11b
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff802a13bb>] do_kern_mount+0x43/0xdc
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff802b3c44>] do_mount+0x6d1/0x73a
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff802b3d37>] sys_mount+0x8a/0xcd
Feb 19 09:22:10 vlab-004 kernel: [<ffffffff8020bedb>]
system_call_fastpath+0x16/0x1b
Feb 19 09:22:10 vlab-004 kernel: ---[ end trace 4274af3cc62c771f ]---
....
Feb 12 22:07:56 mellanox-2 kernel: INFO: task bigfile:28246 blocked for more
than 480 seconds.
Feb 12 22:07:56 mellanox-2 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 12 22:07:56 mellanox-2 kernel: bigfile D ffff880028057780 0 28246
27786
Feb 12 22:07:56 mellanox-2 kernel: ffffffff805b5360 0000000000000082
0000000000000001 ffffffffa03184b1
Feb 12 22:07:56 mellanox-2 kernel: ffffffffa0344f70 ffff88013a92f120
ffff88013a92f480 0000000100638e67
Feb 12 22:07:56 mellanox-2 kernel: ffff880119557c98 ffff8801024381e8
ffff880139999740 ffffffffa03102cf
Feb 12 22:07:56 mellanox-2 kernel: Call Trace:
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffffa03184b1>]
nfs_readdata_alloc+0x30/0x92 [nfs]
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffffa03102cf>]
__put_nfs_open_context+0x23/0x7f [nfs]
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff8024fc3e>]
getnstimeofday+0x57/0xb6
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff80273472>] sync_page+0x0/0x40
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff80498e4d>] io_schedule+0x5d/0x9e
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff802734ae>] sync_page+0x3c/0x40
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff80498fc7>]
__wait_on_bit_lock+0x3e/0x84
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff8027345e>] __lock_page+0x5e/0x64
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff8024a4a8>]
wake_bit_function+0x0/0x23
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff80273502>]
find_lock_page+0x35/0x55
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff8027505c>]
filemap_fault+0x169/0x335
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff803360d4>]
prio_tree_insert+0x23/0x22a
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff80283ed6>] __do_fault+0x51/0x3bd
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff80281a68>]
vma_prio_tree_insert+0x20/0x39
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff80285e40>]
handle_mm_fault+0x328/0x6f2
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff8049c297>]
do_page_fault+0x3c7/0x74e
Feb 12 22:07:56 mellanox-2 kernel: [<ffffffff8049a41f>] page_fault+0x1f/0x30
Feb 12 22:09:02 mellanox-2 kernel: INFO: task tlock64:29564 blocked for more
than 480 seconds.
Feb 12 22:09:02 mellanox-2 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 12 22:09:02 mellanox-2 kernel: tlock64 D ffff880028097780 0 29564
29551
Feb 12 22:09:02 mellanox-2 kernel: ffff880128488de0 0000000000000082
ffff88013d5a8b80 ffff8801111cbd18
Feb 12 22:09:02 mellanox-2 kernel: 0000000000000000 ffff88013a985220
ffff88013a985580 ffff8801111cbd90
Feb 12 22:09:02 mellanox-2 kernel: ffff8801024a4840 ffffffff80273220
ffff88010fc18160 000000000000000e
Feb 12 22:09:02 mellanox-2 kernel: Call Trace:
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffff80273220>]
find_get_pages_tag+0x43/0xdd
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffffa0319049>]
nfs_block_sillyrename+0x82/0x99 [nfs]
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffff8024a47a>]
autoremove_wake_function+0x0/0x2e
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffffa030b9c5>] nfs_lookup+0xd2/0x170
[nfs]
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffffa028c1e6>] put_rpccred+0x3b/0xf3
[sunrpc]
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffffa030c399>]
nfs_permission+0xe6/0x16c [nfs]
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffff8022d9a4>] update_curr+0x6f/0xaa
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffff80235a99>]
dequeue_task_fair+0x93/0x105
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffffa030c0c8>]
nfs_do_access+0xd0/0x2bb [nfs]
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffff802ada87>] d_alloc+0x15f/0x190
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffff802a6114>]
__lookup_hash+0xf9/0x11d
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffff802a8aff>] do_unlinkat+0x59/0x14e
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffff80263e08>]
audit_syscall_entry+0x151/0x17c
Feb 12 22:09:02 mellanox-2 kernel: [<ffffffff8020bedb>]
system_call_fastpath+0x16/0x1b
Feb 12 22:16:03 mellanox-2 hald: mounted /dev/scd0 on behalf of uid 0
Feb 12 22:16:48 mellanox-2 kernel: INFO: task bigfile:28246 blocked for more
than 480 seconds.
Feb 12 22:16:48 mellanox-2 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 12 22:16:48 mellanox-2 kernel: bigfile D ffff880028057780 0 28246
27786
Feb 12 22:16:48 mellanox-2 kernel: ffffffff805b5360 0000000000000082
0000000000000001 ffffffffa03184b1
Feb 12 22:16:48 mellanox-2 kernel: ffffffffa0344f70 ffff88013a92f120
ffff88013a92f480 0000000100638e67
Feb 12 22:16:48 mellanox-2 kernel: ffff880119557c98 ffff8801024381e8
ffff880139999740 ffffffffa03102cf
Feb 12 22:16:48 mellanox-2 kernel: Call Trace:
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffffa03184b1>]
nfs_readdata_alloc+0x30/0x92 [nfs]
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffffa03102cf>]
__put_nfs_open_context+0x23/0x7f [nfs]
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff8024fc3e>]
getnstimeofday+0x57/0xb6
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff80273472>] sync_page+0x0/0x40
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff80498e4d>] io_schedule+0x5d/0x9e
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff802734ae>] sync_page+0x3c/0x40
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff80498fc7>]
__wait_on_bit_lock+0x3e/0x84
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff8027345e>] __lock_page+0x5e/0x64
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff8024a4a8>]
wake_bit_function+0x0/0x23
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff80273502>]
find_lock_page+0x35/0x55
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff8027505c>]
filemap_fault+0x169/0x335
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff803360d4>]
prio_tree_insert+0x23/0x22a
Feb 12 22:16:48 mellanox-2 kernel: [<ffffffff80283ed6>] __do_fault+0x51/0x3bd
Feb 12 22:16:49 mellanox-2 kernel: [<ffffffff80281a68>]
vma_prio_tree_insert+0x20/0x39
Feb 12 22:16:49 mellanox-2 kernel: [<ffffffff80285e40>]
handle_mm_fault+0x328/0x6f2
Feb 12 22:16:49 mellanox-2 kernel: [<ffffffff8049c297>]
do_page_fault+0x3c7/0x74e
Feb 12 22:16:49 mellanox-2 kernel: [<ffffffff8049a41f>] page_fault+0x1f/0x30
Feb 12 22:17:55 mellanox-2 kernel: INFO: task tlock64:29564 blocked for more
than 480 seconds.
Feb 12 22:17:55 mellanox-2 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 12 22:17:55 mellanox-2 kernel: tlock64 D ffff880028097780 0 29564
29551
Feb 12 22:17:55 mellanox-2 kernel: ffff880128488de0 0000000000000082
ffff88013d5a8b80 ffff8801111cbd18
Feb 12 22:17:55 mellanox-2 kernel: 0000000000000000 ffff88013a985220
ffff88013a985580 ffff8801111cbd90
Feb 12 22:17:55 mellanox-2 kernel: ffff8801024a4840 ffffffff80273220
ffff88010fc18160 000000000000000e
Feb 12 22:17:55 mellanox-2 kernel: Call Trace:
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffff80273220>]
find_get_pages_tag+0x43/0xdd
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffffa0319049>]
nfs_block_sillyrename+0x82/0x99 [nfs]
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffff8024a47a>]
autoremove_wake_function+0x0/0x2e
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffffa030b9c5>] nfs_lookup+0xd2/0x170
[nfs]
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffffa028c1e6>] put_rpccred+0x3b/0xf3
[sunrpc]
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffffa030c399>]
nfs_permission+0xe6/0x16c [nfs]
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffff8022d9a4>] update_curr+0x6f/0xaa
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffff80235a99>]
dequeue_task_fair+0x93/0x105
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffffa030c0c8>]
nfs_do_access+0xd0/0x2bb [nfs]
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffff802ada87>] d_alloc+0x15f/0x190
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffff802a6114>]
__lookup_hash+0xf9/0x11d
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffff802a8aff>] do_unlinkat+0x59/0x14e
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffff80263e08>]
audit_syscall_entry+0x151/0x17c
Feb 12 22:17:55 mellanox-2 kernel: [<ffffffff8020bedb>]
system_call_fastpath+0x16/0x1b
Feb 12 22:21:03 mellanox-2 kernel: rpcrdma: connection to 11.20.1.7:20049
closed (-103)
Feb 12 22:25:41 mellanox-2 kernel: INFO: task bigfile:28246 blocked for more
than 480 seconds.
Feb 12 22:25:41 mellanox-2 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 12 22:25:41 mellanox-2 kernel: bigfile D ffff880028057780 0 28246
27786
Feb 12 22:25:41 mellanox-2 kernel: ffffffff805b5360 0000000000000082
0000000000000001 ffffffffa03184b1
Feb 12 22:25:41 mellanox-2 kernel: ffffffffa0344f70 ffff88013a92f120
ffff88013a92f480 0000000100638e67
Feb 12 22:25:41 mellanox-2 kernel: ffff880119557c98 ffff8801024381e8
ffff880139999740 ffffffffa03102cf
Feb 12 22:25:41 mellanox-2 kernel: Call Trace:
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffffa03184b1>]
nfs_readdata_alloc+0x30/0x92 [nfs]
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffffa03102cf>]
__put_nfs_open_context+0x23/0x7f [nfs]
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff8024fc3e>]
getnstimeofday+0x57/0xb6
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff80273472>] sync_page+0x0/0x40
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff80498e4d>] io_schedule+0x5d/0x9e
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff802734ae>] sync_page+0x3c/0x40
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff80498fc7>]
__wait_on_bit_lock+0x3e/0x84
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff8027345e>] __lock_page+0x5e/0x64
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff8024a4a8>]
wake_bit_function+0x0/0x23
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff80273502>]
find_lock_page+0x35/0x55
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff8027505c>]
filemap_fault+0x169/0x335
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff803360d4>]
prio_tree_insert+0x23/0x22a
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff80283ed6>] __do_fault+0x51/0x3bd
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff80281a68>]
vma_prio_tree_insert+0x20/0x39
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff80285e40>]
handle_mm_fault+0x328/0x6f2
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff8049c297>]
do_page_fault+0x3c7/0x74e
Feb 12 22:25:41 mellanox-2 kernel: [<ffffffff8049a41f>] page_fault+0x1f/0x30
Feb 12 22:26:48 mellanox-2 kernel: INFO: task tlock64:29564 blocked for more
than 480 seconds.
Feb 12 22:26:48 mellanox-2 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 12 22:26:48 mellanox-2 kernel: tlock64 D ffff880028097780 0 29564
29551
Feb 12 22:26:48 mellanox-2 kernel: ffff880128488de0 0000000000000082
ffff88013d5a8b80 ffff8801111cbd18
Feb 12 22:26:48 mellanox-2 kernel: 0000000000000000 ffff88013a985220
ffff88013a985580 ffff8801111cbd90
Feb 12 22:26:48 mellanox-2 kernel: ffff8801024a4840 ffffffff80273220
ffff88010fc18160 000000000000000e
Feb 12 22:26:48 mellanox-2 kernel: Call Trace:
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffff80273220>]
find_get_pages_tag+0x43/0xdd
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffffa0319049>]
nfs_block_sillyrename+0x82/0x99 [nfs]
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffff8024a47a>]
autoremove_wake_function+0x0/0x2e
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffffa030b9c5>] nfs_lookup+0xd2/0x170
[nfs]
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffffa028c1e6>] put_rpccred+0x3b/0xf3
[sunrpc]
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffffa030c399>]
nfs_permission+0xe6/0x16c [nfs]
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffff8022d9a4>] update_curr+0x6f/0xaa
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffff80235a99>]
dequeue_task_fair+0x93/0x105
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffffa030c0c8>]
nfs_do_access+0xd0/0x2bb [nfs]
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffff802ada87>] d_alloc+0x15f/0x190
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffff802a6114>]
__lookup_hash+0xf9/0x11d
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffff802a8aff>] do_unlinkat+0x59/0x14e
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffff80263e08>]
audit_syscall_entry+0x151/0x17c
Feb 12 22:26:48 mellanox-2 kernel: [<ffffffff8020bedb>]
system_call_fastpath+0x16/0x1b
Feb 12 22:28:16 mellanox-2 kernel: RPC: failed to contact local rpcbind server
(errno 5).
...
Feb 12 18:34:59 mellanox-2 kernel: INFO: task tlocklfs:16954 blocked for more
than 480 seconds.
Feb 12 18:34:59 mellanox-2 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 12 18:34:59 mellanox-2 kernel: tlocklfs D ffff8800280b7780 0 16954
16947
Feb 12 18:34:59 mellanox-2 kernel: ffff88013eb8f610 0000000000000086
0000001e00000002 ffff8801109a9ac8
Feb 12 18:34:59 mellanox-2 kernel: 0000000000000000 ffff88013d5c67f0
ffff88013d5c6b50 000000010008fb9e
Feb 12 18:34:59 mellanox-2 kernel: 0000000000000001 ffffffff80273220
0a0000000000001e 000000000000000e
Feb 12 18:34:59 mellanox-2 kernel: Call Trace:
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffff80273220>]
find_get_pages_tag+0x43/0xdd
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffff8024fc3e>]
getnstimeofday+0x57/0xb6
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffff80273472>] sync_page+0x0/0x40
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffff80498e4d>] io_schedule+0x5d/0x9e
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffff802734ae>] sync_page+0x3c/0x40
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffff804990c5>] __wait_on_bit+0x40/0x6f
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffff802735cb>]
wait_on_page_bit+0x6c/0x72
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffff8024a4a8>]
wake_bit_function+0x0/0x23
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffff8027ad82>]
pagevec_lookup_tag+0x1a/0x21
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffff80273982>]
wait_on_page_writeback_range+0x66/0x113
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffffa0324a41>]
nfs_writepages+0x75/0x97 [nfs]
Feb 12 18:34:59 mellanox-2 kernel: [<ffffffffa031b542>]
nfs_write_inode+0x19/0x4e [nfs]
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff802b6d98>]
__writeback_single_inode+0x190/0x294
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffffa032138c>]
nfs_pageio_doio+0x2a/0x51 [nfs]
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffffa0324a41>]
nfs_writepages+0x75/0x97 [nfs]
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff802b6f16>]
write_inode_now+0x7a/0xbd
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff802b6feb>]
generic_osync_inode+0x92/0xd4
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff80274441>]
sync_page_range+0x5e/0x9f
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff80274528>]
generic_file_aio_write+0xa6/0xc1
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffffa031979f>]
nfs_file_write+0x109/0x17c [nfs]
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff8029ed07>]
do_sync_write+0xc9/0x10c
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff8024a47a>]
autoremove_wake_function+0x0/0x2e
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff802b0759>]
notify_change+0x2b6/0x2c9
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff8029f403>] vfs_write+0xad/0x136
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff8029f920>] sys_write+0x45/0x6e
Feb 12 18:35:00 mellanox-2 kernel: [<ffffffff8020bedb>]
system_call_fastpath+0x16/0x1b
Feb 12 18:38:04 mellanox-2 avahi-daemon[12062]: Invalid query packet.
Feb 12 18:43:51 mellanox-2 kernel: INFO: task tlocklfs:16954 blocked for more
than 480 seconds.
Feb 12 18:43:51 mellanox-2 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 12 18:43:51 mellanox-2 kernel: tlocklfs D ffff8800280b7780 0 16954
16947
Feb 12 18:43:51 mellanox-2 kernel: ffff88013eb8f610 0000000000000086
0000001e00000002 ffff8801109a9ac8
Feb 12 18:43:51 mellanox-2 kernel: 0000000000000000 ffff88013d5c67f0
ffff88013d5c6b50 000000010008fb9e
Feb 12 18:43:51 mellanox-2 kernel: 0000000000000001 ffffffff80273220
0a0000000000001e 000000000000000e
Feb 12 18:43:51 mellanox-2 kernel: Call Trace:
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff80273220>]
find_get_pages_tag+0x43/0xdd
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff8024fc3e>]
getnstimeofday+0x57/0xb6
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff80273472>] sync_page+0x0/0x40
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff80498e4d>] io_schedule+0x5d/0x9e
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff802734ae>] sync_page+0x3c/0x40
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff804990c5>] __wait_on_bit+0x40/0x6f
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff802735cb>]
wait_on_page_bit+0x6c/0x72
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff8024a4a8>]
wake_bit_function+0x0/0x23
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff8027ad82>]
pagevec_lookup_tag+0x1a/0x21
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff80273982>]
wait_on_page_writeback_range+0x66/0x113
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffffa0324a41>]
nfs_writepages+0x75/0x97 [nfs]
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffffa031b542>]
nfs_write_inode+0x19/0x4e [nfs]
Feb 12 18:43:51 mellanox-2 kernel: [<ffffffff802b6d98>]
__writeback_single_inode+0x190/0x294
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffffa032138c>]
nfs_pageio_doio+0x2a/0x51 [nfs]
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffffa0324a41>]
nfs_writepages+0x75/0x97 [nfs]
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffff802b6f16>]
write_inode_now+0x7a/0xbd
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffff802b6feb>]
generic_osync_inode+0x92/0xd4
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffff80274441>]
sync_page_range+0x5e/0x9f
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffff80274528>]
generic_file_aio_write+0xa6/0xc1
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffffa031979f>]
nfs_file_write+0x109/0x17c [nfs]
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffff8029ed07>]
do_sync_write+0xc9/0x10c
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffff8024a47a>]
autoremove_wake_function+0x0/0x2e
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffff802b0759>]
notify_change+0x2b6/0x2c9
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffff8029f403>] vfs_write+0xad/0x136
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffff8029f920>] sys_write+0x45/0x6e
Feb 12 18:43:52 mellanox-2 kernel: [<ffffffff8020bedb>]
system_call_fastpath+0x16/0x1b
Feb 12 18:52:44 mellanox-2 kernel: INFO: task tlocklfs:16954 blocked for more
than 480 seconds.
Feb 12 18:52:44 mellanox-2 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 12 18:52:44 mellanox-2 kernel: tlocklfs D ffff8800280b7780 0 16954
16947
Feb 12 18:52:44 mellanox-2 kernel: tlocklfs D ffff8800280b7780 0 16954
16947
Feb 12 18:52:44 mellanox-2 kernel: ffff88013eb8f610 0000000000000086
0000001e00000002 ffff8801109a9ac8
Feb 12 18:52:44 mellanox-2 kernel: 0000000000000000 ffff88013d5c67f0
ffff88013d5c6b50 000000010008fb9e
Feb 12 18:52:44 mellanox-2 kernel: 0000000000000001 ffffffff80273220
0a0000000000001e 000000000000000e
Feb 12 18:52:44 mellanox-2 kernel: Call Trace:
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff80273220>]
find_get_pages_tag+0x43/0xdd
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff8024fc3e>]
getnstimeofday+0x57/0xb6
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff80273472>] sync_page+0x0/0x40
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff80498e4d>] io_schedule+0x5d/0x9e
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff802734ae>] sync_page+0x3c/0x40
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff804990c5>] __wait_on_bit+0x40/0x6f
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff802735cb>]
wait_on_page_bit+0x6c/0x72
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff8024a4a8>]
wake_bit_function+0x0/0x23
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff8027ad82>]
pagevec_lookup_tag+0x1a/0x21
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff80273982>]
wait_on_page_writeback_range+0x66/0x113
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffffa0324a41>]
nfs_writepages+0x75/0x97 [nfs]
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffffa031b542>]
nfs_write_inode+0x19/0x4e [nfs]
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff802b6d98>]
__writeback_single_inode+0x190/0x294
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffffa032138c>]
nfs_pageio_doio+0x2a/0x51 [nfs]
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffffa0324a41>]
nfs_writepages+0x75/0x97 [nfs]
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff802b6f16>]
write_inode_now+0x7a/0xbd
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff802b6feb>]
generic_osync_inode+0x92/0xd4
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff80274441>]
sync_page_range+0x5e/0x9f
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff80274528>]
generic_file_aio_write+0xa6/0xc1
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffffa031979f>]
nfs_file_write+0x109/0x17c [nfs]
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff8029ed07>]
do_sync_write+0xc9/0x10c
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff8024a47a>]
autoremove_wake_function+0x0/0x2e
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff802b0759>]
notify_change+0x2b6/0x2c9
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff8029f403>] vfs_write+0xad/0x136
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff8029f920>] sys_write+0x45/0x6e
Feb 12 18:52:44 mellanox-2 kernel: [<ffffffff8020bedb>]
system_call_fastpath+0x16/0x1b
Feb 12 19:01:36 mellanox-2 kernel: INFO: task tlocklfs:16954 blocked for more
than 480 seconds.
Feb 12 19:01:36 mellanox-2 kernel: "echo 0 >
/proc/sys/kernel/hung_task_timeout_secs" disables this message.
Feb 12 19:01:37 mellanox-2 kernel: tlocklfs D ffff8800280b7780 0 16954
16947
Feb 12 19:01:37 mellanox-2 kernel: ffff88013eb8f610 0000000000000086
0000001e00000002 ffff8801109a9ac8
Feb 12 19:01:37 mellanox-2 kernel: 0000000000000000 ffff88013d5c67f0
ffff88013d5c6b50 000000010008fb9e
Feb 12 19:01:37 mellanox-2 kernel: 0000000000000001 ffffffff80273220
0a0000000000001e 000000000000000e
Feb 12 19:01:37 mellanox-2 kernel: Call Trace:
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff80273220>]
find_get_pages_tag+0x43/0xdd
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff8024fc3e>]
getnstimeofday+0x57/0xb6
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff80273472>] sync_page+0x0/0x40
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff80498e4d>] io_schedule+0x5d/0x9e
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff802734ae>] sync_page+0x3c/0x40
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff804990c5>] __wait_on_bit+0x40/0x6f
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff802735cb>]
wait_on_page_bit+0x6c/0x72
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff8024a4a8>]
wake_bit_function+0x0/0x23
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff8027ad82>]
pagevec_lookup_tag+0x1a/0x21
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff80273982>]
wait_on_page_writeback_range+0x66/0x113
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffffa0324a41>]
nfs_writepages+0x75/0x97 [nfs]
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffffa031b542>]
nfs_write_inode+0x19/0x4e [nfs]
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff802b6d98>]
__writeback_single_inode+0x190/0x294
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffffa032138c>]
nfs_pageio_doio+0x2a/0x51 [nfs]
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffffa0324a41>]
nfs_writepages+0x75/0x97 [nfs]
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff802b6f16>]
write_inode_now+0x7a/0xbd
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff802b6feb>]
generic_osync_inode+0x92/0xd4
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff80274441>]
sync_page_range+0x5e/0x9f
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff80274528>]
generic_file_aio_write+0xa6/0xc1
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffffa031979f>]
nfs_file_write+0x109/0x17c [nfs]
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff8029ed07>]
do_sync_write+0xc9/0x10c
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff8024a47a>]
autoremove_wake_function+0x0/0x2e
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff802b0759>]
notify_change+0x2b6/0x2c9
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff8029f403>] vfs_write+0xad/0x136
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff8029f920>] sys_write+0x45/0x6e
Feb 12 19:01:37 mellanox-2 kernel: [<ffffffff8020bedb>]
system_call_fastpath+0x16/0x1b
Feb 20 08:44:15 mellanox-1 kernel: ------------[ cut here ]------------
Feb 20 08:44:15 mellanox-1 kernel: kernel BUG at
net/sunrpc/xprtrdma/svc_rdma_sendto.c:238!
Feb 20 08:44:15 mellanox-1 kernel: invalid opcode: 0000 [#1] SMP
Feb 20 08:44:15 mellanox-1 kernel: last sysfs file:
/sys/devices/pci0000:00/0000:00:09.0/0000:05:00.0/0000:06:02.0/0000:08:00.1/irq
Feb 20 08:44:15 mellanox-1 kernel: CPU 7
Feb 20 08:44:15 mellanox-1 kernel: Modules linked in: xprtrdma nfs svcrdma nfsd
lockd nfs_acl auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc
ib_ipoib inet_lro rdma_ucm ib_ucm ib_uverbs ib_umad rdma_cm ib_cm iw_cm ib_addr
ipv6 ib_sa mlx4_ib dm_mirror dm_region_hash dm_log dm_multipath dm_mod raid0
sbs sbshc battery acpi_memhotplug ac parport_pc lp parport ib_mthca ib_mad
ib_core e1000e sg button mlx4_core serio_raw rtc_cmos rtc_core rtc_lib i2c_i801
i2c_core shpchp pcspkr ata_piix libata mptsas mptscsih scsi_transport_sas
mptbase sd_mod scsi_mod ext3 jbd uhci_hcd ohci_hcd ehci_hcd [last unloaded:
microcode]
Feb 20 08:44:15 mellanox-1 kernel: Pid: 14550, comm: nfsd Not tainted
2.6.29-rc5 #1 X7DWE
Feb 20 08:44:15 mellanox-1 kernel: RIP: 0010:[<ffffffffa039ade2>]
[<ffffffffa039ade2>] svc_rdma_sendto+0x62e/0xfa4 [svcrdma]
Feb 20 08:44:15 mellanox-1 kernel: RSP: 0018:ffff88020f4d7c70 EFLAGS: 00010202
Feb 20 08:44:15 mellanox-1 kernel: RAX: 0000000000000004 RBX: 0000000000000000
RCX: 0000000000000001
Feb 20 08:44:15 mellanox-1 kernel: RDX: ffff8801f058f080 RSI: 0000000000000000
RDI: 0000000000000005
Feb 20 08:44:15 mellanox-1 kernel: RBP: 00000000fffffff2 R08: 0000000000000010
R09: 0000000000000088
Feb 20 08:44:15 mellanox-1 kernel: R10: ffff88020f0c3138 R11: ffff88022c4dc000
R12: ffff88022152d000
Feb 20 08:44:15 mellanox-1 kernel: R13: ffff88020f0dc140 R14: ffff88022152d000
R15: ffff8801ef4b6f40
Feb 20 08:44:15 mellanox-1 kernel: FS: 0000000000000000(0000)
GS:ffff88022e1044c0(0000) knlGS:0000000000000000
Feb 20 08:44:15 mellanox-1 kernel: CS: 0010 DS: 0018 ES: 0018 CR0:
000000008005003b
Feb 20 08:44:15 mellanox-1 kernel: CR2: 00007f9eb68bb000 CR3: 000000022e0d6000
CR4: 00000000000006e0
Feb 20 08:44:15 mellanox-1 kernel: DR0: 0000000000000000 DR1: 0000000000000000
DR2: 0000000000000000
Feb 20 08:44:15 mellanox-1 kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0
DR7: 0000000000000400
Feb 20 08:44:15 mellanox-1 kernel: Process nfsd (pid: 14550, threadinfo
ffff88020f4d6000, task ffff88021e4846f0)
Feb 20 08:44:15 mellanox-1 kernel: Stack:
Feb 20 08:44:15 mellanox-1 kernel: ffff880221524800 ffffffff802b748f
ffff8801ebc82190 ffff88020f0dc000
Feb 20 08:44:15 mellanox-1 kernel: ffff880221524800 0000000000000ffc
0000000000000000 ffffffff802b0177
Feb 20 08:44:15 mellanox-1 kernel: ffff88021e8c0580 0000000000000020
0000000000000000 0000006400000000
Feb 20 08:44:15 mellanox-1 kernel: Call Trace:
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffff802b748f>] ?
__mark_inode_dirty+0x29/0x16b
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffff802b0177>] ?
touch_atime+0x109/0x112
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffff802b81b7>] ?
splice_direct_to_actor+0x136/0x199
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffffa035a4ab>] ?
nfsd_direct_splice_actor+0x0/0x13 [nfsd]
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffff802a1ee7>] ? vfs_getattr+0x53/0x5e
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffffa036282f>] ?
encode_fattr3+0x175/0x185 [nfsd]
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffffa03628aa>] ?
encode_post_op_attr+0x6b/0x84 [nfsd]
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffffa02c7b9f>] ? svc_send+0x57/0x96
[sunrpc]
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffffa02bf297>] ?
svc_process+0x471/0x6ea [sunrpc]
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffff8049a01c>] ? __down_read+0x12/0x8b
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffffa035683c>] ? nfsd+0x1ae/0x27a
[nfsd]
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffffa035668e>] ? nfsd+0x0/0x27a [nfsd]
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffff8024a34a>] ? kthread+0x47/0x75
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffff8020ceba>] ? child_rip+0xa/0x20
Feb 20 08:44:15 mellanox-1 kernel: [<ffffffff8024a303>] ? kthread+0x0/0x75
_______________________________________________
general mailing list
[email protected]
http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
