https://bugzilla.kernel.org/show_bug.cgi?id=30042
Summary: page allocation failure when using jumbo frames with
kvm guests
Product: Virtualization
Version: unspecified
Kernel Version: 2.6.35
Platform: All
OS/Version: Linux
Tree: Mainline
Status: NEW
Severity: low
Priority: P1
Component: kvm
AssignedTo: virtualization_...@kernel-bugs.osdl.org
ReportedBy: kernelbug_...@russenmafia.at
Regression: No
i've got a intel e1000 based network card in my ubuntu 10.10 host, using jumbo
frames (mtu 9000).
my kvm guest (ubuntu 10.10) i'm using the "virtio" network card - also
configured with jumbo frames (mtu 9000).
netio shows me about 190MB/s, which is almost double the performance i get from
the standard mtu size (1500).
the only problems i get is when rtorrent starts hash checking. it's awful slow,
cpu at 100% idle, and kernel errors appearing.
Feb 27 21:09:48 vmbuntu kernel: [348422.309070] rtorrent: page allocation
failure. order:2, mode:0x4020
Feb 27 21:09:48 vmbuntu kernel: [348422.309075] Pid: 984, comm: rtorrent Not
tainted 2.6.35-25-virtual #44-Ubuntu
Feb 27 21:09:48 vmbuntu kernel: [348422.309078] Call Trace:
Feb 27 21:09:48 vmbuntu kernel: [348422.309087] [<ffffffff81107956>]
__alloc_pages_slowpath+0x4b6/0x5a0
Feb 27 21:09:48 vmbuntu kernel: [348422.309091] [<ffffffff81107bac>]
__alloc_pages_nodemask+0x16c/0x1d0
Feb 27 21:09:48 vmbuntu kernel: [348422.309096] [<ffffffff8113f742>]
kmalloc_large_node+0x62/0xb0
Feb 27 21:09:48 vmbuntu kernel: [348422.309100] [<ffffffff8114322c>]
__kmalloc_node_track_caller+0x11c/0x1d0
Feb 27 21:09:48 vmbuntu kernel: [348422.309105] [<ffffffff814f1f81>] ?
sk_stream_alloc_skb+0x41/0x110
Feb 27 21:09:48 vmbuntu kernel: [348422.309109] [<ffffffff814a8033>]
__alloc_skb+0x83/0x170
Feb 27 21:09:48 vmbuntu kernel: [348422.309112] [<ffffffff814f1f81>]
sk_stream_alloc_skb+0x41/0x110
Feb 27 21:09:48 vmbuntu kernel: [348422.309116] [<ffffffff814f5868>]
tcp_sendmsg+0x3c8/0xa60
Feb 27 21:09:48 vmbuntu kernel: [348422.309121] [<ffffffff81071096>] ?
mod_timer+0x176/0x2d0
Feb 27 21:09:48 vmbuntu kernel: [348422.309126] [<ffffffff814a07d3>]
sock_sendmsg+0xf3/0x120
Feb 27 21:09:48 vmbuntu kernel: [348422.309129] [<ffffffff814f5c28>] ?
tcp_sendmsg+0x788/0xa60
Feb 27 21:09:48 vmbuntu kernel: [348422.309134] [<ffffffff812975f6>] ?
blkcipher_walk_next+0x1b6/0x3e0
Feb 27 21:09:48 vmbuntu kernel: [348422.309137] [<ffffffff814a07d3>] ?
sock_sendmsg+0xf3/0x120
Feb 27 21:09:48 vmbuntu kernel: [348422.309141] [<ffffffff814a0841>]
kernel_sendmsg+0x41/0x60
Feb 27 21:09:48 vmbuntu kernel: [348422.309160] [<ffffffffa0052bee>]
xs_send_kvec+0x8e/0xa0 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309177] [<ffffffffa01158be>] ?
reserve_space+0xe/0x20 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309185] [<ffffffffa0052db2>]
xs_sendpages+0x1b2/0x210 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309194] [<ffffffffa0052f4d>]
xs_tcp_send_request+0x5d/0x170 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309202] [<ffffffffa0050fb3>]
xprt_transmit+0x83/0x2f0 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309210] [<ffffffffa004e118>]
call_transmit+0xa8/0x130 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309219] [<ffffffffa00564a2>]
__rpc_execute+0xa2/0x290 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309227] [<ffffffffa0056713>]
rpc_execute+0x83/0xa0 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309235] [<ffffffffa004ec99>]
rpc_run_task+0x29/0x40 [sunrpc]
Feb 27 21:09:48 vmbuntu kernel: [348422.309244] [<ffffffffa010198f>]
nfs_read_rpcsetup+0x18f/0x1f0 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309254] [<ffffffffa01027b0>] ?
readpage_async_filler+0x0/0x160 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309264] [<ffffffffa0101dd9>]
nfs_pagein_one+0xa9/0xf0 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309272] [<ffffffffa00ff6c7>]
nfs_pageio_doio+0x37/0x80 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309281] [<ffffffffa00ff764>]
nfs_pageio_add_request+0x54/0x100 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309296] [<ffffffffa0102838>]
readpage_async_filler+0x88/0x160 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309306] [<ffffffffa01027b0>] ?
readpage_async_filler+0x0/0x160 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309311] [<ffffffff8110b49a>]
read_cache_pages+0xba/0x130
Feb 27 21:09:48 vmbuntu kernel: [348422.309425] [<ffffffffa0101676>]
nfs_readpages+0x146/0x210 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309435] [<ffffffffa0101d30>] ?
nfs_pagein_one+0x0/0xf0 [nfs]
Feb 27 21:09:48 vmbuntu kernel: [348422.309439] [<ffffffff8110b1db>]
__do_page_cache_readahead+0x13b/0x210
Feb 27 21:09:48 vmbuntu kernel: [348422.309443] [<ffffffff8110b351>]
force_page_cache_readahead+0x71/0xa0
Feb 27 21:09:48 vmbuntu kernel: [348422.309448] [<ffffffff8111b28b>]
madvise_vma+0xcb/0x210
Feb 27 21:09:48 vmbuntu kernel: [348422.309452] [<ffffffff811265f5>] ?
do_mmap_pgoff+0x335/0x380
Feb 27 21:09:48 vmbuntu kernel: [348422.309455] [<ffffffff8111b535>]
sys_madvise+0x165/0x290
Feb 27 21:09:48 vmbuntu kernel: [348422.309461] [<ffffffff8100a0f2>]
system_call_fastpath+0x16/0x1b
Feb 27 21:09:48 vmbuntu kernel: [348422.309464] Mem-Info:
Feb 27 21:09:48 vmbuntu kernel: [348422.309465] Node 0 DMA per-cpu:
Feb 27 21:09:48 vmbuntu kernel: [348422.309468] CPU 0: hi: 0, btch: 1
usd: 0
Feb 27 21:09:48 vmbuntu kernel: [348422.309469] Node 0 DMA32 per-cpu:
Feb 27 21:09:48 vmbuntu kernel: [348422.309472] CPU 0: hi: 186, btch: 31
usd: 50
Feb 27 21:09:48 vmbuntu kernel: [348422.309476] active_anon:558
inactive_anon:14286 isolated_anon:0
Feb 27 21:09:48 vmbuntu kernel: [348422.309505] active_file:62168
inactive_file:160876 isolated_file:0
Feb 27 21:09:48 vmbuntu kernel: [348422.309506] unevictable:0 dirty:0
writeback:0 unstable:0
Feb 27 21:09:48 vmbuntu kernel: [348422.309507] free:2170
slab_reclaimable:3884 slab_unreclaimable:2493
Feb 27 21:09:48 vmbuntu kernel: [348422.309508] mapped:3454 shmem:112
pagetables:1452 bounce:0
Feb 27 21:09:48 vmbuntu kernel: [348422.309510] Node 0 DMA free:4008kB min:60kB
low:72kB high:88kB active_anon:0kB inactive_anon:0kB active_file:780kB
inactive_file:10996kB unevictable:0kB isolated(anon):0kB isolated(file):0kB
present:15
700kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB
slab_reclaimable:72kB slab_unreclaimable:4kB kernel_stack:0kB pagetables:0kB
unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Feb 27 21:09:48 vmbuntu kernel: [348422.309520] lowmem_reserve[]: 0 994 994 994
Feb 27 21:09:48 vmbuntu kernel: [348422.309523] Node 0 DMA32 free:4672kB
min:4000kB low:5000kB high:6000kB active_anon:2232kB inactive_anon:57144kB
active_file:247892kB inactive_file:632508kB unevictable:0kB isolated(anon):0kB
isolated(f
ile):0kB present:1018068kB mlocked:0kB dirty:0kB writeback:0kB mapped:13816kB
shmem:448kB slab_reclaimable:15464kB slab_unreclaimable:9968kB
kernel_stack:1456kB pagetables:5808kB unstable:0kB bounce:0kB writeback_tmp:0kB
pages_scanned:0
all_unreclaimable? no
Feb 27 21:09:48 vmbuntu kernel: [348422.309532] lowmem_reserve[]: 0 0 0 0
Feb 27 21:09:48 vmbuntu kernel: [348422.309535] Node 0 DMA: 2*4kB 8*8kB 4*16kB
7*32kB 7*64kB 7*128kB 1*256kB 0*512kB 0*1024kB 1*2048kB 0*4096kB = 4008kB
Feb 27 21:09:48 vmbuntu kernel: [348422.309544] Node 0 DMA32: 392*4kB 340*8kB
3*16kB 11*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB =
4688kB
Feb 27 21:09:48 vmbuntu kernel: [348422.309552] 223212 total pagecache pages
Feb 27 21:09:48 vmbuntu kernel: [348422.309554] 43 pages in swap cache
Feb 27 21:09:48 vmbuntu kernel: [348422.309556] Swap cache stats: add 108,
delete 65, find 30135/30140
Feb 27 21:09:48 vmbuntu kernel: [348422.309557] Free swap = 976624kB
Feb 27 21:09:48 vmbuntu kernel: [348422.309559] Total swap = 976892kB
Feb 27 21:09:48 vmbuntu kernel: [348422.313348] 262125 pages RAM
Feb 27 21:09:48 vmbuntu kernel: [348422.313351] 6524 pages reserved
Feb 27 21:09:48 vmbuntu kernel: [348422.313352] 49320 pages shared
Feb 27 21:09:48 vmbuntu kernel: [348422.313353] 224583 pages non-shared
when i disable jumbo frames on the guest and host, everything works fine.
host:
ubuntu 10.10
Intel(R) Core(TM)2 Quad CPU Q6600
04:00.0 Ethernet controller: Intel Corporation 82572EI Gigabit Ethernet
Controller (Copper) (rev 06)
2.6.35-25-generic #44-Ubuntu SMP Fri Jan 21 17:40:44 UTC 2011 x86_64 GNU/Linux
QEMU PC emulator version 0.12.5 (qemu-kvm-0.12.5), Copyright (c) 2003-2008
Fabrice Bellard
guest:
ubuntu 10.10
'x86_64' machine='pc-0.12'
1 cpu configured
virtio network interface
2.6.35-25-virtual #44-Ubuntu SMP Fri Jan 21 20:39:04 UTC 2011 x86_64 GNU/Linux
--
Configure bugmail: https://bugzilla.kernel.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are watching the assignee of the bug.
--
To unsubscribe from this list: send the line "unsubscribe kvm" in
the body of a message to majord...@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
