Hi,
I've set up an iSCSI COMSTAR 8T LUN (RAID 10) on an x4500 running snv_134
I'm doing tests with Bonnie++ and simple dd's.
My network between the x4500 and Linux box is 10Gbit, direct connect, Jumbo
frames, and using iperf, I see speeds of 5Gbits/sec both ways.
If I use a Linux initiator (ext3), I get 194Mbytes/sec write speed, but only 45
Mbytes/sec read speed.
If I use Windows 2008 (NTFS) initiator on a 1Gbit network, I get 95Mbytes/sec
write speed, but only 55 Mbytes/sec read speed, (using a 1Tbye Lun)
If I use an openSolaris initiator, on a 1Gbit network, I can get 100Mb/sec
write and read speed, - just tested with dd
I've tried with Nagle's algorithm disabled on server - no difference.
It also made no difference when done on the openSolaris client.
In Linux, it's compiled into the iscsi initiator and it's disabled.
I just tested with NFS, and I get 370 Mbytes/second read and write from my
Linux box, using the same equipment at both ends.
Anyone know, why iSCSI should be so slow, especially the read speed on Linux
and Windows
Regards
John
Tests:
iSCSI
Write:
dd if=/dev/zero of=100Gx bs=8192k count=12500 540.174 seconds, 194 MB/s
Read:
Nagles algorith on:
dd if=100Ga of=/dev/null bs=1024k 2806.15 seconds, 37.4 MB/s
dd if=100Gb of=/dev/null bs=2048k 2376.15 seconds, 44.1 MB/s
dd if=100Ga of=/dev/null bs=4096k 2133.34 seconds, 49.2 MB/s
dd if=100Gb of=/dev/null bs=8192k 2163.47 seconds, 48.5 MB/s
dd if=100Gb of=/dev/null bs=32384k 2329.03 seconds, 45.0 MB/s
Nagles algorith off: (ndd -set /dev/tcp tcp_naglim_def 1)
dd if=100Ga of=/dev/null bs=1024k 2194.58 seconds, 47.8 MB/s
dd if=100Gb of=/dev/null bs=2048k 2360.44 seconds, 44.4 MB/s
dd if=100Ga of=/dev/null bs=4096k 2153.25 seconds, 48.7 MB/s
dd if=100Gb of=/dev/null bs=8192k 2364.61 seconds, 44.3 MB/s
dd if=100Ga of=/dev/null bs=16384k 2191.67 seconds, 47.8 MB/s
Bonnie:
Version 1.03 ------Sequential Output------ --Sequential Input- --Random-
-Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
bs-hpsvr01 63G 70009 86 90998 24 24509 4 32604 50 41884 2 763.2 1
------Sequential Create------ --------Random Create--------
-Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
bs-hpsvr01
,63G,70009,86,90998,24,24509,4,32604,50,41884,2,763.2,1,16,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++
NFS write: - Nagles algorithm off
dd if=/dev/zero of=100Ga bs=8192k count=12500 331.563 seconds, 316 MB/s
dd if=/dev/zero of=100Gb bs=8192k count=12500 317.991 seconds, 330 MB/s
NFS reads:
dd if=100Ga of=/dev/null bs=4096k 280.927 seconds, 373 MB/s
dd if=100Gb of=/dev/null bs=8192k 280.444 seconds, 374 MB/s
NFS reads: - Nagles algorithm on
dd if=100Ga of=/dev/null bs=8192k 289.565 seconds, 362 MB/s
_______________________________________________
storage-discuss mailing list
storage-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/storage-discuss
