On Jan 16, 2007, at 9:39 AM, Scott Atchley wrote:
Unfortunately, I have no 10G machines available to test this on.
Hopefully, I will in a couple of days.
Scott
I managed to get my hands on a couple of 10G machines. Using ramfs
instead of disk, I am still only getting about 450 MB/s with pvfs2-cp.
On the client, there do not seem to be any gaps. On the server,
however, there is still a 8.5 ms gap after the receive completes and
sending a small message, followed by a 1 ms gap before another small
send, and then another 8.5 ms gap before receiving the next
unexpected message from the client.
The early expected receives start at tag 8 just like on the slower 2G
nodes.
Scott
Early expected message length 1048576 tag 8 match 0xe000000100000008
Early expected message length 1048576 tag 9 match 0xe000000100000009
Early expected message length 1048576 tag 8 match 0xe000000100000008
Early expected message length 1048576 tag 9 match 0xe000000100000009
Early expected message length 1048576 tag 8 match 0xe000000100000008
Early expected message length 1048576 tag 9 match 0xe000000100000009
Early expected message length 1048576 tag 8 match 0xe000000100000008
Early expected message length 1048576 tag 9 match 0xe000000100000009
Early expected message length 1048576 tag 8 match 0xe000000100000008
Early expected message length 1048576 tag 9 match 0xe000000100000009
Early expected message length 1048576 tag 8 match 0xe000000100000008
Early expected message length 1048576 tag 9 match 0xe000000100000009
Early expected message length 1048576 tag 8 match 0xe000000100000008
Early expected message length 1048576 tag 10 match 0xe00000010000000a
Early expected message length 1048576 tag 11 match 0xe00000010000000b
Early expected message length 1048576 tag 10 match 0xe00000010000000a
Early expected message length 1048576 tag 11 match 0xe00000010000000b
Early expected message length 1048576 tag 11 match 0xe00000010000000b
Early expected message length 1048576 tag 10 match 0xe00000010000000a
Early expected message length 1048576 tag 13 match 0xe00000010000000d
Early expected message length 1048576 tag 12 match 0xe00000010000000c
Early expected message length 1048576 tag 15 match 0xe00000010000000f
Early expected message length 1048576 tag 14 match 0xe00000010000000e
Early expected message length 1048576 tag 17 match 0xe000000100000011
Early expected message length 1048576 tag 16 match 0xe000000100000010
Early expected message length 1048576 tag 19 match 0xe000000100000013
Early expected message length 1048576 tag 18 match 0xe000000100000012
Early expected message length 1048576 tag 21 match 0xe000000100000015
Early expected message length 1048576 tag 21 match 0xe000000100000015
Early expected message length 1048576 tag 21 match 0xe000000100000015
Early expected message length 1048576 tag 20 match 0xe000000100000014
Early expected message length 1048576 tag 23 match 0xe000000100000017
Early expected message length 1048576 tag 22 match 0xe000000100000016
Early expected message length 1048576 tag 25 match 0xe000000100000019
Early expected message length 1048576 tag 24 match 0xe000000100000018
Early expected message length 1048576 tag 27 match 0xe00000010000001b
Early expected message length 1048576 tag 26 match 0xe00000010000001a
Early expected message length 1048576 tag 29 match 0xe00000010000001d
Early expected message length 1048576 tag 28 match 0xe00000010000001c
Early expected message length 1048576 tag 31 match 0xe00000010000001f
Early expected message length 1048576 tag 31 match 0xe00000010000001f
Early expected message length 1048576 tag 30 match 0xe00000010000001e
Early expected message length 1048576 tag 33 match 0xe000000100000021
Early expected message length 1048576 tag 32 match 0xe000000100000020
Early expected message length 1048576 tag 35 match 0xe000000100000023
Early expected message length 1048576 tag 34 match 0xe000000100000022
Early expected message length 1048576 tag 37 match 0xe000000100000025
Early expected message length 1048576 tag 36 match 0xe000000100000024
Early expected message length 1048576 tag 36 match 0xe000000100000024
Early expected message length 1048576 tag 39 match 0xe000000100000027
Early expected message length 1048576 tag 38 match 0xe000000100000026
Early expected message length 1048576 tag 41 match 0xe000000100000029
Early expected message length 1048576 tag 41 match 0xe000000100000029
Early expected message length 1048576 tag 40 match 0xe000000100000028
Early expected message length 1048576 tag 43 match 0xe00000010000002b
Early expected message length 1048576 tag 42 match 0xe00000010000002a
Early expected message length 1048576 tag 45 match 0xe00000010000002d
Early expected message length 1048576 tag 44 match 0xe00000010000002c
Early expected message length 1048576 tag 47 match 0xe00000010000002f
Early expected message length 1048576 tag 46 match 0xe00000010000002e
Early expected message length 1048576 tag 49 match 0xe000000100000031
Early expected message length 1048576 tag 48 match 0xe000000100000030
Early expected message length 1048576 tag 51 match 0xe000000100000033
Early expected message length 1048576 tag 51 match 0xe000000100000033
Early expected message length 1048576 tag 51 match 0xe000000100000033
Early expected message length 1048576 tag 50 match 0xe000000100000032
Early expected message length 1048576 tag 53 match 0xe000000100000035
Early expected message length 1048576 tag 52 match 0xe000000100000034
Early expected message length 1048576 tag 55 match 0xe000000100000037
Early expected message length 1048576 tag 54 match 0xe000000100000036
Early expected message length 1048576 tag 57 match 0xe000000100000039
Early expected message length 1048576 tag 56 match 0xe000000100000038
Early expected message length 1048576 tag 59 match 0xe00000010000003b
Early expected message length 1048576 tag 59 match 0xe00000010000003b
Early expected message length 1048576 tag 59 match 0xe00000010000003b
Early expected message length 1048576 tag 58 match 0xe00000010000003a
Early expected message length 1048576 tag 61 match 0xe00000010000003d
Early expected message length 1048576 tag 61 match 0xe00000010000003d
Early expected message length 1048576 tag 61 match 0xe00000010000003d
Early expected message length 1048576 tag 60 match 0xe00000010000003c
Early expected message length 1048576 tag 63 match 0xe00000010000003f
Early expected message length 1048576 tag 62 match 0xe00000010000003e
Early expected message length 1048576 tag 65 match 0xe000000100000041
Early expected message length 1048576 tag 64 match 0xe000000100000040
Early expected message length 1048576 tag 67 match 0xe000000100000043
Early expected message length 1048576 tag 66 match 0xe000000100000042
Early expected message length 1048576 tag 69 match 0xe000000100000045
Early expected message length 1048576 tag 68 match 0xe000000100000044
Early expected message length 1048576 tag 71 match 0xe000000100000047
Early expected message length 1048576 tag 71 match 0xe000000100000047
Early expected message length 1048576 tag 70 match 0xe000000100000046
Early expected message length 1048576 tag 73 match 0xe000000100000049
Early expected message length 1048576 tag 72 match 0xe000000100000048
Early expected message length 1048576 tag 75 match 0xe00000010000004b
Early expected message length 1048576 tag 74 match 0xe00000010000004a
Early expected message length 1048576 tag 77 match 0xe00000010000004d
Early expected message length 1048576 tag 76 match 0xe00000010000004c
Early expected message length 1048576 tag 79 match 0xe00000010000004f
Early expected message length 1048576 tag 78 match 0xe00000010000004e
Early expected message length 1048576 tag 81 match 0xe000000100000051
Early expected message length 1048576 tag 81 match 0xe000000100000051
Early expected message length 1048576 tag 80 match 0xe000000100000050
Early expected message length 1048576 tag 83 match 0xe000000100000053
Early expected message length 1048576 tag 82 match 0xe000000100000052
Early expected message length 1048576 tag 85 match 0xe000000100000055
Early expected message length 1048576 tag 84 match 0xe000000100000054
Early expected message length 1048576 tag 87 match 0xe000000100000057
Early expected message length 1048576 tag 86 match 0xe000000100000056
Early expected message length 1048576 tag 89 match 0xe000000100000059
Early expected message length 1048576 tag 88 match 0xe000000100000058
Early expected message length 1048576 tag 91 match 0xe00000010000005b
Early expected message length 1048576 tag 91 match 0xe00000010000005b
Early expected message length 1048576 tag 91 match 0xe00000010000005b
Early expected message length 1048576 tag 90 match 0xe00000010000005a
Early expected message length 1048576 tag 93 match 0xe00000010000005d
Early expected message length 1048576 tag 92 match 0xe00000010000005c
Early expected message length 1048576 tag 95 match 0xe00000010000005f
Early expected message length 1048576 tag 94 match 0xe00000010000005e
Early expected message length 1048576 tag 97 match 0xe000000100000061
Early expected message length 1048576 tag 96 match 0xe000000100000060
Early expected message length 1048576 tag 99 match 0xe000000100000063
Early expected message length 1048576 tag 98 match 0xe000000100000062
Early expected message length 1048576 tag 101 match
0xe000000100000065
Early expected message length 1048576 tag 101 match
0xe000000100000065
Early expected message length 1048576 tag 101 match
0xe000000100000065
Early expected message length 1048576 tag 100 match
0xe000000100000064
Early expected message length 1048576 tag 103 match
0xe000000100000067
Early expected message length 1048576 tag 102 match
0xe000000100000066
Early expected message length 1048576 tag 105 match
0xe000000100000069
Early expected message length 1048576 tag 104 match
0xe000000100000068
Early expected message length 1048576 tag 107 match
0xe00000010000006b
Early expected message length 1048576 tag 106 match
0xe00000010000006a
Early expected message length 1048576 tag 109 match
0xe00000010000006d
Early expected message length 1048576 tag 108 match
0xe00000010000006c
Early expected message length 57604 tag 110 match 0xe00000010000006e
_______________________________________________
Pvfs2-developers mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers