On Jan 16, 2007, at 9:39 AM, Scott Atchley wrote:

Unfortunately, I have no 10G machines available to test this on. Hopefully, I will in a couple of days.

Scott

I managed to get my hands on a couple of 10G machines. Using ramfs instead of disk, I am still only getting about 450 MB/s with pvfs2-cp.

On the client, there do not seem to be any gaps. On the server, however, there is still a 8.5 ms gap after the receive completes and sending a small message, followed by a 1 ms gap before another small send, and then another 8.5 ms gap before receiving the next unexpected message from the client.

The early expected receives start at tag 8 just like on the slower 2G nodes.

Scott

Early expected message  length 1048576  tag 8  match 0xe000000100000008
Early expected message  length 1048576  tag 9  match 0xe000000100000009
Early expected message  length 1048576  tag 8  match 0xe000000100000008
Early expected message  length 1048576  tag 9  match 0xe000000100000009
Early expected message  length 1048576  tag 8  match 0xe000000100000008
Early expected message  length 1048576  tag 9  match 0xe000000100000009
Early expected message  length 1048576  tag 8  match 0xe000000100000008
Early expected message  length 1048576  tag 9  match 0xe000000100000009
Early expected message  length 1048576  tag 8  match 0xe000000100000008
Early expected message  length 1048576  tag 9  match 0xe000000100000009
Early expected message  length 1048576  tag 8  match 0xe000000100000008
Early expected message  length 1048576  tag 9  match 0xe000000100000009
Early expected message  length 1048576  tag 8  match 0xe000000100000008
Early expected message  length 1048576  tag 10  match 0xe00000010000000a
Early expected message  length 1048576  tag 11  match 0xe00000010000000b
Early expected message  length 1048576  tag 10  match 0xe00000010000000a
Early expected message  length 1048576  tag 11  match 0xe00000010000000b
Early expected message  length 1048576  tag 11  match 0xe00000010000000b
Early expected message  length 1048576  tag 10  match 0xe00000010000000a
Early expected message  length 1048576  tag 13  match 0xe00000010000000d
Early expected message  length 1048576  tag 12  match 0xe00000010000000c
Early expected message  length 1048576  tag 15  match 0xe00000010000000f
Early expected message  length 1048576  tag 14  match 0xe00000010000000e
Early expected message  length 1048576  tag 17  match 0xe000000100000011
Early expected message  length 1048576  tag 16  match 0xe000000100000010
Early expected message  length 1048576  tag 19  match 0xe000000100000013
Early expected message  length 1048576  tag 18  match 0xe000000100000012
Early expected message  length 1048576  tag 21  match 0xe000000100000015
Early expected message  length 1048576  tag 21  match 0xe000000100000015
Early expected message  length 1048576  tag 21  match 0xe000000100000015
Early expected message  length 1048576  tag 20  match 0xe000000100000014
Early expected message  length 1048576  tag 23  match 0xe000000100000017
Early expected message  length 1048576  tag 22  match 0xe000000100000016
Early expected message  length 1048576  tag 25  match 0xe000000100000019
Early expected message  length 1048576  tag 24  match 0xe000000100000018
Early expected message  length 1048576  tag 27  match 0xe00000010000001b
Early expected message  length 1048576  tag 26  match 0xe00000010000001a
Early expected message  length 1048576  tag 29  match 0xe00000010000001d
Early expected message  length 1048576  tag 28  match 0xe00000010000001c
Early expected message  length 1048576  tag 31  match 0xe00000010000001f
Early expected message  length 1048576  tag 31  match 0xe00000010000001f
Early expected message  length 1048576  tag 30  match 0xe00000010000001e
Early expected message  length 1048576  tag 33  match 0xe000000100000021
Early expected message  length 1048576  tag 32  match 0xe000000100000020
Early expected message  length 1048576  tag 35  match 0xe000000100000023
Early expected message  length 1048576  tag 34  match 0xe000000100000022
Early expected message  length 1048576  tag 37  match 0xe000000100000025
Early expected message  length 1048576  tag 36  match 0xe000000100000024
Early expected message  length 1048576  tag 36  match 0xe000000100000024
Early expected message  length 1048576  tag 39  match 0xe000000100000027
Early expected message  length 1048576  tag 38  match 0xe000000100000026
Early expected message  length 1048576  tag 41  match 0xe000000100000029
Early expected message  length 1048576  tag 41  match 0xe000000100000029
Early expected message  length 1048576  tag 40  match 0xe000000100000028
Early expected message  length 1048576  tag 43  match 0xe00000010000002b
Early expected message  length 1048576  tag 42  match 0xe00000010000002a
Early expected message  length 1048576  tag 45  match 0xe00000010000002d
Early expected message  length 1048576  tag 44  match 0xe00000010000002c
Early expected message  length 1048576  tag 47  match 0xe00000010000002f
Early expected message  length 1048576  tag 46  match 0xe00000010000002e
Early expected message  length 1048576  tag 49  match 0xe000000100000031
Early expected message  length 1048576  tag 48  match 0xe000000100000030
Early expected message  length 1048576  tag 51  match 0xe000000100000033
Early expected message  length 1048576  tag 51  match 0xe000000100000033
Early expected message  length 1048576  tag 51  match 0xe000000100000033
Early expected message  length 1048576  tag 50  match 0xe000000100000032
Early expected message  length 1048576  tag 53  match 0xe000000100000035
Early expected message  length 1048576  tag 52  match 0xe000000100000034
Early expected message  length 1048576  tag 55  match 0xe000000100000037
Early expected message  length 1048576  tag 54  match 0xe000000100000036
Early expected message  length 1048576  tag 57  match 0xe000000100000039
Early expected message  length 1048576  tag 56  match 0xe000000100000038
Early expected message  length 1048576  tag 59  match 0xe00000010000003b
Early expected message  length 1048576  tag 59  match 0xe00000010000003b
Early expected message  length 1048576  tag 59  match 0xe00000010000003b
Early expected message  length 1048576  tag 58  match 0xe00000010000003a
Early expected message  length 1048576  tag 61  match 0xe00000010000003d
Early expected message  length 1048576  tag 61  match 0xe00000010000003d
Early expected message  length 1048576  tag 61  match 0xe00000010000003d
Early expected message  length 1048576  tag 60  match 0xe00000010000003c
Early expected message  length 1048576  tag 63  match 0xe00000010000003f
Early expected message  length 1048576  tag 62  match 0xe00000010000003e
Early expected message  length 1048576  tag 65  match 0xe000000100000041
Early expected message  length 1048576  tag 64  match 0xe000000100000040
Early expected message  length 1048576  tag 67  match 0xe000000100000043
Early expected message  length 1048576  tag 66  match 0xe000000100000042
Early expected message  length 1048576  tag 69  match 0xe000000100000045
Early expected message  length 1048576  tag 68  match 0xe000000100000044
Early expected message  length 1048576  tag 71  match 0xe000000100000047
Early expected message  length 1048576  tag 71  match 0xe000000100000047
Early expected message  length 1048576  tag 70  match 0xe000000100000046
Early expected message  length 1048576  tag 73  match 0xe000000100000049
Early expected message  length 1048576  tag 72  match 0xe000000100000048
Early expected message  length 1048576  tag 75  match 0xe00000010000004b
Early expected message  length 1048576  tag 74  match 0xe00000010000004a
Early expected message  length 1048576  tag 77  match 0xe00000010000004d
Early expected message  length 1048576  tag 76  match 0xe00000010000004c
Early expected message  length 1048576  tag 79  match 0xe00000010000004f
Early expected message  length 1048576  tag 78  match 0xe00000010000004e
Early expected message  length 1048576  tag 81  match 0xe000000100000051
Early expected message  length 1048576  tag 81  match 0xe000000100000051
Early expected message  length 1048576  tag 80  match 0xe000000100000050
Early expected message  length 1048576  tag 83  match 0xe000000100000053
Early expected message  length 1048576  tag 82  match 0xe000000100000052
Early expected message  length 1048576  tag 85  match 0xe000000100000055
Early expected message  length 1048576  tag 84  match 0xe000000100000054
Early expected message  length 1048576  tag 87  match 0xe000000100000057
Early expected message  length 1048576  tag 86  match 0xe000000100000056
Early expected message  length 1048576  tag 89  match 0xe000000100000059
Early expected message  length 1048576  tag 88  match 0xe000000100000058
Early expected message  length 1048576  tag 91  match 0xe00000010000005b
Early expected message  length 1048576  tag 91  match 0xe00000010000005b
Early expected message  length 1048576  tag 91  match 0xe00000010000005b
Early expected message  length 1048576  tag 90  match 0xe00000010000005a
Early expected message  length 1048576  tag 93  match 0xe00000010000005d
Early expected message  length 1048576  tag 92  match 0xe00000010000005c
Early expected message  length 1048576  tag 95  match 0xe00000010000005f
Early expected message  length 1048576  tag 94  match 0xe00000010000005e
Early expected message  length 1048576  tag 97  match 0xe000000100000061
Early expected message  length 1048576  tag 96  match 0xe000000100000060
Early expected message  length 1048576  tag 99  match 0xe000000100000063
Early expected message  length 1048576  tag 98  match 0xe000000100000062
Early expected message length 1048576 tag 101 match 0xe000000100000065 Early expected message length 1048576 tag 101 match 0xe000000100000065 Early expected message length 1048576 tag 101 match 0xe000000100000065 Early expected message length 1048576 tag 100 match 0xe000000100000064 Early expected message length 1048576 tag 103 match 0xe000000100000067 Early expected message length 1048576 tag 102 match 0xe000000100000066 Early expected message length 1048576 tag 105 match 0xe000000100000069 Early expected message length 1048576 tag 104 match 0xe000000100000068 Early expected message length 1048576 tag 107 match 0xe00000010000006b Early expected message length 1048576 tag 106 match 0xe00000010000006a Early expected message length 1048576 tag 109 match 0xe00000010000006d Early expected message length 1048576 tag 108 match 0xe00000010000006c
Early expected message  length 57604  tag 110  match 0xe00000010000006e
_______________________________________________
Pvfs2-developers mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers

Reply via email to