We are using Cisco and Force10 10Gb switches here at Michigan to do the
opposite, 10Gb clients accessing many 1Gb storage nodes. One thing
we've found (and it is worse with our Cisco switch) is that the switch
can run out of buffer space when packets switch from the 1Gb ports to
the 10Gb port, and packets are dropped. 1Gb to 1Gb is good, 10Gb to
10Gb is good, but 1Gb to 10Gb doesn't work so well (this is our read
throughput benchmark). The best throughput we've been able to get is
around 4Gb/s in this scenario. We are currently working with Force10 to
try and resolve this issue, but no progress yet.
Hope this helps,
--
Dean Hildebrand
Ph.D. Candidate
University of Michigan
Andrew Pochinsky wrote:
Hi,
I'm looking to build a new PVFS2 storage and it seems that the
price sweet spot these days is on boxes with a lot of local disks (my
estimates are 5 to 10 TB per chassis). To provide enough bandwidth to
clients, I'm thinking about connecting PVFS2 servers to the switch via
10Ge. (We already have a Cisco switch and can not go IB. GigE and 10G
are the only choices, as far as I know.) Did anybody have any
experience with such a setup? What pitfalls are there?
Thanks,
--andrew
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
