On 10/19/2011 01:46 PM, Becky Ligon wrote:
In this situation, the best solution is to setup OrangeFS using
TCP/IP, which is the default communication protocol, and setup
infiniband as IB over TCP.
OrangeFS is capable of understanding IB and TCP at the same time;
however, there is a performance hit. So, in a production environment,
you don't want to run OrangeFS in this way.
Thanks for your reply.
It did different experiment using either IB or TCP. With TCP through
1Gbit ethernet (linking the pvfs2 servers together),
the performance is a bit disappointing, while it is excellent with IB.
Unfortunately our cluster
has only one IB network and we wanted to use it for MPI communication only.
So, if I do understand well, there is no way to overcome this problem,
except using IB over TCP, which is not recommended...
What will be the penality of using it ? Does it reduce the performace to
the one obtained with TCP through 1Gbit ethernet ?
What about using fiber channel betwen servers ?
Cheers,
yves
Becky
On Tue, Oct 18, 2011 at 5:35 PM, Yves Revaz <[email protected]
<mailto:[email protected]>> wrote:
Hi all,
I would like to set up a parallel file system using orangefs,
composed of 4 nodes (acting as metadata and io servers)
using and infiniband network.
Then, is it possible to reach this parallel file system from another
node, that does not share the infiniband network but has only
a Gbit network ? (obviously all 4 nodes share also this Gbit network).
Thanks in advance,
yves
--
(o o)
--------------------------------------------oOO--(_)--OOo-------
Yves Revaz
Laboratory of Astrophysics EPFL
Observatoire de Sauverny Tel : ++ 41 22 379 24 28
<tel:%2B%2B%2041%2022%20379%2024%2028>
51. Ch. des Maillettes Fax : ++ 41 22 379 22 05
<tel:%2B%2B%2041%2022%20379%2022%2005>
1290 Sauverny e-mail : [email protected]
<mailto:[email protected]>
SWITZERLAND Web : http://www.lunix.ch/revaz/
----------------------------------------------------------------
_______________________________________________
Pvfs2-users mailing list
[email protected]
<mailto:[email protected]>
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
--
Becky Ligon
OrangeFS Support and Development
Omnibond Systems
Anderson, South Carolina
--
(o o)
--------------------------------------------oOO--(_)--OOo-------
Dr. Yves Revaz
Laboratory of Astrophysics
Ecole Polytechnique Fédérale de Lausanne (EPFL)
Observatoire de Sauverny Tel : ++ 41 22 379 24 28
51. Ch. des Maillettes Fax : ++ 41 22 379 22 05
1290 Sauverny e-mail : [email protected]
SWITZERLAND Web : http://www.lunix.ch/revaz/
----------------------------------------------------------------
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
