Hi Kyle,
yes, from the fileserver I can do ibv_rc_pingpong from/to hosts in both
subnets. The only thing I have to do is to specify the IB port on the
fileserver when I test a node on the 2nd subnet (which is connected to
the 2nd IB port in the fileserver).
There is no IB router between those two subnets. The fileservers are
just connected to each subnet with their dualport HCA.
Regards,
Oliver Weihe
Are your ofed utilities allowing you to at least ping between the subnets?
Ibv_rc_pingpong, etc?
Do you have an ib router in between the subnets?
Kyle Schochenmaier
On Sep 23, 2009 7:03 AM, "Oliver Weihe" <[email protected]
<mailto:[email protected]>> wrote:
Hello,
I have some fileservers which should export an PVFS (2.8.1) into two
Infiniband subnets (2 clusters, each has its own subnet/switch). The
fileservers have dualport Infiniband HCAs, one port is connected to
each subnet.
The clients in the subnet where the fileservers are connected to with
their first IB port are able to mount the PVFS2 while the clients in
the other subnet where the fileservers are connected to with their
second IB port get timeouts and are unable to mount/pvfs2-ping.
The fileservers have NO IP-over-IB configured, I'm using the IP
addresses/hostnames of the ethernet network in the pvfs2-fs.conf.
-- cut here --
...
<Aliases>
Alias fs1 ib://fs1:3335
Alias fs2 ib://fs2:3335
Alias fs3 ib://fs3:3335
Alias fs4 ib://fs4:3335
</Aliases>
...
-- cut here --
PVFS 2.8.1 configure options I've used:
./configure --prefix=/opt/pvfs2 --without-bmi-tcp \
--with-openib=/opt/ofed/ --with-kernel=/lib/modules/`uname -r`/build/
Regards,
Oliver Weihe
_______________________________________________
Pvfs2-users mailing list
[email protected]
<mailto:[email protected]>
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
--
Gruß,
Oliver Weihe
Delta Computer Products GmbH, Roentgenstr. 4, 21465 Reinbek, Germany
Handelsregister Reinbek HRB 3678, Geschaeftsfuehrer: Hans-Peter Hellmann
[email protected], [P] +49-40-300672-31
_______________________________________________
Pvfs2-users mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
