On May 25, 2011, at 1:34 PM, Joshua Randall wrote: > Scott, > > I tried running the pvfs2-server under root and the clients (pvfs2- > ping, pvfs2-ls) under my user account and that appears to work just > fine using Open-MX.
Ok. The restriction should be for MX only unless Myricom changes their shmem implementation. > Should I be expecting to be able to communicate with myself over MX by > going to the switch and back, as this suggests? If so, perhaps my > issue has something to do with my switch configuration? > > I have tried the following test, which does not work: > >> jrandall@renton:~$ MX_DISABLE_SHMEM=1 MX_DISABLE_SELF=1 /opt/open-mx/ >> bin/tests/mx_pingpong >> OMX: Emulating MX_DISABLE_SELF as OMX_DISABLE_SELF >> OMX: Forcing self comms to disabled >> OMX: Emulating MX_DISABLE_SHMEM as OMX_DISABLE_SHARED >> OMX: Forcing shared comms to disabled >> Starting pingpong receiver on renton:0, endpoint=1 > > And, in another shell on the same machine: >> jrandall@renton:~$ MX_DISABLE_SHMEM=1 MX_DISABLE_SELF=1 /opt/open-mx/ >> bin/tests/mx_pingpong -d renton:0 -r 1 >> OMX: trying to open board [0,31] endpoint [0,31] >> OMX: trying to open board #0 endpoint #0 >> OMX: successfully open board #0 endpoint #0 >> OMX: desc at 0x7fc9013c7000 sendq at 0x7fc9003ec000, recvq at >> 0x7fc8ffbec000, exp eventq at 0x7fc9013b7000, unexp at 0x7fc90139e000 >> OMX: Successfully attached endpoint #0 on board #0 (hostname 'renton: >> 0', name 'eth3', addr 00:1b:21:4d:ba:92) >> OMX: created partner 0000001b214dba92 ep 0 peer index 0 >> OMX: created myself partner 0000001b214dba92 ep 0 peer index 0 >> OMX: created partner 0000001b214dba92 ep 1 peer index 0 >> OMX: waiting for connect reply from partner 0000001b214dba92 ep 1 > > Is this something that _should_ work? No, Ethernet switches do not reply if the src and dst are the same. This is for Myrinet switches only. The same holds for native MX over Ethernet (MXoE using Myricom NICs and any Ethernet switch) in that the switch will _not_ send the traffic back. Scott _______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
