Re: [OMPI devel] selectively bind MPI to one HCA out of available ones

2009-07-16 Thread neeraj
Thanks a lot Pasha,
You saved lot of my time.
Thanks

Regards

Neeraj Chourasia (MTS)
Computational Research Laboratories Ltd.
(A wholly Owned Subsidiary of TATA SONS Ltd)
B-101, ICC Trade Towers, Senapati Bapat Road
Pune 411016 (Mah) INDIA
(O) +91-20-6620 9863  (Fax) +91-20-6620 9862
M: +91.9225520634




"Pavel Shamis (Pasha)" <pash...@gmail.com> 
Sent by: devel-boun...@open-mpi.org
07/16/2009 01:50 PM
Please respond to
pa...@dev.mellanox.co.il; Please respond to
Open MPI Developers <de...@open-mpi.org>


To
Open MPI Developers <de...@open-mpi.org>
cc
Open MPI Users <us...@open-mpi.org>
Subject
Re: [OMPI devel] selectively bind MPI to one HCA out of available ones






Hi,
You can select ib device used with openib btl by using follow parametres:
 MCA btl: parameter "btl_openib_if_include" (current value: , data 
source: default value)
  Comma-delimited list of devices/ports to be 
used (e.g. "mthca0,mthca1:2"; empty value means to
  use all ports found).  Mutually exclusive with 
btl_openib_if_exclude.
 MCA btl: parameter "btl_openib_if_exclude" (current value: , data 
source: default value)
  Comma-delimited list of device/ports to be 
excluded (empty value means to not exclude any
  ports).  Mutually exclusive with 
btl_openib_if_include.

For example, if you want to use first port on mthc0 you command line 
will look like:

mpirun -np. --mca btl_openib_if_include mthca0:1 

Pasha

nee...@crlindia.com wrote:
>
> Hi all,
>
> I have a cluster where both HCA's of blade are active, but 
> connected to different subnet.
> Is there an option in MPI to select one HCA out of available 
> one's? I know it can be done by making changes in openmpi code, but i 
> need clean interface like option during mpi launch time to select 
> mthca0 or mthca1?
>
> Any help is appreciated. Btw i just checked Mvapich and 
> feature is there inside.
>
> Regards
>
> Neeraj Chourasia (MTS)
> Computational Research Laboratories Ltd.
> (A wholly Owned Subsidiary of TATA SONS Ltd)
> B-101, ICC Trade Towers, Senapati Bapat Road
> Pune 411016 (Mah) INDIA
> (O) +91-20-6620 9863  (Fax) +91-20-6620 9862
> M: +91.9225520634
>
> =-=-= Notice: The information contained in this 
> e-mail message and/or attachments to it may contain confidential or 
> privileged information. If you are not the intended recipient, any 
> dissemination, use, review, distribution, printing or copying of the 
> information contained in this e-mail message and/or attachments to it 
> are strictly prohibited. If you have received this communication in 
> error, please notify us by reply e-mail or telephone and immediately 
> and permanently delete the message and any attachments. Internet 
> communications cannot be guaranteed to be timely, secure, error or 
> virus-free. The sender does not accept liability for any errors or 
> omissions.Thank you =-=-=
>
> 
>
> ___
> devel mailing list
> de...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/devel

___
devel mailing list
de...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/devel


=-=-=



Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. 

Internet communications cannot be guaranteed to be timely,
secure, error or virus-free. The sender does not accept liability
for any errors or omissions.Thank you

=-=-=


Re: [OMPI devel] selectively bind MPI to one HCA out of available ones

2009-07-16 Thread Pavel Shamis (Pasha)

Hi,
You can select ib device used with openib btl by using follow parametres:
MCA btl: parameter "btl_openib_if_include" (current value: , data 
source: default value)
 Comma-delimited list of devices/ports to be 
used (e.g. "mthca0,mthca1:2"; empty value means to
 use all ports found).  Mutually exclusive with 
btl_openib_if_exclude.
MCA btl: parameter "btl_openib_if_exclude" (current value: , data 
source: default value)
 Comma-delimited list of device/ports to be 
excluded (empty value means to not exclude any
 ports).  Mutually exclusive with 
btl_openib_if_include.


For example, if you want to use first port on mthc0 you command line 
will look like:


mpirun -np. --mca btl_openib_if_include mthca0:1 

Pasha

nee...@crlindia.com wrote:


Hi all,

I have a cluster where both HCA's of blade are active, but 
connected to different subnet.
Is there an option in MPI to select one HCA out of available 
one's? I know it can be done by making changes in openmpi code, but i 
need clean interface like option during mpi launch time to select 
mthca0 or mthca1?


Any help is appreciated. Btw i just checked Mvapich and 
feature is there inside.


Regards

Neeraj Chourasia (MTS)
Computational Research Laboratories Ltd.
(A wholly Owned Subsidiary of TATA SONS Ltd)
B-101, ICC Trade Towers, Senapati Bapat Road
Pune 411016 (Mah) INDIA
(O) +91-20-6620 9863  (Fax) +91-20-6620 9862
M: +91.9225520634

=-=-= Notice: The information contained in this 
e-mail message and/or attachments to it may contain confidential or 
privileged information. If you are not the intended recipient, any 
dissemination, use, review, distribution, printing or copying of the 
information contained in this e-mail message and/or attachments to it 
are strictly prohibited. If you have received this communication in 
error, please notify us by reply e-mail or telephone and immediately 
and permanently delete the message and any attachments. Internet 
communications cannot be guaranteed to be timely, secure, error or 
virus-free. The sender does not accept liability for any errors or 
omissions.Thank you =-=-=




___
devel mailing list
de...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/devel




[OMPI devel] selectively bind MPI to one HCA out of available ones

2009-07-15 Thread neeraj
Hi all,

I have a cluster where both HCA's of blade are active, but 
connected to different subnet.
Is there an option in MPI to select one HCA out of available 
one's? I know it can be done by making changes in openmpi code, but i need 
clean interface like option during mpi launch time to select mthca0 or 
mthca1?

Any help is appreciated. Btw i just checked Mvapich and feature is 
there inside.

Regards

Neeraj Chourasia (MTS)
Computational Research Laboratories Ltd.
(A wholly Owned Subsidiary of TATA SONS Ltd)
B-101, ICC Trade Towers, Senapati Bapat Road
Pune 411016 (Mah) INDIA
(O) +91-20-6620 9863  (Fax) +91-20-6620 9862
M: +91.9225520634

=-=-=



Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. 

Internet communications cannot be guaranteed to be timely,
secure, error or virus-free. The sender does not accept liability
for any errors or omissions.Thank you

=-=-=