Re: [MTT users] mpi jobs triggered on remote hosts

2007-06-05 Thread Jeff Squyres 

On Jun 5, 2007, at 12:25 PM, Shai Venter wrote:


I must say, you guys are in the 'zero response time' zone !
Great! I appreciate it a lot.


Glad to help.


One major Q : When mtt is launched on 'host116' for example, does the
scratch area for the ompi installation should be a shared directory
(like a network folder) acessible to all other hosts in the setup, or
can it be on the local 'host116' which is running the mtt?


MTT currently assumes that the scratch area is shared across all  
nodes where that instance of MTT is running (e.g., a network share  
folder such as NFS).  We have some trac tickets open to support non- 
uniform-shared setups (e.g., heterogeneous architectures where a  
single shared folder will not be sufficient), but no work has  
progressed on that front yet.



What I'm trying to figure out is, how does mpi jobs run on the remote
hosts in my setup if there's no ompi installation there?
Or maybe I didn't fully understand the greatness of how mtt works  
behind

the curtains.


Hah!  :-)

MTT doesn't transparently install MPI on multiple machines -- it  
installs it once in the scratch directory and then assumes that the  
same scratch tree is available on all nodes.




Once more - Thank you

Regards,
Shai Venter.
-Original Message-
From: mtt-users-boun...@open-mpi.org
[mailto:mtt-users-boun...@open-mpi.org] On Behalf Of
mtt-users-requ...@open-mpi.org
Sent: Tuesday, June 05, 2007 7:00 PM
To: mtt-us...@open-mpi.org
Subject: mtt-users Digest, Vol 16, Issue 2

Send mtt-users mailing list submissions to
mtt-us...@open-mpi.org

To subscribe or unsubscribe via the World Wide Web, visit
http://www.open-mpi.org/mailman/listinfo.cgi/mtt-users
or, via email, send a message with subject or body 'help' to
mtt-users-requ...@open-mpi.org

You can reach the person managing the list at
mtt-users-ow...@open-mpi.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of mtt-users digest..."


Today's Topics:

   1. Re: mtt-users Digest, Vol 15, Issue 5 (Jeff Squyres)


--

Message: 1
Date: Tue, 5 Jun 2007 08:13:14 -0400
From: Jeff Squyres 
Subject: Re: [MTT users] mtt-users Digest, Vol 15, Issue 5
To: General user list for the MPI Testing Tool

Message-ID: <20aaafa1-e868-4dd0-b7c3-d992d2167...@cisco.com>
Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed

Great; let us know how else we can help getting you setup on MTT.


On Jun 3, 2007, at 3:06 AM, Shai Venter wrote:


Hard-coded indeed it was. One more hurdle overcomed.
Thanks and good day.

Regards,
Shai Venter.
-Original Message-
From: mtt-users-boun...@open-mpi.org
[mailto:mtt-users-boun...@open-mpi.org] On Behalf Of
mtt-users-requ...@open-mpi.org
Sent: Monday, May 21, 2007 6:44 PM
To: mtt-us...@open-mpi.org
Subject: mtt-users Digest, Vol 15, Issue 5

Send mtt-users mailing list submissions to
mtt-us...@open-mpi.org

To subscribe or unsubscribe via the World Wide Web, visit
http://www.open-mpi.org/mailman/listinfo.cgi/mtt-users
or, via email, send a message with subject or body 'help' to
mtt-users-requ...@open-mpi.org

You can reach the person managing the list at
mtt-users-ow...@open-mpi.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of mtt-users digest..."


Today's Topics:

   1. Re: mtt test build for IMB-MPI1 fails, (Jeff Squyres)
   2. Re: mtt test build for IMB-MPI1 fails, (Ethan Mallove)
   3. Re: mtt test build for IMB-MPI1 fails, (Jeff Squyres)


- 
-


Message: 1
Date: Mon, 21 May 2007 06:32:53 -0700
From: Jeff Squyres 
Subject: Re: [MTT users] mtt test build for IMB-MPI1 fails,
To: General user list for the MPI Testing Tool

Message-ID: <72ebb18f-34bc-4635-a012-a122e925b...@cisco.com>
Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed

It looks like your makefile is hard-coded to use /bin/mpicc, which
will always be wrong for MTT.  This specifies an absolute location
for mpicc, and does not allow the $PATH to be used.

Where are you getting your copy of IMB from?

The IMB 2.3 that is in the ompi_tests repository has a make_openmpi
that contains the following line:

CC  = mpicc

Hence, "mpicc" is used, and therefore $PATH is used to find it.

Can you modify your makefile this way?


On May 20, 2007, at 12:31 AM, Shai Venter wrote:


Hello again Mr Squyres.

I am most greatfull for your answers to my questions (2).
Actualy, they are both linked to the same issue: my mtt run fails
in the
test build phase for IMB-MPI1.

It seems that the make file cannot find the mpicc to compile.
It searches for it in a default path (/bin/mpicc) but it's
Usless scince this path is irrelevant.

I've tried this code:

[MTT users] mpi jobs triggered on remote hosts

2007-06-05 Thread Shai Venter 
Hi again.
I must say, you guys are in the 'zero response time' zone !
Great! I appreciate it a lot.

One major Q : When mtt is launched on 'host116' for example, does the
scratch area for the ompi installation should be a shared directory
(like a network folder) acessible to all other hosts in the setup, or
can it be on the local 'host116' which is running the mtt? 

What I'm trying to figure out is, how does mpi jobs run on the remote
hosts in my setup if there's no ompi installation there? 
Or maybe I didn't fully understand the greatness of how mtt works behind
the curtains.


Once more - Thank you 

Regards,
Shai Venter.
-Original Message-
From: mtt-users-boun...@open-mpi.org
[mailto:mtt-users-boun...@open-mpi.org] On Behalf Of
mtt-users-requ...@open-mpi.org
Sent: Tuesday, June 05, 2007 7:00 PM
To: mtt-us...@open-mpi.org
Subject: mtt-users Digest, Vol 16, Issue 2

Send mtt-users mailing list submissions to
mtt-us...@open-mpi.org

To subscribe or unsubscribe via the World Wide Web, visit
http://www.open-mpi.org/mailman/listinfo.cgi/mtt-users
or, via email, send a message with subject or body 'help' to
mtt-users-requ...@open-mpi.org

You can reach the person managing the list at
mtt-users-ow...@open-mpi.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of mtt-users digest..."


Today's Topics:

   1. Re: mtt-users Digest, Vol 15, Issue 5 (Jeff Squyres)


--

Message: 1
List-Post: mtt-users@lists.open-mpi.org
Date: Tue, 5 Jun 2007 08:13:14 -0400
From: Jeff Squyres 
Subject: Re: [MTT users] mtt-users Digest, Vol 15, Issue 5
To: General user list for the MPI Testing Tool

Message-ID: <20aaafa1-e868-4dd0-b7c3-d992d2167...@cisco.com>
Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed

Great; let us know how else we can help getting you setup on MTT.


On Jun 3, 2007, at 3:06 AM, Shai Venter wrote:

> Hard-coded indeed it was. One more hurdle overcomed.
> Thanks and good day.
>
> Regards,
> Shai Venter.
> -Original Message-
> From: mtt-users-boun...@open-mpi.org
> [mailto:mtt-users-boun...@open-mpi.org] On Behalf Of
> mtt-users-requ...@open-mpi.org
> Sent: Monday, May 21, 2007 6:44 PM
> To: mtt-us...@open-mpi.org
> Subject: mtt-users Digest, Vol 15, Issue 5
>
> Send mtt-users mailing list submissions to
>   mtt-us...@open-mpi.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>   http://www.open-mpi.org/mailman/listinfo.cgi/mtt-users
> or, via email, send a message with subject or body 'help' to
>   mtt-users-requ...@open-mpi.org
>
> You can reach the person managing the list at
>   mtt-users-ow...@open-mpi.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of mtt-users digest..."
>
>
> Today's Topics:
>
>1. Re: mtt test build for IMB-MPI1 fails, (Jeff Squyres)
>2. Re: mtt test build for IMB-MPI1 fails, (Ethan Mallove)
>3. Re: mtt test build for IMB-MPI1 fails, (Jeff Squyres)
>
>
> --
>
> Message: 1
> Date: Mon, 21 May 2007 06:32:53 -0700
> From: Jeff Squyres 
> Subject: Re: [MTT users] mtt test build for IMB-MPI1 fails,
> To: General user list for the MPI Testing Tool
>   
> Message-ID: <72ebb18f-34bc-4635-a012-a122e925b...@cisco.com>
> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed
>
> It looks like your makefile is hard-coded to use /bin/mpicc, which
> will always be wrong for MTT.  This specifies an absolute location
> for mpicc, and does not allow the $PATH to be used.
>
> Where are you getting your copy of IMB from?
>
> The IMB 2.3 that is in the ompi_tests repository has a make_openmpi
> that contains the following line:
>
> CC  = mpicc
>
> Hence, "mpicc" is used, and therefore $PATH is used to find it.
>
> Can you modify your makefile this way?
>
>
> On May 20, 2007, at 12:31 AM, Shai Venter wrote:
>
>> Hello again Mr Squyres.
>>
>> I am most greatfull for your answers to my questions (2).
>> Actualy, they are both linked to the same issue: my mtt run fails
>> in the
>> test build phase for IMB-MPI1.
>>
>> It seems that the make file cannot find the mpicc to compile.
>> It searches for it in a default path (/bin/mpicc) but it's
>> Usless scince this path is irrelevant.
>>
>> I've tried this code:
>>
>> module = Shell
>> shell_build_command = <> cd src
>> make clean IMB-MPI1
>> EOT
>>
>> But still the same error.
>>
>>
>> Lets have a look at the output of build error:
>>
>> -

>> -
>
>> --
>> 
>> sw169:/usr/local/mtt # cat
>> scratch/installs/K5a_/tests/imb-2.3/test_built.ini
>> # This file was automatically created by Config/IniFiles.pm.  Any
>> changes made manually are