Yes, we build OpenMPI --without-torque. 

-----Original Message-----
From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On Behalf 
Of Reuti
Sent: Thursday, September 08, 2011 4:33 AM
To: Open MPI Users
Subject: EXTERNAL: Re: [OMPI users] Can you set the gid of the processes 
created by mpirun?

Am 08.09.2011 um 04:04 schrieb Ed Blosch:

> Typically it is something like 'qsub -W group_list=groupB <other options>
> myjob.sh'. Ultimately myjob.sh runs with gid groupB on some host in the
> cluster.  When that script reaches the mpirun command, then mpirun and the
> processes started on the same host all run with gid groupB, but any of the
> spawned processes that start on other hosts run with the user's default
> group, say groupA.
> 
> It did occur to me that the launching technique might have some ability to
> influence this behavior as you indicated. I don't know what launcher is
> being used in our cases, I guess it's rsh/ssh.

I can only make a statement for SGE that it would honor the group id for the 
"built-in method" or "rsh startup method" with SGE's patched rshd, not for ssh.

But you are using Torque I assume, as there is no -W switch in SGE. How did you 
build Open MPI then? I thought the support for Torque is available by default 
without any special switch to configure in Open MPI.

So, if the slave tasks are started by the pbs_mom, then it should also get the 
set group id. As I don't use Torque I can't make any definite statement for it.

Are you resetting inside the job script some variables to let it run outside 
Torque, i.e. without tight integration?

-- Reuti


> -----Original Message-----
> From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On
> Behalf Of Reuti
> Sent: Wednesday, September 07, 2011 12:24 PM
> To: Open MPI Users
> Subject: Re: [OMPI users] Can you set the gid of the processes created by
> mpirun?
> 
> Hi,
> 
> you mean you change the group id of the user before you submit the job? In
> GridEngine you can specify whether the actual group id should be used for
> the job, or the default login id.
> 
> Having a tight integration, also the slave processes will run with the same
> group id.
> 
> -- Reuti
> 
> 
>> Ed
>> 
>> From: Ralph Castain [mailto:r...@open-mpi.org] 
>> Sent: Wednesday, September 07, 2011 8:53 AM
>> To: Open MPI Users
>> Subject: Re: [OMPI users] Can you set the gid of the processes created by
> mpirun?
>> 
>> On Sep 7, 2011, at 7:38 AM, Blosch, Edwin L wrote:
>> 
>> 
>> The mpirun command is invoked when the user's group is 'set group' to
> group 650.  When the rank 0 process creates files, they have group ownership
> 650.  But the user's login group is group 1040. The child processes that get
> started on other nodes run with group 1040, and the files they create have
> group ownership 1040.
>> 
>> Is there a way to tell mpirun to start the child processes with the same
> uid and gid as the rank 0 process?
>> 
>> I'm afraid not - never came up before. Could be done, but probably not
> right away. What version are you using?
>> 
>> 
>> 
>> Thanks
>> _______________________________________________
>> users mailing list
>> us...@open-mpi.org
>> http://www.open-mpi.org/mailman/listinfo.cgi/users
>> 
>> _______________________________________________
>> users mailing list
>> us...@open-mpi.org
>> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 
> 
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
> 
> _______________________________________________
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users


_______________________________________________
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users

Reply via email to