Thx ,
the problem solved. I appriciate for your help.

On Sat, Nov 19, 2011 at 9:24 PM, Reuti <[email protected]> wrote:

> Am 19.11.2011 um 17:50 schrieb mahbube rustaee:
>
> >>> number of slots per node is correct, but host list is not host list on
> that
> >>> queue.
> >> Which queue, the one it runs in or the one you wanted it to run in?
> >> I defined a queue on a hostgroup (such @rack1) and attached to the
> queue a PE (such mpi2 with Allocatio_rule 2). I expected that any job
> launch to that queue use 2 slots of @rack1 hosts, but hosts that run jobs
> are not member of @rack1.
> > jobs get 2 slots per host , but some hosts are not member of @rack1!
> why?
> >
> > I want jobs that launch to the mentioned queue use 2 slots of @rack1
> hosts.
>
> Did you setup the wildcard solution I outlined below?
>
> In SGE you don't think in queues, but resource requests. If you request a
> PE which is attached to several queues, you will get what you asked for.
>
>
> http://www.gridengine.info/2006/02/14/grouping-jobs-to-nodes-via-wildcard-pes/
>
> Further more:
>
> Is the output of `qstat -g t` not the expected one, or the node your MPI
> job tasks - possibly outisde of SGE's allocarion?
>
> -- Reuti
>
>
> > Thx so much
> >>>>
> >
> >
> > On 11/19/11, Reuti <[email protected]> wrote:
> >> Am 19.11.2011 um 13:00 schrieb William Hay:
> >>
> >>> On 19 November 2011 09:58, mahbube rustaee <[email protected]> wrote:
> >>>>
> >>>>
> >>>> On Sat, Nov 19, 2011 at 12:05 PM, William Hay <[email protected]>
> wrote:
> >>>>>
> >>>>> On 19 November 2011 04:53, mahbube rustaee <[email protected]>
> wrote:
> >>>>>> Hi,
> >>>>>> I defined a queue on @node-grp (a group of nodes).
> >>>>>> I defined mpi2 parallel environment as:
> >>>>>> start_proc_args    /opt/gridengine/mpi/startmpi.
> >>>>>> sh $pe_hostfile
> >>>>>> stop_proc_args     /opt/gridengine/mpi/stopmpi.sh
> >>>>>> allocation_rule    2
> >>>>>> control_slaves     FALSE
> >>>>>> job_is_first_task  TRUE
> >>>>>> urgency_slots      min
> >>>>>> accounting_summary TRUE
> >>>>>>
> >>>>>> and attach this PE to that queue. I expected that parallel programs
> get
> >>>>>> slots from  @node-grp  on that queue and 2 slots on any host.
> >>>>>> but that was not happen, slots are at another hosts that arenot
> member
> >>>>>> of
> >>>>>> @node-grp.
> >>>>>>
> >>>>>> how can I define such parallel environment ?
> >>>>> 1.Were the parallel programs submitted to the mpi2 PE or possibly to
> a
> >>>>> different PE?
> >>>>
> >>>> Yes,  the parallel programs submitted to the mpi2 PE.
> >>>>>
> >>>>> 2.Is mpi2 defined in the pe_list of the queue in which the jobs
> actually
> >>>>> do run?
> >>>>
> >>>> yes,
> >>> Well that would appear to be the problem.  If you have multiple queues
> >>> with mpi2 defined then the job can run in any or all of them
> >>
> >> Correct. To limit it to one hostgroup you will have to attach different
> PEs
> >> to the hostgroups (this can still be done in one and the same queue) and
> >> request a PE with a wildcard. E.g. if they should stay inside one rack
> or
> >> so:
> >>
> >> $ qconf -sq all.q
> >> ...
> >> pe_list NONE,[@rack1=MPI2a PVMa],[@rack2=MPI2b PVMb]
> >>
> >>
> >> Then submitting:
> >>
> >> $ qsub -pe "MPI2*" 4 job.sh
> >>
> >> will give you machines only from one hostgroup. Of course MPI2a could
> also
> >> be requested directly this way.
> >>
> >> -- Reuti
> >>
> >>
> >>>> number of slots per node is correct, but host list is not host list on
> >>>> that
> >>>> queue.
> >>> Which queue, the one it runs in or the one you wanted it to run in?
> >>>
> >>>>>
> >>>>> William
> >>>>>>
> >>>>>> Thx
> >>>>
> >>>>
> >>>
> >>> _______________________________________________
> >>> users mailing list
> >>> [email protected]
> >>> https://gridengine.org/mailman/listinfo/users
> >>>
> >>
> >>
>
>
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users

Reply via email to