I have read the Torque implementation's code already, that is not suitable for us. It has to schedul one node at a time, not one core. Now I am trying to implement it by using Maui as the job scheduler, and make Maui request resources from Mesos. The requesting resource part is done, and the part that update the Torque job state to mesos is done too. The rest work I have to do is making the executors on every salve be started before Maui begin to schedule jobs.
I will try to start a simple task on every slave whose only goal is to start the executor. Thank you all for the advices！ > -----原始邮件----- > 发件人: "Vinod Kone" <[email protected]> > 发送时间: 2014年1月7日 星期二 > 收件人: dev <[email protected]> > 抄送: > 主题: Re: Re: Question about Executor > > Technically you can't launch an executor without a task. There is no > launchExecutor() scheduler driver method only launchTask() which launches > an executor if one isn't already running on the slave. That said I could > imagine launching a dummy/startup task whose only goal is to get an > executor launched. The subsequent tasks launched on the executor could be > real tasks. This would likely require some bookkeeping by the scheduler. > Makes sense? > > Also, as Julien mentioned take a look at the existing Torque > implementation. That code hasn't been touched in a while (last commit was 3 > years ago) so it's likely not going to work out of the box. But it could be > a good starting point. > > On Mon, Jan 6, 2014 at 6:50 AM, Julien Eid <[email protected]> wrote: > > > Hey, > > > > Are you trying to put Torque on Mesos? Because someone has already ported > > Torque on Mesos and you might want to just take what they've worked on and > > improve it. > > > > https://github.com/apache/mesos/tree/master/frameworks/torque > > > > Enjoy! > > Julien > > > > > > On Mon, Jan 6, 2014 at 4:13 AM, HUO Jing <[email protected]> wrote: > > > > > Thank you very much! > > > Another question: > > > Can I start the Executor even if there is no task to run on it? > > > And how to do it ? > > > > -----原始邮件----- > > > > 发件人: "Vinod Kone" <[email protected]> > > > > 发送时间: 2014年1月6日 星期一 > > > > 收件人: dev <[email protected]> > > > > 抄送: > > > > 主题: Re: Question about Executor > > > > > > > > On Sun, Jan 5, 2014 at 9:41 PM, HUO Jing <[email protected]> wrote: > > > > > > > > > But when there is no task running in the executor, mesos slave will > > > shut > > > > > down the executor > > > > > > > > > > > > This is not true. The mesos slave will not kill an executor when it has > > > no > > > > tasks running. It is up to the executor whether it wants to keep > > running > > > > when there are no tasks or shut down. > > > > > > > > Hope that helps, > > > > > > > >
