Re: Running YARN in-process Application Master?

2014-04-29 Thread bo yang
This is great info for me. Thanks Oleg! I will take a look. Hope it can also fit in our production environment. Best Regards, Bo On Tue, Apr 29, 2014 at 3:38 AM, Oleg Zhurakousky < oleg.zhurakou...@gmail.com> wrote: > Yes there is. You can provide your own implementation of > org.apache.hadoop.

Re: Running YARN in-process Application Master?

2014-04-29 Thread Oleg Zhurakousky
Yes there is. You can provide your own implementation of org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor and configure it as 'yarn.nodemanager.container-executor.class' property. There you can bypass Shell and create your own way of invoking processes. Obviously it only makes se

Running YARN in-process Application Master?

2014-04-28 Thread bo yang
Hi All, I just joined this group, and not sure whether this question was discussed before. Is it possible to run Application Master within the same process as Node Manager? If not, any plan to support it future? I am asking this because we might want to use YARN as a job dispatching system. We h