Question about YARN NodeManager and ApplicationMaster failures

2016-03-02 Thread Sadystio Ilmatunt
Hello, I have some questions regarding failure of NodeManager and Application Master. What happens if NodeManager which is running on the same node as Application Master fails? Does Application Master fail as well? Also How is Application Master failure handled with respect to its (child)

RE: Yarn with CapacityScheduler will only schedule two applications - open to consultants today

2016-03-02 Thread Naganarasimha G R (Naga)
Hi Marcin, we're seeing is that even though we have 12 machines in our yarn cluster, yarn will only schedule two applications. If this is the problem you are facing with the below configuration then its mostly YARN-3216 itself. And i think its

unsubscribe

2016-03-02 Thread zhiliang wang

Re: Yarn with CapacityScheduler will only schedule two applications - open to consultants today

2016-03-02 Thread Marcin Tustin
Hi Naga, You're quite right. Our fix was balance out the resources in each label more, in order to have the bug bite us less. Beyond that I would direct any readers to your text and my text below. Marcin On Wednesday, March 2, 2016, Naganarasimha G R (Naga) < garlanaganarasi...@huawei.com>

Yarn with CapacityScheduler will only schedule two applications - open to consultants today

2016-03-02 Thread Marcin Tustin
Hi All, We're hitting this issue. If you're a consultant with capacity today (2 March 2016 EST in New York) please feel free to contact me on or off list. In terms of stack, we're using Yarn 2.7.1.2.3 from the latest Hortonworks distribution. It's possible we're hitting this bug: