Re: Re: High Availability for an application running on yarn

2020-03-23 Thread Malcolm McFarland
I think you can use the reservation system in Hadoop 2.8.x as well: https://hadoop.apache.org/docs/r2.8.5/hadoop-yarn/hadoop-yarn-site/ReservationSystem.html Cheers, Malcolm McFarland Cavulus This correspondence is from HealthPlanCRM, LLC, d/b/a Cavulus. Any unauthorized or improper disclosure,

Re:Re: High Availability for an application running on yarn

2020-03-23 Thread xyf
You can use Placements Constraints(https://hadoop.apache.org/docs/r3.1.0/hadoop-yarn/hadoop-yarn-site/PlacementConstraints.html) or set yarn.scheduler.capacity.per-node-heartbeat.maximum-container-assignments to 1 if you RM config with capacityscheduler. At 2020-03-23 22:58:59,

Re: High Availability for an application running on yarn

2020-03-23 Thread Debraj Manna
The same has been posted in StackOverflow but did not get any response there also. Anyone any thoughts on this ? On Mon, Mar 23, 2020 at 3:52 PM Debraj Manna wrote: > Can someone let me know what is the

High Availability for an application running on yarn

2020-03-23 Thread Debraj Manna
Can someone let me know what is the recommended way to ensure high availability for a yarn application? For example, let say I have 3 physical nodes. The yarn java application needs 3 containers and each physical node has enough resources to hold 3 yarn containers. What is the recommended way to

Re: hadoop 3.3.0 release plan

2020-03-23 Thread Brahma Reddy Battula
Yes, It's supposed to be on March-15th.Mostly this month end, we can start release voting. Earlier Plan: https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-3.3.0 On Mon, Mar 23, 2020 at 8:49 AM wangyongqiang0...@163.com < wangyongqiang0...@163.com> wrote: > is there any release