[jira] [Created] (YARN-5897) using drainEvent to replace sleep-wait in MockRM#waitForState

2016-11-16 Thread sandflee (JIRA)
sandflee created YARN-5897: -- Summary: using drainEvent to replace sleep-wait in MockRM#waitForState Key: YARN-5897 URL: https://issues.apache.org/jira/browse/YARN-5897 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5896) add drainEvents to MockAM to reduce test failure

2016-11-16 Thread sandflee (JIRA)
sandflee created YARN-5896: -- Summary: add drainEvents to MockAM to reduce test failure Key: YARN-5896 URL: https://issues.apache.org/jira/browse/YARN-5896 Project: Hadoop YARN Issue Type:

[jira] [Resolved] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee resolved YARN-5895. Resolution: Duplicate > TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey >

[VOTE] Merge feature branch YARN-4752. FairScheduler preemption overhaul

2016-11-16 Thread Karthik Kambatla
Hi folks, Based on the positive feedback on the DISCUSS thread [1], I would like to start a formal vote to merge feature branch YARN-4752 to trunk. The cumulative patch is posted to YARN-4752, and squashed into one commit here [2]. The changes include: 1. Preemption considers individual

[jira] [Created] (YARN-5895) TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey

2016-11-16 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-5895: --- Summary: TestRMRestart#testFinishedAppRemovalAfterRMRestart is still flakey Key: YARN-5895 URL: https://issues.apache.org/jira/browse/YARN-5895

[jira] [Created] (YARN-5894) license warning in de.ruedigermoeller:fst:jar:2.24

2016-11-16 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5894: Summary: license warning in de.ruedigermoeller:fst:jar:2.24 Key: YARN-5894 URL: https://issues.apache.org/jira/browse/YARN-5894 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-5880) Add sanity check for FIFO scheduler

2016-11-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-5880. Resolution: Invalid There is already sanity check for memory in FIFO scheduler. > Add sanity check for FIFO

Re: [DISCUSS] Merge FairScheduler preemption overhaul (YARN-4752) to trunk

2016-11-16 Thread Karthik Kambatla
Thanks Sangjin, Daniel, and Arun for your positive feedback. Sangjin - filed HADOOP-13821 to track the findbugs work. Arun - A synchronous approach would benefit with locking, but might lead to delay in processing apps that do not require a preemption to satisfy their request. Offline, you had

[jira] [Created] (YARN-5893) Experiment with using PriorityQueue for storing starved applications

2016-11-16 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5893: -- Summary: Experiment with using PriorityQueue for storing starved applications Key: YARN-5893 URL: https://issues.apache.org/jira/browse/YARN-5893 Project: Hadoop

[jira] [Created] (YARN-5891) yarn rmadmin -help contains a misspelled ResourceManager

2016-11-16 Thread Grant Sohn (JIRA)
Grant Sohn created YARN-5891: Summary: yarn rmadmin -help contains a misspelled ResourceManager Key: YARN-5891 URL: https://issues.apache.org/jira/browse/YARN-5891 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5890) FairScheduler should log information about AM-resource-usage and max-AM-share for queues

2016-11-16 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-5890: -- Summary: FairScheduler should log information about AM-resource-usage and max-AM-share for queues Key: YARN-5890 URL: https://issues.apache.org/jira/browse/YARN-5890 Project:

Re: [DISCUSS] Merge FairScheduler preemption overhaul (YARN-4752) to trunk

2016-11-16 Thread Arun Suresh
+1 from me too. minor nit: * In FSAppAttempt, maybe rename addPreemption(container) / removePreemption(container) to something better. Also, had an offline discussion with Karthik. Suggested to maybe experiment with replacing the PreemptionThread with a synchronous preemption approach. For eg.

[jira] [Created] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-11-16 Thread Sunil G (JIRA)
Sunil G created YARN-5889: - Summary: Improve user-limit calculation in capacity scheduler Key: YARN-5889 URL: https://issues.apache.org/jira/browse/YARN-5889 Project: Hadoop YARN Issue Type: Bug

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-11-16 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/227/ [Nov 15, 2016 7:57:37 AM] (naganarasimha_gr) Reverted due to issue YARN-5765. Revert "YARN-5287. [Nov 15, 2016 10:11:56 AM] (naganarasimha_gr) YARN-4355. NPE while processing localizer heartbeat.

[jira] [Resolved] (YARN-5108) TestFileSystemApplicationHistoryStore fails

2016-11-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S resolved YARN-5108. - Resolution: Duplicate After HADOOP-13140, this test is passing in all the build. Closing

[jira] [Resolved] (YARN-5765) Revert CHMOD on the new dirs created-LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-11-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R resolved YARN-5765. - Resolution: Fixed Hadoop Flags: Reviewed Release Note: This change reverts