[jira] [Commented] (YARN-6231) TestFairScheduler::testMoveWouldViolateMaxResourcesConstraints failing on branch-2

2017-02-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884833#comment-15884833 ] Miklos Szegedi commented on YARN-6231: -- [~kasha], is this the same issue as YARN-6230? >

[jira] [Updated] (YARN-5579) Resourcemanager should surface failed state store operation prominently

2017-02-26 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated YARN-5579: - Description: I found the following in Resourcemanager log when I tried to figure out why application got stuck in

[jira] [Comment Edited] (YARN-5956) Refactor ClientRMService

2017-02-26 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884742#comment-15884742 ] Kai Sasaki edited comment on YARN-5956 at 2/26/17 1:17 PM: --- [~sunilg] Thanks for

[jira] [Commented] (YARN-5956) Refactor ClientRMService

2017-02-26 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884742#comment-15884742 ] Kai Sasaki commented on YARN-5956: -- [~sunilg] Thanks for checking again. I agree with you. I think

[jira] [Updated] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-02-26 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5548: --- Attachment: YARN-5548.0011.patch > Use MockRMMemoryStateStore to reduce test failures >

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-02-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884812#comment-15884812 ] Hadoop QA commented on YARN-5548: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6231) TestFairScheduler::testMoveWouldViolateMaxResourcesConstraints failing on branch-2

2017-02-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884837#comment-15884837 ] Karthik Kambatla commented on YARN-6231: Yes, closed it as a duplicate. >

[jira] [Resolved] (YARN-6230) Failing unit test TestFairScheduler.testMoveWouldViolateMaxResourcesConstraints

2017-02-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-6230. Resolution: Duplicate YARN-6231 duplicates this issue, but we have made more progress there.

[jira] [Commented] (YARN-5517) Add GPU as a resource type for scheduling

2017-02-26 Thread Jaeboo Jeong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884747#comment-15884747 ] Jaeboo Jeong commented on YARN-5517: This patch just is intended for use with hadoop 2.7. I agree with

[jira] [Updated] (YARN-6172) TestFSAppStarvation fails on trunk

2017-02-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6172: - Attachment: YARN-6172.001.patch > TestFSAppStarvation fails on trunk >

[jira] [Commented] (YARN-6172) TestFSAppStarvation fails on trunk

2017-02-26 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884845#comment-15884845 ] Miklos Szegedi commented on YARN-6172: -- Thank you, [~kasha] for the comments. I updated the patch.

[jira] [Commented] (YARN-6172) TestFSAppStarvation fails on trunk

2017-02-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15884873#comment-15884873 ] Hadoop QA commented on YARN-6172: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-1728) History server doesn't understand percent encoded paths

2017-02-26 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuanbo Liu updated YARN-1728: - Attachment: YARN-1728-branch-2.004.patch > History server doesn't understand percent encoded paths >

[jira] [Commented] (YARN-1728) History server doesn't understand percent encoded paths

2017-02-26 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885088#comment-15885088 ] Yuanbo Liu commented on YARN-1728: -- [~jira.shegalov] Thanks for your comments. Agree with you. since the

[jira] [Commented] (YARN-6215) TestFairSchedulerPreemption.testPreemptionBetweenNonSiblingQueues fails in trunk

2017-02-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885107#comment-15885107 ] Karthik Kambatla commented on YARN-6215: While it is unlikely that lock() would through an

[jira] [Updated] (YARN-6215) FairScheduler preemption and update should not run concurrently

2017-02-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6215: --- Summary: FairScheduler preemption and update should not run concurrently (was:

[jira] [Commented] (YARN-6215) TestFairSchedulerPreemption.testPreemptionBetweenNonSiblingQueues fails in trunk

2017-02-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885114#comment-15885114 ] Hadoop QA commented on YARN-6215: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4752) FairScheduler should preempt for a ResourceRequest and all preempted containers should be on the same node

2017-02-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885113#comment-15885113 ] Karthik Kambatla commented on YARN-4752: YARN-6215 adds a lock, and on the surface it appears would

[jira] [Comment Edited] (YARN-5280) Allow YARN containers to run with Java Security Manager

2017-02-26 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885140#comment-15885140 ] Varun Vasudev edited comment on YARN-5280 at 2/27/17 5:00 AM: -- [~gphillips] -

[jira] [Commented] (YARN-6172) FSLeafQueue demand update needs to be atomic

2017-02-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885151#comment-15885151 ] Hudson commented on YARN-6172: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11311 (See

[jira] [Created] (YARN-6236) Move lock() out of try-block in FairScheduler

2017-02-26 Thread Tao Jie (JIRA)
Tao Jie created YARN-6236: - Summary: Move lock() out of try-block in FairScheduler Key: YARN-6236 URL: https://issues.apache.org/jira/browse/YARN-6236 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6215) TestFairSchedulerPreemption.testPreemptionBetweenNonSiblingQueues fails in trunk

2017-02-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885100#comment-15885100 ] Hadoop QA commented on YARN-6215: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1728) History server doesn't understand percent encoded paths

2017-02-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885111#comment-15885111 ] Hadoop QA commented on YARN-1728: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6172) FSLeafQueue demand update needs to be atomic

2017-02-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6172: --- Summary: FSLeafQueue demand update needs to be atomic (was: TestFSAppStarvation fails on

[jira] [Commented] (YARN-6215) FairScheduler preemption and update should not run concurrently

2017-02-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885128#comment-15885128 ] Hudson commented on YARN-6215: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11310 (See

[jira] [Updated] (YARN-6215) TestFairSchedulerPreemption.testPreemptionBetweenNonSiblingQueues fails in trunk

2017-02-26 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-6215: -- Attachment: YARN-6215.002.patch > TestFairSchedulerPreemption.testPreemptionBetweenNonSiblingQueues fails in >

[jira] [Commented] (YARN-5956) Refactor ClientRMService

2017-02-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885082#comment-15885082 ] Sunil G commented on YARN-5956: --- Thanks [~lewuathe] With current patch, {{checkAccess}} inside

[jira] [Commented] (YARN-6215) TestFairSchedulerPreemption.testPreemptionBetweenNonSiblingQueues fails in trunk

2017-02-26 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885080#comment-15885080 ] Tao Jie commented on YARN-6215: --- [~kasha] thank you for you comments and patch updated. {quote} lock() should

[jira] [Updated] (YARN-6215) TestFairSchedulerPreemption.testPreemptionBetweenNonSiblingQueues fails in trunk

2017-02-26 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-6215: -- Attachment: YARN-6215.002.patch > TestFairSchedulerPreemption.testPreemptionBetweenNonSiblingQueues fails in >

[jira] [Updated] (YARN-6215) TestFairSchedulerPreemption.testPreemptionBetweenNonSiblingQueues fails in trunk

2017-02-26 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-6215: -- Attachment: (was: YARN-6215.002.patch) > TestFairSchedulerPreemption.testPreemptionBetweenNonSiblingQueues

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient in FSParentQueue.java

2017-02-26 Thread zhangshilong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885072#comment-15885072 ] zhangshilong commented on YARN-4090: [~yufeigu] I found one problem when doing this issue. In

[jira] [Commented] (YARN-4122) Add support for GPU as a resource

2017-02-26 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885002#comment-15885002 ] Jun Gong commented on YARN-4122: [~leftnoteasy] It's OK. Move it now. > Add support for GPU as a resource

[jira] [Updated] (YARN-4122) Add support for GPU as a resource

2017-02-26 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4122: --- Issue Type: Sub-task (was: New Feature) Parent: YARN-6223 > Add support for GPU as a resource >

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2017-02-26 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885022#comment-15885022 ] Greg Phillips commented on YARN-5280: - [~rkanter] I tested {{TestContainerManagerSecurity}} with and

[jira] [Commented] (YARN-4752) FairScheduler should preempt for a ResourceRequest and all preempted containers should be on the same node

2017-02-26 Thread zhangshilong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885081#comment-15885081 ] zhangshilong commented on YARN-4752: [~kasha] I found one problem. In FSLeafQueue: I think

[jira] [Updated] (YARN-6236) Move lock() out of try-block in FairScheduler

2017-02-26 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-6236: -- Attachment: YARN-6236.001.patch > Move lock() out of try-block in FairScheduler >

[jira] [Updated] (YARN-6236) Move lock() out of try-block in FairScheduler

2017-02-26 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-6236: -- Component/s: fairscheduler > Move lock() out of try-block in FairScheduler >

[jira] [Commented] (YARN-6236) Move lock() out of try-block in FairScheduler

2017-02-26 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885267#comment-15885267 ] Tao Jie commented on YARN-6236: --- Checked files in fair folder by {{grep -R "Lock.lock()" -A 1 -B 1 ./}} and

[jira] [Updated] (YARN-6236) Move lock() out of try-block in FairScheduler

2017-02-26 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Jie updated YARN-6236: -- Priority: Minor (was: Major) > Move lock() out of try-block in FairScheduler >

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2017-02-26 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885140#comment-15885140 ] Varun Vasudev commented on YARN-5280: - [~gphillips] - can you explain this - {code} + public void

[jira] [Updated] (YARN-6123) [YARN-5864] Add a test to make sure queues of orderingPolicy will be updated when childQueues is added or removed.

2017-02-26 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6123: -- Attachment: YARN-6123-branch-2.0002.patch Attaching branch-2 patch > [YARN-5864] Add a test to make sure queues