[jira] [Updated] (YARN-6769) Put no demand queue after the most in FairSharePolicy#compare

2017-07-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6769: --- Summary: Put no demand queue after the most in FairSharePolicy#compare (was: Put the no demand queue after

[jira] [Created] (YARN-6822) TestContainerManagerSecurity tests fail on trunk

2017-07-14 Thread Sonia Garudi (JIRA)
Sonia Garudi created YARN-6822: -- Summary: TestContainerManagerSecurity tests fail on trunk Key: YARN-6822 URL: https://issues.apache.org/jira/browse/YARN-6822 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-6769) Make schedulables without demand less needy in FairSharePolicy#compare

2017-07-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6769: --- Summary: Make schedulables without demand less needy in FairSharePolicy#compare (was: Put no demand queue

[jira] [Commented] (YARN-6769) Make schedulables without demand less needy in FairSharePolicy#compare

2017-07-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086920#comment-16086920 ] Yufei Gu commented on YARN-6769: Committed to trunk and branch-2. Thanks [~daemon] for working on this.

[jira] [Commented] (YARN-6769) Make schedulables without demand less needy in FairSharePolicy#compare

2017-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086926#comment-16086926 ] Hudson commented on YARN-6769: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12006 (See

[jira] [Created] (YARN-6823) TestRMRestart#testRMRestartWaitForPreviousAMToFinish consistently fails in PreCommit build

2017-07-14 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6823: -- Summary: TestRMRestart#testRMRestartWaitForPreviousAMToFinish consistently fails in PreCommit build Key: YARN-6823 URL: https://issues.apache.org/jira/browse/YARN-6823 Project:

[jira] [Commented] (YARN-6823) TestRMRestart#testRMRestartWaitForPreviousAMToFinish consistently fails in PreCommit build

2017-07-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086950#comment-16086950 ] Bibin A Chundatt commented on YARN-6823: Duplicate of YARN-6759. Can be closed as duplicate >

[jira] [Updated] (YARN-6759) Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure

2017-07-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6759: --- Summary: Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure (was:

[jira] [Updated] (YARN-6759) TestRMRestart.testRMRestartWaitForPreviousAMToFinish consistent failure

2017-07-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6759: --- Summary: TestRMRestart.testRMRestartWaitForPreviousAMToFinish consistent failure (was:

[jira] [Created] (YARN-6825) RM quit due to ApplicationStateData exceed the limit size of znode in zk

2017-07-14 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-6825: --- Summary: RM quit due to ApplicationStateData exceed the limit size of znode in zk Key: YARN-6825 URL: https://issues.apache.org/jira/browse/YARN-6825 Project:

[jira] [Commented] (YARN-6819) Application report fails if app rejected due to nodesize

2017-07-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087059#comment-16087059 ] Rohith Sharma K S commented on YARN-6819: - There are some other un covered issues with YARN-5006.

[jira] [Commented] (YARN-5146) [YARN-3368] Supports Fair Scheduler in new YARN UI

2017-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086937#comment-16086937 ] Sunil G commented on YARN-5146: --- I think your adapter is wrong. {noformat} Request

[jira] [Updated] (YARN-6759) Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure

2017-07-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6759: --- Target Version/s: (was: 2.9.0, 3.0.0-beta1) Fix Version/s: 3.0.0-beta1

[jira] [Commented] (YARN-6759) Fix TestRMRestart.testRMRestartWaitForPreviousAMToFinish failure

2017-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087045#comment-16087045 ] Hudson commented on YARN-6759: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12007 (See

[jira] [Commented] (YARN-6819) Application report fails if app rejected due to nodesize

2017-07-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16086944#comment-16086944 ] Bibin A Chundatt commented on YARN-6819: {{TestDelegationTokenRenewer}} locally its running fine

[jira] [Created] (YARN-6824) Implement kafka writer of timeline server

2017-07-14 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-6824: - Summary: Implement kafka writer of timeline server Key: YARN-6824 URL: https://issues.apache.org/jira/browse/YARN-6824 Project: Hadoop YARN Issue Type:

[jira] [Resolved] (YARN-6823) TestRMRestart#testRMRestartWaitForPreviousAMToFinish consistently fails in PreCommit build

2017-07-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt resolved YARN-6823. Resolution: Duplicate > TestRMRestart#testRMRestartWaitForPreviousAMToFinish consistently

[jira] [Updated] (YARN-4455) Support fetching metrics by time range

2017-07-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4455: --- Affects Version/s: (was: YARN-2928) YARN-5355 > Support fetching metrics by

[jira] [Updated] (YARN-4455) Support fetching metrics by time range

2017-07-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4455: --- Attachment: YARN-4455-YARN-5355.02.patch > Support fetching metrics by time range >

[jira] [Commented] (YARN-6280) Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087269#comment-16087269 ] Hadoop QA commented on YARN-6280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6819) Application report fails if app rejected due to nodesize

2017-07-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087372#comment-16087372 ] Rohith Sharma K S commented on YARN-6819: - +1 lgtm, would mind fixing checkstyle which is fixable?

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087233#comment-16087233 ] Rohith Sharma K S commented on YARN-4455: - thanks [~varun_saxena] for working on this jira. Overall

[jira] [Commented] (YARN-6714) IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087252#comment-16087252 ] Hadoop QA commented on YARN-6714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087301#comment-16087301 ] Rohith Sharma K S commented on YARN-6733: - Thanks Vrushali updating patch. I will take a look at

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087323#comment-16087323 ] Varun Saxena commented on YARN-4455: Thanks [~rohithsharma] for the review. bq. Just for curiosity,

[jira] [Comment Edited] (YARN-6714) IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-07-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087164#comment-16087164 ] Tao Yang edited comment on YARN-6714 at 7/14/17 2:14 PM: - Sorry to have misplaced

[jira] [Updated] (YARN-6714) IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-07-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6714: --- Attachment: (was: YARN-6714.branch-2.005.patch) > IllegalStateException while handling APP_ATTEMPT_REMOVED

[jira] [Updated] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

2017-07-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6678: --- Attachment: YARN-6678.005.patch Sure, upload new patch to resolve the conflict with YARN-6714 in

[jira] [Commented] (YARN-6825) RM quit due to ApplicationStateData exceed the limit size of znode in zk

2017-07-14 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087303#comment-16087303 ] Bibin A Chundatt commented on YARN-6825: {quote} I think 80% of configured jute buffer should be

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087389#comment-16087389 ] Sunil G commented on YARN-2113: --- Thank you very much [~eepayne]. I also just verified the same. > Add

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.005.patch Thanks [~leftnoteasy] Addressed first set of comments. But I am

[jira] [Updated] (YARN-6826) SLS NMSimulator support for Opportunistic Container Queuing

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6826: -- Summary: SLS NMSimulator support for Opportunistic Container Queuing (was: SLS NMSimulator support for

[jira] [Reopened] (YARN-5049) Extend NMStateStore to save queued container information

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-5049: --- Assignee: Arun Suresh (was: Konstantinos Karanasos) > Extend NMStateStore to save queued container

[jira] [Comment Edited] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088085#comment-16088085 ] Ray Chiang edited comment on YARN-6798 at 7/14/17 9:17 PM: --- Updating the version

[jira] [Commented] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088136#comment-16088136 ] Wangda Tan commented on YARN-6808: -- [~asuresh], If it uses main scheduler, it will be much better than

[jira] [Commented] (YARN-6741) Deleting all children of a Parent Queue on refresh throws exception

2017-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088153#comment-16088153 ] Wangda Tan commented on YARN-6741: -- [~naganarasimha...@apache.org], Could you add more description of what

[jira] [Commented] (YARN-6775) CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls

2017-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088155#comment-16088155 ] Wangda Tan commented on YARN-6775: -- TestCapacityScheduler failures are tracked by: YARN-6240, will commit

[jira] [Commented] (YARN-6775) CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls

2017-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088169#comment-16088169 ] Wangda Tan commented on YARN-6775: -- [~nroberts], there're some conflicts to apply patches to branch-2

[jira] [Updated] (YARN-6223) [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN

2017-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6223: - Attachment: YARN-6223.wip.3.patch Attached ver.3 patch, make container-executor code changes better

[jira] [Commented] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-07-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087971#comment-16087971 ] Robert Kanter commented on YARN-6625: - Two last minor things and then we're good to go: # The

[jira] [Commented] (YARN-3260) AM attempt fail to register before RM processes launch event

2017-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087996#comment-16087996 ] Hudson commented on YARN-3260: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12008 (See

[jira] [Commented] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088052#comment-16088052 ] Hadoop QA commented on YARN-6625: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-5049) Extend NMStateStore to save queued container information

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5049: - Assignee: Konstantinos Karanasos (was: Arun Suresh) > Extend NMStateStore to save queued

[jira] [Commented] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-07-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088062#comment-16088062 ] Robert Kanter commented on YARN-6625: - +1 > yarn application -list returns a tracking URL for AM that

[jira] [Resolved] (YARN-6243) CapacityScheduler: canAssignToThisQueue should be called only when necessary

2017-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-6243. -- Resolution: Duplicate Duplicated to YARN-6775 > CapacityScheduler: canAssignToThisQueue should be

[jira] [Commented] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-07-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088138#comment-16088138 ] Yufei Gu commented on YARN-6625: Thanks [~rkanter] for the review and lots of off-line discussion. > yarn

[jira] [Commented] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-07-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088145#comment-16088145 ] Hudson commented on YARN-6625: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12011 (See

[jira] [Updated] (YARN-6818) User limit per partition is not honored in branch-2.7 >=

2017-07-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6818: Labels: blocker (was: ) > User limit per partition is not honored in branch-2.7 >= >

[jira] [Updated] (YARN-6818) User limit per partition is not honored in branch-2.7 >=

2017-07-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6818: Labels: release-blocker (was: blocker) > User limit per partition is not honored in branch-2.7 >= >

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088015#comment-16088015 ] Ray Chiang commented on YARN-6798: -- Thanks [~asuresh]. That's what I get for relying on JIRA and

[jira] [Updated] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-07-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6625: --- Attachment: YARN-6625.004.patch Thanks [~rkanter]. Uploaded patch v4 for your comments. > yarn application

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088058#comment-16088058 ] Arun Suresh commented on YARN-6798: --- [~rchiang], I've committed YARN-5049 to branch-2 (cherry-picked and

[jira] [Assigned] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang reassigned YARN-6798: Assignee: Botong Huang (was: Ray Chiang) > NM startup failure with old state store due to version

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-14 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088088#comment-16088088 ] Botong Huang commented on YARN-6798: Sounds good, thx! > NM startup failure with old state store due

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088085#comment-16088085 ] Ray Chiang commented on YARN-6798: -- Updating the version table: || Patch || LevelDBKey(s) || Hadoop

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087965#comment-16087965 ] Arun Suresh commented on YARN-6798: --- I had rolled back YARN-5049 from branch-2 precisely because of the

[jira] [Commented] (YARN-5049) Extend NMStateStore to save queued container information

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087964#comment-16087964 ] Arun Suresh commented on YARN-5049: --- Re-opening for branch-2 commit > Extend NMStateStore to save queued

[jira] [Updated] (YARN-5049) Extend NMStateStore to save queued container information

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5049: -- Fix Version/s: 2.9.0 > Extend NMStateStore to save queued container information >

[jira] [Resolved] (YARN-5049) Extend NMStateStore to save queued container information

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5049. --- Resolution: Fixed Committed to branch-2 as well > Extend NMStateStore to save queued container

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088081#comment-16088081 ] Ray Chiang commented on YARN-6798: -- Thanks [~asuresh]! [~botong], it looks like we'll use 1.2 as our

[jira] [Commented] (YARN-6714) IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087709#comment-16087709 ] Hadoop QA commented on YARN-6714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5146) [YARN-3368] Supports Fair Scheduler in new YARN UI

2017-07-14 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087824#comment-16087824 ] Abdullah Yousufi edited comment on YARN-5146 at 7/14/17 7:09 PM: - Hey

[jira] [Commented] (YARN-6471) Support to add min/max resource configuration for a queue

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087940#comment-16087940 ] Hadoop QA commented on YARN-6471: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6822) TestContainerManagerSecurity tests fail on trunk

2017-07-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087482#comment-16087482 ] Ray Chiang commented on YARN-6822: -- [~Sonia], can you confirm whether this issue continues after applying

[jira] [Commented] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087615#comment-16087615 ] Hadoop QA commented on YARN-6808: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6775) CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087851#comment-16087851 ] Hadoop QA commented on YARN-6775: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087910#comment-16087910 ] Hadoop QA commented on YARN-6788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087699#comment-16087699 ] Jian He commented on YARN-6804: --- bq. Do you think we should remove them all? ok, I didn't see those. I don't

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087719#comment-16087719 ] Ray Chiang commented on YARN-6798: -- Finally got a bit of time to look at the previous patches. I see a

[jira] [Updated] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-07-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6625: --- Attachment: YARN-6625.003.patch Thanks [~rkanter] for the review. Uploaded patch v3 for all your comments. >

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

2017-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087794#comment-16087794 ] Wangda Tan commented on YARN-1011: -- Thanks [~kasha] / [~haibo.chen] for the proposal. I just left some

[jira] [Commented] (YARN-5146) [YARN-3368] Supports Fair Scheduler in new YARN UI

2017-07-14 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087824#comment-16087824 ] Abdullah Yousufi commented on YARN-5146: Hey [~sunilg]], thanks for catching that! How can I

[jira] [Comment Edited] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087782#comment-16087782 ] Wangda Tan edited comment on YARN-6808 at 7/14/17 6:49 PM: --- Thanks [~asuresh] for

[jira] [Commented] (YARN-6625) yarn application -list returns a tracking URL for AM that doesn't work in secured and HA environment

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087760#comment-16087760 ] Hadoop QA commented on YARN-6625: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6771) Use classloader inside configuration class to make new classes

2017-07-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087770#comment-16087770 ] Sangjin Lee commented on YARN-6771: --- Thanks for the contribution [~jongyoul]. It appears that the same

[jira] [Commented] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087782#comment-16087782 ] Wangda Tan commented on YARN-6808: -- Thanks [~asuresh] for the additional explanations. Frankly speaking,

[jira] [Commented] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087835#comment-16087835 ] Arun Suresh commented on YARN-6808: --- [~leftnoteasy], bq. Currently, opportunistic container allocation

[jira] [Updated] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6808: -- Attachment: YARN-6808.002.patch Attaching v002. > Allow Schedulers to return OPPORTUNISTIC containers

[jira] [Updated] (YARN-6775) CapacityScheduler: Improvements to assignContainers, avoid unnecessary canAssignToUser/Queue calls

2017-07-14 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-6775: - Attachment: YARN-6775.branch-2.8.002.patch > CapacityScheduler: Improvements to assignContainers,

[jira] [Commented] (YARN-6818) User limit per partition is not honored in branch-2.7 >=

2017-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087580#comment-16087580 ] Sunil G commented on YARN-6818: --- Yes. Thanks [~jhung]. I will wait for [~naganarasimha...@apache.org] as

[jira] [Comment Edited] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087500#comment-16087500 ] Arun Suresh edited comment on YARN-6808 at 7/14/17 3:55 PM: [~leftnoteasy],

[jira] [Commented] (YARN-6714) IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087542#comment-16087542 ] Hadoop QA commented on YARN-6714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6471) Support to add min/max resource configuration for a queue

2017-07-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6471: -- Attachment: YARN-6471-YARN-5881.001.patch Attaching patch against branch and kicking jenkins > Support to add

[jira] [Updated] (YARN-6714) IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-07-14 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-6714: --- Attachment: YARN-6714.branch-2.006.patch > IllegalStateException while handling APP_ATTEMPT_REMOVED event when

[jira] [Created] (YARN-6826) SLS NMSimulator support for Opportunistic Container Queuing.

2017-07-14 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6826: - Summary: SLS NMSimulator support for Opportunistic Container Queuing. Key: YARN-6826 URL: https://issues.apache.org/jira/browse/YARN-6826 Project: Hadoop YARN

[jira] [Updated] (YARN-6826) SLS NMSimulator support for Opportunistic Container Queuing

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6826: -- Issue Type: Improvement (was: Bug) > SLS NMSimulator support for Opportunistic Container Queuing >

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087517#comment-16087517 ] Billie Rinaldi commented on YARN-6804: -- bq. I think the check for if “LOG.isInfoEnabled” is not

[jira] [Updated] (YARN-6818) User limit per partition is not honored in branch-2.7 >=

2017-07-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6818: Affects Version/s: 2.7.4 > User limit per partition is not honored in branch-2.7 >= >

[jira] [Commented] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087500#comment-16087500 ] Arun Suresh commented on YARN-6808: --- [~leftnoteasy], good questions.. bq. Use opportunistic container to

[jira] [Comment Edited] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087500#comment-16087500 ] Arun Suresh edited comment on YARN-6808 at 7/14/17 3:49 PM: [~leftnoteasy],

[jira] [Comment Edited] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16087500#comment-16087500 ] Arun Suresh edited comment on YARN-6808 at 7/14/17 3:50 PM: [~leftnoteasy],

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-07-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088357#comment-16088357 ] Subru Krishnan commented on YARN-6704: -- Thanks [~botong] for the patch. I looked and have a few

[jira] [Updated] (YARN-6741) Deleting all children of a Parent Queue on refresh throws exception

2017-07-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6741: Description: If we configure CS such that all children of a parent queue are deleted and

[jira] [Updated] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-14 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5412: --- Attachment: YARN-5412-YARN-2915.4.patch > Create a proxy chain for

[jira] [Commented] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-14 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088309#comment-16088309 ] Giovanni Matteo Fumarola commented on YARN-5412: Attached v4. It addresses the remaining

[jira] [Commented] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088371#comment-16088371 ] Hadoop QA commented on YARN-5412: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6818) User limit per partition is not honored in branch-2.7 >=

2017-07-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088310#comment-16088310 ] Naganarasimha G R commented on YARN-6818: - Thanks [~sunilg] for the reviews and [~jhung] for

[jira] [Commented] (YARN-4455) Support fetching metrics by time range

2017-07-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088442#comment-16088442 ] Rohith Sharma K S commented on YARN-4455: - I was just thinking on REST API filters metricstimestart

[jira] [Updated] (YARN-6307) Refactor FairShareComparator#compare

2017-07-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6307: --- Attachment: YARN-6307.002.patch Rebase it since YARN-6769 was in. > Refactor FairShareComparator#compare >

[jira] [Commented] (YARN-6307) Refactor FairShareComparator#compare

2017-07-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16088355#comment-16088355 ] Hadoop QA commented on YARN-6307: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >