[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083467#comment-16083467 ] Haibo Chen commented on YARN-6706: -- hmm... Looks like the maxOppQueueLength is also used in

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083442#comment-16083442 ] Rohith Sharma K S commented on YARN-6733: - bq. The sub app name is just like the flow name. We need

[jira] [Updated] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2017-07-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5292: -- Attachment: YARN-5292.006.patch > NM Container lifecycle and state transitions to support for PAUSED

[jira] [Commented] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-11 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083450#comment-16083450 ] daemon commented on YARN-6791: -- [~templedf] hi, templedf. Can you help me review code? pretty thanks! > Add

[jira] [Reopened] (YARN-5292) NM Container lifecycle and state transitions to support for PAUSED container state.

2017-07-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-5292: --- Re-opening to cherry-pick and run Jenkins on trunk > NM Container lifecycle and state transitions to

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083352#comment-16083352 ] Haibo Chen commented on YARN-6706: -- Thanks for your reviews! I'll update the patch to get rid of

[jira] [Created] (YARN-6808) Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity

2017-07-11 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6808: - Summary: Allow Schedulers to return OPPORTUNISTIC containers when queues go over configured capacity Key: YARN-6808 URL: https://issues.apache.org/jira/browse/YARN-6808

[jira] [Created] (YARN-6807) Adding required missing configs to Federation configuration guide based on e2e testing

2017-07-11 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6807: Summary: Adding required missing configs to Federation configuration guide based on e2e testing Key: YARN-6807 URL: https://issues.apache.org/jira/browse/YARN-6807

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083301#comment-16083301 ] Hadoop QA commented on YARN-6798: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-6806) Scheduler-agnostic RM changes support oversubscription

2017-07-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-6806. -- Resolution: Duplicate > Scheduler-agnostic RM changes support oversubscription >

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-07-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083261#comment-16083261 ] Arun Suresh commented on YARN-6706: --- bq. You are referring to the else statement in

[jira] [Updated] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-11 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6798: --- Attachment: YARN-6798.v1.patch v1 patch uploaded that roll back version to 1.1, with added notes. What

[jira] [Created] (YARN-6806) Scheduler-agnostic RM changes support oversubscription

2017-07-11 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6806: Summary: Scheduler-agnostic RM changes support oversubscription Key: YARN-6806 URL: https://issues.apache.org/jira/browse/YARN-6806 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-6806) Scheduler-agnostic RM changes support oversubscription

2017-07-11 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6806: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > Scheduler-agnostic RM changes support

[jira] [Commented] (YARN-6775) CapacityScheduler: Improvements to assignContainers()

2017-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083166#comment-16083166 ] Wangda Tan commented on YARN-6775: -- bq. I think it is necessary because we need to keep track of the

[jira] [Reopened] (YARN-3254) HealthReport should include disk full information

2017-07-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened YARN-3254: -- Assignee: Suma Shivaprasad (was: Akira Ajisaka) > HealthReport should include disk full information >

[jira] [Commented] (YARN-6805) NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code

2017-07-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083110#comment-16083110 ] Jason Lowe commented on YARN-6805: -- Sample stack trace from a 2.8-based release: {noformat} 2017-07-10

[jira] [Created] (YARN-6805) NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code

2017-07-11 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-6805: Summary: NPE in LinuxContainerExecutor due to null PrivilegedOperationException exit code Key: YARN-6805 URL: https://issues.apache.org/jira/browse/YARN-6805 Project: Hadoop

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083084#comment-16083084 ] Eric Payne commented on YARN-2113: -- I see. Sure, will do. > Add cross-user preemption within

[jira] [Commented] (YARN-6775) CapacityScheduler: Improvements to assignContainers()

2017-07-11 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083045#comment-16083045 ] Nathan Roberts commented on YARN-6775: -- Thanks [~leftnoteasy] for the review. bq. 1)

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083017#comment-16083017 ] Wangda Tan commented on YARN-2113: -- [~eepayne], IIUC, you're planning to revert branch-2 commit for

[jira] [Commented] (YARN-6798) NM startup failure with old state store due to version mismatch

2017-07-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083034#comment-16083034 ] Arun Suresh commented on YARN-6798: --- I agree with Jason. To move forward, I suggest we follow YARN-6703

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083042#comment-16083042 ] Wangda Tan commented on YARN-2113: -- [~eepayne], I meant even if backport of the two patches doesn't have

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16083038#comment-16083038 ] Eric Payne commented on YARN-2113: -- bq. revert branch-2 commit for YARN-2113 and cherry-pick

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082989#comment-16082989 ] Eric Payne commented on YARN-2113: -- I should not have created a separate patch for the branch-2 backport.

[jira] [Commented] (YARN-6803) AM registration could fail if event processing is delayed.

2017-07-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082984#comment-16082984 ] Jason Lowe commented on YARN-6803: -- This looks like a duplicate of YARN-3260. Even if the token is setup

[jira] [Commented] (YARN-6742) Minor mistakes in "The YARN Service Registry" docs

2017-07-11 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082911#comment-16082911 ] Daniel Templeton commented on YARN-6742: Thanks for the patch. Overall a great set of language

[jira] [Updated] (YARN-6733) Add table for storing sub-application entities

2017-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6733: - Attachment: IMG_7040.JPG > Add table for storing sub-application entities >

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082810#comment-16082810 ] Vrushali C commented on YARN-6733: -- bq. I do not remember why subAppName was added!!? Can you remind me?

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082687#comment-16082687 ] Hadoop QA commented on YARN-6102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6102: Attachment: YARN-6102.03.patch > On failover RM can crash due to unregistered event to

[jira] [Created] (YARN-6804) Allow custom hostname for docker containers in native services

2017-07-11 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-6804: Summary: Allow custom hostname for docker containers in native services Key: YARN-6804 URL: https://issues.apache.org/jira/browse/YARN-6804 Project: Hadoop YARN

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082202#comment-16082202 ] Rohith Sharma K S commented on YARN-6733: - thanks Vrushali for the v0 patch. I vaguely remember

[jira] [Commented] (YARN-6803) AM registration could fail if event processing is delayed.

2017-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082423#comment-16082423 ] Bibin A Chundatt commented on YARN-6803: Will upload the patch after umanaged AM handling and

[jira] [Commented] (YARN-6742) Minor mistakes in "The YARN Service Registry" docs

2017-07-11 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082362#comment-16082362 ] Shane Kumpf commented on YARN-6742: --- Sorry for the delayed response. Thank you for addressing that issue.

[jira] [Commented] (YARN-6803) AM registration could fail if event processing is delayed.

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082356#comment-16082356 ] Hadoop QA commented on YARN-6803: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6797) TimelineWriter does not fully consume the POST response

2017-07-11 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082242#comment-16082242 ] Nathan Roberts commented on YARN-6797: -- Thanks Jason. +1 on this patch. > TimelineWriter does not

[jira] [Updated] (YARN-6803) AM registration could fail if event processing is delayed.

2017-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6803: --- Attachment: YARN-6803.001.patch > AM registration could fail if event processing is delayed. >

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-07-11 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082179#comment-16082179 ] Shane Kumpf commented on YARN-6726: --- I've uploaded a patch to address the items above and a few more. The

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082200#comment-16082200 ] Hadoop QA commented on YARN-6102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6296) ReservationId.compareTo ignores id when clustertimestamp is the same

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082183#comment-16082183 ] Hadoop QA commented on YARN-6296: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082170#comment-16082170 ] Hadoop QA commented on YARN-6726: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6296) ReservationId.compareTo ignores id when clustertimestamp is the same

2017-07-11 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082162#comment-16082162 ] Yeliang Cang commented on YARN-6296: Hi, [~haibochen], I have submit a patch like you suggested. Please

[jira] [Updated] (YARN-6296) ReservationId.compareTo ignores id when clustertimestamp is the same

2017-07-11 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-6296: --- Attachment: YARN-6296.001.patch > ReservationId.compareTo ignores id when clustertimestamp is the same

[jira] [Updated] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-07-11 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6726: -- Attachment: YARN-6726.001.patch > Fix issues with docker commands executed by container-executor >

[jira] [Updated] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6102: Attachment: YARN-6102.02.patch updated the patch adding test case and some minor refactoring

[jira] [Commented] (YARN-6801) NPE in RM while setting collectors map in NodeHeartbeatResponse

2017-07-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082123#comment-16082123 ] Rohith Sharma K S commented on YARN-6801: - committing shortly > NPE in RM while setting

[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082107#comment-16082107 ] Rohith Sharma K S commented on YARN-6102: - Assigning JIRA to myself as reporter not responded for a

[jira] [Assigned] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-11 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-6102: --- Assignee: Rohith Sharma K S (was: Ajith S) > On failover RM can crash due to

[jira] [Commented] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082111#comment-16082111 ] Hadoop QA commented on YARN-6791: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6803) AM registration could fail if event processing is delayed.

2017-07-11 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082110#comment-16082110 ] Bibin A Chundatt commented on YARN-6803: ClientToAMToken should be set before AMLaunch . > AM

[jira] [Created] (YARN-6803) AM registration could fail if event processing is delayed.

2017-07-11 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-6803: -- Summary: AM registration could fail if event processing is delayed. Key: YARN-6803 URL: https://issues.apache.org/jira/browse/YARN-6803 Project: Hadoop YARN

[jira] [Updated] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-11 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daemon updated YARN-6791: - Attachment: YARN-6791.002.patch > Add a new acl control to make YARN acl control perfect >

[jira] [Commented] (YARN-6714) IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-07-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082053#comment-16082053 ] Sunil G commented on YARN-6714: --- Committed to trunk. [~Tao Yang] please help to share branch-2 patch as its

[jira] [Commented] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16082006#comment-16082006 ] Hadoop QA commented on YARN-6802: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

2017-07-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081944#comment-16081944 ] Sunil G commented on YARN-6678: --- In last 2 runs and in local runs, I cannot see any more failures. [~Tao

[jira] [Updated] (YARN-6714) IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-07-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6714: -- Summary: IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in

[jira] [Commented] (YARN-6714) IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-07-11 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081980#comment-16081980 ] Hudson commented on YARN-6714: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11986 (See

[jira] [Commented] (YARN-6386) Graceful shutdown support on webui 2

2017-07-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081943#comment-16081943 ] Sunil G commented on YARN-6386: --- As mentioned earlier, patch and changes are looking good. Could you please

[jira] [Commented] (YARN-6280) Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API

2017-07-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081939#comment-16081939 ] Sunil G commented on YARN-6280: --- [~cltlfcjin] could you please help to share branch-2 patch. If you do not

[jira] [Commented] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081864#comment-16081864 ] Hadoop QA commented on YARN-6791: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6769) Put the no demand queue after the most in FairSharePolicy#compare

2017-07-11 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081923#comment-16081923 ] daemon commented on YARN-6769: -- [~yufeigu] Thanks yufei. You are right, I have already fix those problems. >

[jira] [Updated] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-11 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daemon updated YARN-6802: - Attachment: YARN-6802.001.patch > Support view leaf queue am resource usage in RM web ui >

[jira] [Commented] (YARN-5731) Preemption does not work in few corner cases when reservations are placed

2017-07-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081895#comment-16081895 ] Sunil G commented on YARN-5731: --- Test case failures seems related. I think since we enable this flag, we

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081810#comment-16081810 ] Hadoop QA commented on YARN-6733: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-11 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daemon updated YARN-6802: - Description: RM Web ui should support view leaf queue am resource usage. !screenshot-2.png! I will upload my

[jira] [Updated] (YARN-6791) Add a new acl control to make YARN acl control perfect

2017-07-11 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daemon updated YARN-6791: - Attachment: YARN-6791.001.patch > Add a new acl control to make YARN acl control perfect >

[jira] [Commented] (YARN-6733) Add table for storing sub-application entities

2017-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081813#comment-16081813 ] Vrushali C commented on YARN-6733: -- Will address the checkstyle issues along with any other review

[jira] [Updated] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-11 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daemon updated YARN-6802: - Attachment: screenshot-1.png > Support view leaf queue am resource usage in RM web ui >

[jira] [Updated] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-11 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daemon updated YARN-6802: - Attachment: screenshot-2.png > Support view leaf queue am resource usage in RM web ui >

[jira] [Updated] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-11 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] daemon updated YARN-6802: - Description: RM Web ui should support view leaf queue am resource usage. !screenshot-1.png! I will upload my

[jira] [Created] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-11 Thread daemon (JIRA)
daemon created YARN-6802: Summary: Support view leaf queue am resource usage in RM web ui Key: YARN-6802 URL: https://issues.apache.org/jira/browse/YARN-6802 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6786) ResourcePBImpl imports cleanup

2017-07-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081742#comment-16081742 ] Sunil G commented on YARN-6786: --- I could commit this patch if there are no objections tomorrow. >

[jira] [Commented] (YARN-6769) Put the no demand queue after the most in FairSharePolicy#compare

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081764#comment-16081764 ] Hadoop QA commented on YARN-6769: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6801) NPE in RM while setting collectors map in NodeHeartbeatResponse

2017-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081761#comment-16081761 ] Vrushali C commented on YARN-6801: -- It's interesting, it's not during the upgrade. It's when there are

[jira] [Updated] (YARN-6733) Add table for storing sub-application entities

2017-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6733: - Attachment: (was: YARN-6733-YARN-5355.001.patch) > Add table for storing sub-application entities >

[jira] [Updated] (YARN-6733) Add table for storing sub-application entities

2017-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6733: - Attachment: YARN-6733-YARN-5355.001.patch > Add table for storing sub-application entities >

[jira] [Updated] (YARN-6733) Add table for storing sub-application entities

2017-07-11 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6733: - Attachment: YARN-6733-YARN-5355.001.patch Attaching v001. - added a new package

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-07-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081745#comment-16081745 ] Arun Suresh commented on YARN-6594: --- So the reason I feel retaining the {{ContainerRequest}} is a good

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2017-07-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081731#comment-16081731 ] Hadoop QA commented on YARN-6492: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||