[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-12-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712021#comment-15712021 ] Eric Payne commented on YARN-4390: -- Hi [~leftnoteasy], I am making an effort to backport to branch-2.8

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-12-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712097#comment-15712097 ] Eric Payne commented on YARN-5889: -- bq. Any change in resource (allocation and release of container etc)

[jira] [Updated] (YARN-5956) Refactor ClientRMService

2016-12-01 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-5956: - Attachment: YARN-5956.01.patch > Refactor ClientRMService > > >

[jira] [Comment Edited] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-12-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712097#comment-15712097 ] Eric Payne edited comment on YARN-5889 at 12/1/16 2:29 PM: --- bq. Any change in

[jira] [Created] (YARN-5956) Refactor ClientRMService

2016-12-01 Thread Kai Sasaki (JIRA)
Kai Sasaki created YARN-5956: Summary: Refactor ClientRMService Key: YARN-5956 URL: https://issues.apache.org/jira/browse/YARN-5956 Project: Hadoop YARN Issue Type: Improvement

[jira] [Comment Edited] (YARN-5955) Use threadpool or multiple thread to recover app

2016-12-01 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711953#comment-15711953 ] Varun Saxena edited comment on YARN-5955 at 12/1/16 1:23 PM: - We have actually

[jira] [Commented] (YARN-5956) Refactor ClientRMService

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712306#comment-15712306 ] Hadoop QA commented on YARN-5956: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2016-12-01 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712113#comment-15712113 ] Kai Sasaki commented on YARN-5734: -- I'm also interested in flexible Queue configuration management because

[jira] [Commented] (YARN-5955) Use threadpool or multiple thread to recover app

2016-12-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712530#comment-15712530 ] Daniel Templeton commented on YARN-5955: There's also YARN-4494 that backgrounds the whole recovery

[jira] [Created] (YARN-5957) NMWebAppFilter currently drops end of URL during container log redirection

2016-12-01 Thread Eric Badger (JIRA)
Eric Badger created YARN-5957: - Summary: NMWebAppFilter currently drops end of URL during container log redirection Key: YARN-5957 URL: https://issues.apache.org/jira/browse/YARN-5957 Project: Hadoop

[jira] [Commented] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-12-01 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712547#comment-15712547 ] Haibo Chen commented on YARN-5922: -- Thanks [~sjlee0] for your review! Does it make sense to add the new

[jira] [Commented] (YARN-5956) Refactor ClientRMService

2016-12-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712603#comment-15712603 ] Daniel Templeton commented on YARN-5956: Thanks for the patch, [~lewuathe]! Looks good except that

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-01 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712859#comment-15712859 ] Vrushali C commented on YARN-4675: -- As discussed in the call today, let's discuss if we need to do this

[jira] [Assigned] (YARN-4990) Re-direction of a particular log file within in a container in NM UI does not redirect properly to Log Server ( history ) on container completion

2016-12-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-4990: --- Assignee: Xuan Gong > Re-direction of a particular log file within in a container in NM UI does not

[jira] [Commented] (YARN-5957) NMWebAppFilter currently drops end of URL during container log redirection

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712955#comment-15712955 ] Hadoop QA commented on YARN-5957: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5925) Extract hbase-backend-exclusive utility methods from TimelineStorageUtil

2016-12-01 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712811#comment-15712811 ] Haibo Chen commented on YARN-5925: -- [~sjlee0] Can you link the jira that this one needs wait for? Sorry,

[jira] [Commented] (YARN-5746) The state of the parentQueue and its childQueues should be synchronized.

2016-12-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712866#comment-15712866 ] Xuan Gong commented on YARN-5746: - Fix the checkstyle issue > The state of the parentQueue and its

[jira] [Updated] (YARN-5746) The state of the parentQueue and its childQueues should be synchronized.

2016-12-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5746: Attachment: YARN-5746.6.patch > The state of the parentQueue and its childQueues should be synchronized. >

[jira] [Commented] (YARN-5925) Extract hbase-backend-exclusive utility methods from TimelineStorageUtil

2016-12-01 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712877#comment-15712877 ] Sangjin Lee commented on YARN-5925: --- It's YARN-5739. > Extract hbase-backend-exclusive utility methods

[jira] [Commented] (YARN-5956) Refactor ClientRMService

2016-12-01 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712775#comment-15712775 ] Rohith Sharma K S commented on YARN-5956: - As part of this JIRA, we can remove duplicate code which

[jira] [Updated] (YARN-5957) NMWebAppFilter currently drops end of URL during container log redirection

2016-12-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5957: -- Attachment: YARN-5957.001.patch Attaching patch that appends the end of the input URL to the end of the

[jira] [Commented] (YARN-3409) Add constraint node labels

2016-12-01 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712803#comment-15712803 ] Naganarasimha G R commented on YARN-3409: - Thanks for support [~devaraj.k] & [~kkaranasos], Its

[jira] [Commented] (YARN-4675) Reorganize TimeClientImpl into TimeClientV1Impl and TimeClientV2Impl

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712881#comment-15712881 ] Li Lu commented on YARN-4675: - Yes I agree we need to decide on this issue soon. +1 for reorganizing

[jira] [Commented] (YARN-3409) Add constraint node labels

2016-12-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712946#comment-15712946 ] Wangda Tan commented on YARN-3409: -- Thanks all for discussion, sorry for the delayed response, I'm still

[jira] [Updated] (YARN-5958) Fix ASF license warnings for slider core module

2016-12-01 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-5958: - Attachment: YARN-5958-yarn-native-services.001.patch > Fix ASF license warnings for slider core

[jira] [Commented] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2016-12-01 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713186#comment-15713186 ] Robert Kanter commented on YARN-5734: - Oozie has run into scalability problems with Derby, but I would

[jira] [Commented] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-12-01 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713216#comment-15713216 ] Haibo Chen commented on YARN-5901: -- Will update the patch shortly. > Fix race condition in TestGetGroups

[jira] [Updated] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-12-01 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5901: - Attachment: YARN-5901.03.patch > Fix race condition in TestGetGroups beforeclass setup() >

[jira] [Created] (YARN-5958) Fix ASF license warnings for slider core module

2016-12-01 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-5958: Summary: Fix ASF license warnings for slider core module Key: YARN-5958 URL: https://issues.apache.org/jira/browse/YARN-5958 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.006.patch New patch to address review comments. > Provide timeline reader API to

[jira] [Commented] (YARN-5746) The state of the parentQueue and its childQueues should be synchronized.

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713023#comment-15713023 ] Hadoop QA commented on YARN-5746: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713294#comment-15713294 ] Hadoop QA commented on YARN-5739: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5756) Add state-machine implementation for queues

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713290#comment-15713290 ] Li Lu commented on YARN-5756: - Seems like the second submission has been ignored by Jenkins. Kick it for one

[jira] [Commented] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713312#comment-15713312 ] Hadoop QA commented on YARN-5901: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: YARN-5739-YARN-5355.006.patch New 006 patch to make Jenkins happy. > Provide timeline reader API to

[jira] [Updated] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2902: - Fix Version/s: 2.8.0 > Killing a container that is localizing can orphan resources in the > DOWNLOADING

[jira] [Updated] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-12-01 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5901: - Attachment: YARN-5901-branch-2.03.patch Uploading a patch for branch-2. > Fix race condition in

[jira] [Updated] (YARN-3727) For better error recovery, check if the directory exists before using it for localization.

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3727: - Fix Version/s: 2.8.0 > For better error recovery, check if the directory exists before using it for >

[jira] [Updated] (YARN-3690) [JDK8] 'mvn site' fails

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3690: - Fix Version/s: 2.8.0 > [JDK8] 'mvn site' fails > --- > > Key:

[jira] [Commented] (YARN-5958) Fix ASF license warnings for slider core module

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713299#comment-15713299 ] Hadoop QA commented on YARN-5958: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-5739: Attachment: (was: YARN-5739-YARN-5355.006.patch) > Provide timeline reader API to list available timeline entity

[jira] [Updated] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3362: - Fix Version/s: 2.8.0 > Add node label usage in RM CapacityScheduler web UI >

[jira] [Updated] (YARN-3535) Scheduler must re-request container resources when RMContainer transitions from ALLOCATED to KILLED

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3535: - Fix Version/s: 2.8.0 > Scheduler must re-request container resources when RMContainer transitions > from

[jira] [Updated] (YARN-3508) Prevent processing preemption events on the main RM dispatcher

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3508: - Fix Version/s: 2.8.0 > Prevent processing preemption events on the main RM dispatcher >

[jira] [Updated] (YARN-5197) RM leaks containers if running container disappears from node update

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5197: - Fix Version/s: 2.8.0 > RM leaks containers if running container disappears from node update >

[jira] [Updated] (YARN-3170) YARN architecture document needs updating

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3170: - Fix Version/s: 2.8.0 > YARN architecture document needs updating >

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3136: - Fix Version/s: 2.8.0 > getTransferredContainers can be a bottleneck during AM registration >

[jira] [Updated] (YARN-2801) Add documentation for node labels feature

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2801: - Fix Version/s: 2.8.0 > Add documentation for node labels feature >

[jira] [Commented] (YARN-5756) Add state-machine implementation for queues

2016-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713505#comment-15713505 ] Li Lu commented on YARN-5756: - Thanks [~xgong] for the patch! Generally fine, some comments: QueueState.java

[jira] [Updated] (YARN-3697) FairScheduler: ContinuousSchedulingThread can fail to shutdown

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3697: - Fix Version/s: 2.8.0 > FairScheduler: ContinuousSchedulingThread can fail to shutdown >

[jira] [Updated] (YARN-4005) Completed container whose app is finished is not removed from NMStateStore

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4005: - Fix Version/s: 2.8.0 > Completed container whose app is finished is not removed from NMStateStore >

[jira] [Commented] (YARN-5915) ATS 1.5 FileSystemTimelineWriter causes flush() to be called after every event write

2016-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713282#comment-15713282 ] Jason Lowe commented on YARN-5915: -- Sure if the output stream could be unbuffered then having it buffer at

[jira] [Commented] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2016-12-01 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713297#comment-15713297 ] Jonathan Hung commented on YARN-5734: - Thanks [~lewuathe], right now we are working on initial patches,

[jira] [Commented] (YARN-5915) ATS 1.5 FileSystemTimelineWriter causes flush() to be called after every event write

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713331#comment-15713331 ] Junping Du commented on YARN-5915: -- Cool. +1 as well. > ATS 1.5 FileSystemTimelineWriter causes flush()

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-12-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713359#comment-15713359 ] Jason Lowe commented on YARN-5910: -- Pinging [~daryn] since I'm sure he has an opinion on this. I'm not

[jira] [Commented] (YARN-5197) RM leaks containers if running container disappears from node update

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713384#comment-15713384 ] Junping Du commented on YARN-5197: -- I think the patch goes to branch-2.8 as well. Add 2.8 in fix version.

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713412#comment-15713412 ] Hadoop QA commented on YARN-5739: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-12-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713440#comment-15713440 ] Daniel Templeton commented on YARN-5901: LGTM +1 > Fix race condition in TestGetGroups beforeclass

[jira] [Commented] (YARN-5910) Support for multi-cluster delegation tokens

2016-12-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713444#comment-15713444 ] Jian He commented on YARN-5910: --- Thanks for your inputs, Jason bq. Once we have a keytab, is there a need to

[jira] [Commented] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-12-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713513#comment-15713513 ] Hudson commented on YARN-5901: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10926 (See

[jira] [Commented] (YARN-4931) Preempted resources go back to the same application

2016-12-01 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712538#comment-15712538 ] Miles Crawford commented on YARN-4931: -- ``` drf 5 20 0.8 fair ``` We use

[jira] [Comment Edited] (YARN-4931) Preempted resources go back to the same application

2016-12-01 Thread Miles Crawford (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15712538#comment-15712538 ] Miles Crawford edited comment on YARN-4931 at 12/1/16 5:24 PM: --- {code}

[jira] [Commented] (YARN-5694) ZKRMStateStore can prevent the transition to standby in branch-2.7 if the ZK node is unreachable

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713847#comment-15713847 ] Hadoop QA commented on YARN-5694: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

2016-12-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713858#comment-15713858 ] Miklos Szegedi commented on YARN-5714: -- Thank you, for the patch, [~rcatherinot]! 1. "%%A%%" should

[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Attachment: YARN-5938-YARN-5085.002.patch Updating patch.. moved SchedulerRequestKey to a common, so it

[jira] [Assigned] (YARN-5959) Add support for ExecutionType change from OPPORTUNISTIC to GUARANTEED

2016-12-01 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5959: - Assignee: Arun Suresh > Add support for ExecutionType change from OPPORTUNISTIC to GUARANTEED >

[jira] [Created] (YARN-5959) Add support for ExecutionType change from OPPORTUNISTIC to GUARANTEED

2016-12-01 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5959: - Summary: Add support for ExecutionType change from OPPORTUNISTIC to GUARANTEED Key: YARN-5959 URL: https://issues.apache.org/jira/browse/YARN-5959 Project: Hadoop YARN

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713918#comment-15713918 ] Hadoop QA commented on YARN-5548: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2016-12-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5548: --- Attachment: YARN-5548.0009.patch > Use MockRMMemoryStateStore to reduce test failures >

[jira] [Commented] (YARN-5922) Remove direct references of HBaseTimelineWriter/Reader in core ATS classes

2016-12-01 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713815#comment-15713815 ] Sangjin Lee commented on YARN-5922: --- Sorry I was assuming incorrectly that these properties were not

[jira] [Commented] (YARN-5739) Provide timeline reader API to list available timeline entity types for one application

2016-12-01 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713829#comment-15713829 ] Sangjin Lee commented on YARN-5739: --- The latest patch LGTM. Thanks [~gtCarrera9] for the update! I'll

[jira] [Comment Edited] (YARN-5292) Support for PAUSED container state

2016-12-01 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713883#comment-15713883 ] Hitesh Sharma edited comment on YARN-5292 at 12/2/16 3:21 AM: -- [~asuresh]],

[jira] [Commented] (YARN-5292) Support for PAUSED container state

2016-12-01 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713883#comment-15713883 ] Hitesh Sharma commented on YARN-5292: - [~arun suresh], can you please look at the attached patch?

[jira] [Comment Edited] (YARN-5292) Support for PAUSED container state

2016-12-01 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713883#comment-15713883 ] Hitesh Sharma edited comment on YARN-5292 at 12/2/16 3:21 AM: -- [~asuresh], can

[jira] [Updated] (YARN-5901) Fix race condition in TestGetGroups beforeclass setup()

2016-12-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5901: --- Fix Version/s: 3.0.0-alpha2 > Fix race condition in TestGetGroups beforeclass setup() >

[jira] [Updated] (YARN-5694) ZKRMStateStore can prevent the transition to standby in branch-2.7 if the ZK node is unreachable

2016-12-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-5694: --- Attachment: YARN-5694.branch-2.6.002.patch Uploading new branch-2.6 patch to fix the test. >

[jira] [Updated] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4000: - Fix Version/s: 2.8.0 > RM crashes with NPE if leaf queue becomes parent queue during restart >

[jira] [Updated] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3975: - Fix Version/s: 2.8.0 > WebAppProxyServlet should not redirect to RM page if AHS is enabled >

[jira] [Updated] (YARN-3969) Allow jobs to be submitted to reservation that is active but does not have any allocations

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3969: - Fix Version/s: 2.8.0 > Allow jobs to be submitted to reservation that is active but does not have > any

[jira] [Updated] (YARN-5746) The state of the parentQueue and its childQueues should be synchronized.

2016-12-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5746: Attachment: YARN-5746.7.patch Fix the unit test failure > The state of the parentQueue and its childQueues

[jira] [Updated] (YARN-3967) Fetch the application report from the AHS if the RM does not know about it

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3967: - Fix Version/s: 2.8.0 > Fetch the application report from the AHS if the RM does not know about it >

[jira] [Commented] (YARN-5958) Fix ASF license warnings for slider core module

2016-12-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713706#comment-15713706 ] Gour Saha commented on YARN-5958: - Have been yearning to see the ASF license errors gone. Thanks

[jira] [Updated] (YARN-4009) CORS support for ResourceManager REST API

2016-12-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4009: - Fix Version/s: 2.8.0 > CORS support for ResourceManager REST API >

[jira] [Commented] (YARN-5955) Use threadpool or multiple thread to recover app

2016-12-01 Thread Zhaofei Meng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15713671#comment-15713671 ] Zhaofei Meng commented on YARN-5955: OK. > Use threadpool or multiple thread to recover app >

[jira] [Updated] (YARN-5958) Fix ASF license warnings for slider core module

2016-12-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-5958: Fix Version/s: yarn-native-services > Fix ASF license warnings for slider core module >

[jira] [Updated] (YARN-5944) Native services AM should remain up if RM is down

2016-12-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-5944: Fix Version/s: yarn-native-services > Native services AM should remain up if RM is down >

[jira] [Created] (YARN-5955) Use threadpool or multiple thread to recover app

2016-12-01 Thread 5feixiang (JIRA)
5feixiang created YARN-5955: --- Summary: Use threadpool or multiple thread to recover app Key: YARN-5955 URL: https://issues.apache.org/jira/browse/YARN-5955 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5932) Retrospect moveApplicationToQueue in align with YARN-5611

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711827#comment-15711827 ] Hadoop QA commented on YARN-5932: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4931) Preempted resources go back to the same application

2016-12-01 Thread Yevhenii Semenov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711738#comment-15711738 ] Yevhenii Semenov commented on YARN-4931: Hi [~milesc], I have met the same issue. After

[jira] [Updated] (YARN-5932) Retrospect moveApplicationToQueue in align with YARN-5611

2016-12-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5932: -- Attachment: YARN-5932.0001.patch Thanks [~jianhe] Yes. We are not checking this condition as of now in CS.

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-12-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711647#comment-15711647 ] Sunil G commented on YARN-5889: --- Thanks [~eepayne] Yes. for scheduler, 1ms is also smaller. It was a

[jira] [Assigned] (YARN-5955) Use threadpool or multiple thread to recover app

2016-12-01 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S reassigned YARN-5955: - Assignee: Ajith S > Use threadpool or multiple thread to recover app >

[jira] [Commented] (YARN-5955) Use threadpool or multiple thread to recover app

2016-12-01 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711870#comment-15711870 ] Ajith S commented on YARN-5955: --- I would like to work on this if you have not yet started > Use threadpool

[jira] [Commented] (YARN-5927) BaseContainerManagerTest::waitForNMContainerState timeout accounting is not accurate

2016-12-01 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711892#comment-15711892 ] Kai Sasaki commented on YARN-5927: -- [~miklos.szeg...@cloudera.com] Thanks! [~leftnoteasy] Sorry for

[jira] [Commented] (YARN-5955) Use threadpool or multiple thread to recover app

2016-12-01 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15711953#comment-15711953 ] Varun Saxena commented on YARN-5955: We have actually made quite a few changes to make recovery faster

[jira] [Commented] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15714111#comment-15714111 ] Hadoop QA commented on YARN-5938: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||