[jira] [Commented] (YARN-6057) yarn.scheduler.minimum-allocation-* descriptions are incorrect about behavior when a request is out of bounds

2017-01-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815361#comment-15815361 ] Bibin A Chundatt commented on YARN-6057: LGTM +1 . Will commit it in soon. >

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2017-01-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815257#comment-15815257 ] Daniel Templeton commented on YARN-6022: [~leftnoteasy], since I did the branch-2 patch, do I need

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2017-01-10 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815429#comment-15815429 ] Greg Phillips commented on YARN-5280: - [~vvasudev] - I encountered some issues when attempting to move

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815505#comment-15815505 ] Sunil G commented on YARN-6031: --- Patch looks generally fine. Few minor nits: 1. {noformat} String message =

[jira] [Updated] (YARN-5980) Update documentation for single node hbase deploy

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5980: - Attachment: YARN-5980.004.patch Uploading v004 that addresses [~sjlee0]'s suggestions. I will file a

[jira] [Updated] (YARN-6042) Fairscheduler: Dump scheduler state in log

2017-01-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6042: --- Description: To improve the debugging of scheduler issues it would be a big improvement to be able to dump

[jira] [Commented] (YARN-5980) Update documentation for single node hbase deploy

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816152#comment-15816152 ] Hadoop QA commented on YARN-5980: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2017-01-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816388#comment-15816388 ] Jian He commented on YARN-5995: --- How about start with below: - Time cost of write op - MutableRate (which

[jira] [Commented] (YARN-6079) simple spelling errors in yarn test code

2017-01-10 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816321#comment-15816321 ] Grant Sohn commented on YARN-6079: -- +1 (non-binding). > simple spelling errors in yarn test code >

[jira] [Updated] (YARN-6011) Add a new web service to list the files on a container in AHSWebService

2017-01-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6011: Attachment: YARN-6011.3.patch > Add a new web service to list the files on a container in AHSWebService >

[jira] [Created] (YARN-6080) Create WebServiceUtils to have common functions used in RMWebService, NMWebService and AHSWebService

2017-01-10 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-6080: --- Summary: Create WebServiceUtils to have common functions used in RMWebService, NMWebService and AHSWebService Key: YARN-6080 URL: https://issues.apache.org/jira/browse/YARN-6080

[jira] [Updated] (YARN-6079) simple spelling errors in yarn test code

2017-01-10 Thread vijay (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] vijay updated YARN-6079: Attachment: YARN-6079.001.patch > simple spelling errors in yarn test code >

[jira] [Commented] (YARN-6011) Add a new web service to list the files on a container in AHSWebService

2017-01-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816340#comment-15816340 ] Xuan Gong commented on YARN-6011: - Thanks for the review. [~djp] bq. 1. For generating URI embed in

[jira] [Commented] (YARN-6080) Create WebServiceUtils to have common functions used in RMWebService, NMWebService and AHSWebService

2017-01-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816316#comment-15816316 ] Xuan Gong commented on YARN-6080: - In LogsCLI, we have codes to create WebService call to RM, NM and AHS.

[jira] [Updated] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2017-01-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-4148: - Attachment: YARN-4148-branch-2.8.003.patch Attaching the patch for branch-2.8. > When killing app, RM

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816109#comment-15816109 ] Jian He commented on YARN-6072: --- bq. // Set HA configuration should be done before login I don't know why

[jira] [Reopened] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened YARN-4148: -- > When killing app, RM releases app's resource before they are released by NM >

[jira] [Commented] (YARN-5830) Avoid preempting AM containers

2017-01-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816420#comment-15816420 ] Karthik Kambatla commented on YARN-5830: Comments on the latest patch: # The patch does not apply

[jira] [Commented] (YARN-6011) Add a new web service to list the files on a container in AHSWebService

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816442#comment-15816442 ] Hadoop QA commented on YARN-6011: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816191#comment-15816191 ] Junping Du commented on YARN-6072: -- bq. // Set HA configuration should be done before login This is added

[jira] [Updated] (YARN-6011) Add a new web service to list the files on a container in AHSWebService

2017-01-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-6011: Attachment: YARN-6011.4.patch > Add a new web service to list the files on a container in AHSWebService >

[jira] [Commented] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816360#comment-15816360 ] Junping Du commented on YARN-4148: -- Thanks Jason. I reopen the ticket for kicking off the jenkins. > When

[jira] [Commented] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816753#comment-15816753 ] Hadoop QA commented on YARN-4148: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

2017-01-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5864: - Attachment: YARN-5864.003.patch Updated ver.3 patch, updates: - Only preempt for un-satisfied queues -

[jira] [Commented] (YARN-6016) Bugs in AMRMProxy handling (local)AMRMToken

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816807#comment-15816807 ] Hadoop QA commented on YARN-6016: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5554) MoveApplicationAcrossQueues does not check user permission on the target queue

2017-01-10 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816669#comment-15816669 ] Daniel Templeton commented on YARN-5554: Looks like we'll need a branch-2 patch. Can you take care

[jira] [Commented] (YARN-6079) simple spelling errors in yarn test code

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816516#comment-15816516 ] Hadoop QA commented on YARN-6079: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816455#comment-15816455 ] Hadoop QA commented on YARN-2962: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5416) TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816484#comment-15816484 ] Junping Du commented on YARN-5416: -- Sorry for missing above comments, [~ebadger] and [~jlowe]. Just update

[jira] [Commented] (YARN-4212) FairScheduler: Parent queues is not allowed to be 'Fair' policy if its children have the "drf" policy

2017-01-10 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816634#comment-15816634 ] Ray Chiang commented on YARN-4212: -- Minor nit. You have a method named

[jira] [Updated] (YARN-6016) Bugs in AMRMProxy handling (local)AMRMToken

2017-01-10 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6016: --- Attachment: YARN-6016.v2.patch > Bugs in AMRMProxy handling (local)AMRMToken >

[jira] [Commented] (YARN-5416) TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816687#comment-15816687 ] Hadoop QA commented on YARN-5416: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816837#comment-15816837 ] Junping Du commented on YARN-4148: -- The test failures should be unrelated to the patch.

[jira] [Commented] (YARN-4212) FairScheduler: Parent queues is not allowed to be 'Fair' policy if its children have the "drf" policy

2017-01-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816923#comment-15816923 ] Karthik Kambatla commented on YARN-4212: Thanks for updating the patch here, Yufei. Comments: #

[jira] [Commented] (YARN-6061) Add a customized uncaughtexceptionhandler for critical threads

2017-01-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816939#comment-15816939 ] Karthik Kambatla commented on YARN-6061: [~yufeigu] - thanks for working on this. I must have

[jira] [Commented] (YARN-6058) Support for listing all applications i.e /apps

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817037#comment-15817037 ] Vrushali C commented on YARN-6058: -- In the context of retrieving information from the flow activity table,

[jira] [Updated] (YARN-6072) RM unable to start in secure mode

2017-01-10 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ajith S updated YARN-6072: -- Attachment: YARN-6072.03.branch-2.8.patch YARN-6072.03.patch > RM unable to start in secure mode

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-10 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817265#comment-15817265 ] Ying Zhang commented on YARN-6031: -- For findbugs error, it might be good to keep the null check in case

[jira] [Commented] (YARN-4489) Limit flow runs returned while querying flows

2017-01-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817354#comment-15817354 ] Rohith Sharma K S commented on YARN-4489: - I would expect few specific functionality to be provided

[jira] [Comment Edited] (YARN-5304) Ship single node HBase config option with single startup command

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817376#comment-15817376 ] Vrushali C edited comment on YARN-5304 at 1/11/17 6:30 AM: --- [~jrottinghuis],

[jira] [Commented] (YARN-5304) Ship single node HBase config option with single startup command

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817376#comment-15817376 ] Vrushali C commented on YARN-5304: -- [~jrottinghuis], [~sjlee0] and I had an offline discussion about

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817381#comment-15817381 ] Vrushali C commented on YARN-6027: -- bq. Currently, for YARN Web UI, client is aggregating all the

[jira] [Commented] (YARN-5831) Propagate allowPreemptionFrom flag all the way down to the app

2017-01-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816887#comment-15816887 ] Karthik Kambatla commented on YARN-5831: Thanks for updating the patch, Yufei. The patch looks

[jira] [Resolved] (YARN-6079) simple spelling errors in yarn test code

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-6079. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2 2.9.0

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817238#comment-15817238 ] Naganarasimha G R commented on YARN-6072: - Thanks for the patch [~ajithshetty], Approach seems

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817277#comment-15817277 ] Junping Du commented on YARN-6072: -- Latest patch LGTM too. Thanks [~ajithshetty] for quickly addressing

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817323#comment-15817323 ] Rohith Sharma K S commented on YARN-6027: - I think we can move the discussion of limiting flowRuns

[jira] [Updated] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6081: - Priority: Major (was: Critical) > LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816990#comment-15816990 ] Wangda Tan commented on YARN-6081: -- This is the test case to reproduce the problem: {code} @Test

[jira] [Updated] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6081: - Attachment: YARN-6081.001.patch Attached ver.1 patch. >

[jira] [Commented] (YARN-5864) YARN Capacity Scheduler - Queue Priorities

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817019#comment-15817019 ] Hadoop QA commented on YARN-5864: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817047#comment-15817047 ] Vrushali C commented on YARN-6027: -- Catching up on this thread. bq. Sangjin Lee, you remember why the

[jira] [Commented] (YARN-6079) simple spelling errors in yarn test code

2017-01-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817048#comment-15817048 ] Hudson commented on YARN-6079: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11103 (See

[jira] [Commented] (YARN-6012) Remove node label (removeFromClusterNodeLabels) document is missing

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817106#comment-15817106 ] Hadoop QA commented on YARN-6012: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6064) Support fromId for flowRuns and flow/flowRun apps REST API's

2017-01-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817181#comment-15817181 ] Rohith Sharma K S commented on YARN-6064: - bq. What do we mean by next set of earlier entities ?

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817180#comment-15817180 ] Hadoop QA commented on YARN-6031: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-10 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817222#comment-15817222 ] Ajith S commented on YARN-6072: --- Thanks for the comments [~djp] [~jianhe] [~naganarasimha...@apache.org] and

[jira] [Commented] (YARN-6079) simple spelling errors in yarn test code

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816900#comment-15816900 ] Junping Du commented on YARN-6079: -- I have commit the patch to trunk and branch-2. Thanks Vijay for the

[jira] [Created] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-10 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-6081: Summary: LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container Key: YARN-6081 URL:

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817332#comment-15817332 ] Karthik Kambatla commented on YARN-6072: The patch looks good. +1, pending Jenkins. > RM unable

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817326#comment-15817326 ] Vrushali C commented on YARN-6027: -- bq. So, I was thinking, by default can't we give current day flows

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817359#comment-15817359 ] Rohith Sharma K S commented on YARN-6027: - bq. In that case, the data needs to be aggregated at the

[jira] [Commented] (YARN-6079) simple spelling errors in yarn test code

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816878#comment-15816878 ] Junping Du commented on YARN-6079: -- +1. Committing it in. > simple spelling errors in yarn test code >

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-10 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817078#comment-15817078 ] Ying Zhang commented on YARN-6031: -- Thanks very much [~sunilg] for the quick review. Comments addressed in

[jira] [Updated] (YARN-6031) Application recovery failed after disabling node label

2017-01-10 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-6031: - Attachment: YARN-6031.004.patch > Application recovery failed after disabling node label >

[jira] [Updated] (YARN-6012) Remove node label (removeFromClusterNodeLabels) document is missing

2017-01-10 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-6012: - Attachment: (was: YARN-6012.002.patch) > Remove node label (removeFromClusterNodeLabels) document is

[jira] [Updated] (YARN-6012) Remove node label (removeFromClusterNodeLabels) document is missing

2017-01-10 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-6012: - Attachment: YARN-6012.002.patch > Remove node label (removeFromClusterNodeLabels) document is missing >

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817317#comment-15817317 ] Sunil G commented on YARN-6031: --- Hi [~Ying Zhang] When InvalidResourceRequestException is thrown from

[jira] [Commented] (YARN-6072) RM unable to start in secure mode

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814251#comment-15814251 ] Hadoop QA commented on YARN-6072: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814265#comment-15814265 ] Hadoop QA commented on YARN-6022: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5416) TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed intermittently due to not wait SchedulerApplicationAttempt to be stopped

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-5416: - Attachment: YARN-5416-v2.patch > TestRMRestart#testRMRestartWaitForPreviousAMToFinish failed

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-01-10 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816512#comment-15816512 ] Devaraj K commented on YARN-5764: - Thanks a lot [~leftnoteasy] for review and comments. bq. What is the

[jira] [Commented] (YARN-6031) Application recovery failed after disabling node label

2017-01-10 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817555#comment-15817555 ] Ying Zhang commented on YARN-6031: -- Thanks [~sunilg]. Modified the code and uploaded a new patch. >

[jira] [Updated] (YARN-6031) Application recovery failed after disabling node label

2017-01-10 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ying Zhang updated YARN-6031: - Attachment: YARN-6031.005.patch > Application recovery failed after disabling node label >

[jira] [Commented] (YARN-5934) Fix TestTimelineWebServices.testPrimaryFilterNumericString

2017-01-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815710#comment-15815710 ] Naganarasimha G R commented on YARN-5934: - cc [~gtCarrera9]... > Fix

[jira] [Commented] (YARN-6022) Revert changes of AbstractResourceRequest

2017-01-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815715#comment-15815715 ] Wangda Tan commented on YARN-6022: -- [~templedf], Really appreciate your help for updating branch-2 patch.

[jira] [Commented] (YARN-6076) Backport YARN-4752 (FS preemption changes) to branch-2

2017-01-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815726#comment-15815726 ] Yufei Gu commented on YARN-6076: Some compile errors due to different Java versions. > Backport YARN-4752

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815599#comment-15815599 ] Li Lu commented on YARN-6054: - Oops sorry [~Naganarasimha] I was trying to take a closer look at the updated

[jira] [Updated] (YARN-4975) Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues

2017-01-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4975: --- Attachment: YARN-4975.001.patch > Fair Scheduler: exception thrown when a parent queue marked 'parent' has >

[jira] [Commented] (YARN-6064) Support fromId for flowRuns and flow/flowRun apps REST API's

2017-01-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815621#comment-15815621 ] Sangjin Lee commented on YARN-6064: --- The latest patch LGTM. I'll wait a little bit before committing it

[jira] [Commented] (YARN-4212) FairScheduler: Parent queues is not allowed to be 'Fair' policy if its children have the "drf" policy

2017-01-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815631#comment-15815631 ] Yufei Gu commented on YARN-4212: The patch 005 remove the check in loading allocation files. Scheduling

[jira] [Commented] (YARN-6064) Support fromId for flowRuns and flow/flowRun apps REST API's

2017-01-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815647#comment-15815647 ] Varun Saxena commented on YARN-6064: I have a couple of comments. # In getFlowRuns call if fromId is

[jira] [Commented] (YARN-6054) TimelineServer fails to start when some LevelDb state files are missing.

2017-01-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815695#comment-15815695 ] Naganarasimha G R commented on YARN-6054: - Ohh sorry, wasn't sure you were looking into it. May be

[jira] [Commented] (YARN-4975) Fair Scheduler: exception thrown when a parent queue marked 'parent' has configured child queues

2017-01-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815653#comment-15815653 ] Yufei Gu commented on YARN-4975: YARN-2738 has two assumptions: 1. Only leaf queues are reservable. 2. The

[jira] [Comment Edited] (YARN-5934) Fix TestTimelineWebServices.testPrimaryFilterNumericString

2017-01-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15815710#comment-15815710 ] Naganarasimha G R edited comment on YARN-5934 at 1/10/17 6:18 PM: -- Based

[jira] [Comment Edited] (YARN-6031) Application recovery failed after disabling node label

2017-01-10 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817555#comment-15817555 ] Ying Zhang edited comment on YARN-6031 at 1/11/17 7:49 AM: --- Thanks [~sunilg].

[jira] [Updated] (YARN-4148) When killing app, RM releases app's resource before they are released by NM

2017-01-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4148: - Fix Version/s: 2.8.0 > When killing app, RM releases app's resource before they are released by NM >

[jira] [Commented] (YARN-5980) Update documentation for single node hbase deploy

2017-01-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816872#comment-15816872 ] Sangjin Lee commented on YARN-5980: --- The latest patch LGTM in the sense that this update reflects

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15816996#comment-15816996 ] Wangda Tan commented on YARN-6081: -- [~sunilg], [~eepayne]. Could you please review this fix? It will be

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817073#comment-15817073 ] Varun Saxena commented on YARN-6027: bq. This should not happen. There should be exactly one row for a

[jira] [Commented] (YARN-6012) Remove node label (removeFromClusterNodeLabels) document is missing

2017-01-10 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817081#comment-15817081 ] Ying Zhang commented on YARN-6012: -- Re-attach the patch file to start Jekins. > Remove node label

[jira] [Comment Edited] (YARN-6012) Remove node label (removeFromClusterNodeLabels) document is missing

2017-01-10 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817081#comment-15817081 ] Ying Zhang edited comment on YARN-6012 at 1/11/17 3:58 AM: --- Re-attach the patch

[jira] [Commented] (YARN-3884) RMContainerImpl transition from RESERVED to KILL apphistory status not updated

2017-01-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817134#comment-15817134 ] Bibin A Chundatt commented on YARN-3884: Will update patch shortly > RMContainerImpl transition

[jira] [Commented] (YARN-6081) LeafQueue#getTotalPendingResourcesConsideringUserLimit should deduct reserved from pending to avoid unnecessary preemption of reserved container

2017-01-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817153#comment-15817153 ] Hadoop QA commented on YARN-6081: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-6027) Support fromId for flows API

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817288#comment-15817288 ] Vrushali C edited comment on YARN-6027 at 1/11/17 5:55 AM: --- bq. How many do we

[jira] [Commented] (YARN-4489) Limit flow runs returned while querying flows

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817291#comment-15817291 ] Vrushali C commented on YARN-4489: -- In general, I think it is good idea to limit the number of records

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817288#comment-15817288 ] Vrushali C commented on YARN-6027: -- bq. How many do we expect typically ? Can it run into thousands ?

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817303#comment-15817303 ] Rohith Sharma K S commented on YARN-6027: - bq. could not finally decipher in the comments above

[jira] [Commented] (YARN-6027) Support fromId for flows API

2017-01-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817335#comment-15817335 ] Vrushali C commented on YARN-6027: -- Thinking more about how many/which records to show in the UI. By

[jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2017-01-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15817393#comment-15817393 ] Bibin A Chundatt commented on YARN-5849: [~templedf] Sorry for the delay. Will try to review the

  1   2   >