[jira] [Commented] (YARN-4127) RM fail with noAuth error if switched from failover mode to non-failover mode

2015-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14986931#comment-14986931 ] Hadoop QA commented on YARN-4127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4327) RM can not renew TIMELINE_DELEGATION_TOKEN in securt clusters

2015-11-03 Thread zhangshilong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangshilong updated YARN-4327: --- Description: in hadoop 2.7.1 ATS conf like this: yarn.timeline-service.http-authentication.type

[jira] [Created] (YARN-4327) RM can not renew TIMELINE_DELEGATION_TOKEN in securt clusters

2015-11-03 Thread zhangshilong (JIRA)
zhangshilong created YARN-4327: -- Summary: RM can not renew TIMELINE_DELEGATION_TOKEN in securt clusters Key: YARN-4327 URL: https://issues.apache.org/jira/browse/YARN-4327 Project: Hadoop YARN

[jira] [Updated] (YARN-4327) RM can not renew TIMELINE_DELEGATION_TOKEN in secure clusters

2015-11-03 Thread zhangshilong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangshilong updated YARN-4327: --- Summary: RM can not renew TIMELINE_DELEGATION_TOKEN in secure clusters (was: RM can not renew

[jira] [Commented] (YARN-4327) RM can not renew TIMELINE_DELEGATION_TOKEN in securt clusters

2015-11-03 Thread zhangshilong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987054#comment-14987054 ] zhangshilong commented on YARN-4327: yarn.timeline-service.http-authentication.type simple, ATS will

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2015-11-03 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v1.patch This is a preliminary proposal patch. Through this change, any node is

[jira] [Commented] (YARN-4325) purge app state from NM state-store should be independent of log aggregation

2015-11-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987722#comment-14987722 ] Junping Du commented on YARN-4325: -- Hi [~vinodkv], we found in a long running cluster, NMs recovery will

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-03 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987829#comment-14987829 ] Allen Wittenauer commented on YARN-3862: Yetus is happily pointing out how many build fixes your

[jira] [Updated] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3849: - Target Version/s: 2.7.3 Discussed with [~vinodkv], since 2.7.2 is almost done, set target version of this

[jira] [Commented] (YARN-1509) Make AMRMClient support send increase container request and get increased/decreased containers

2015-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987819#comment-14987819 ] Hadoop QA commented on YARN-1509: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4326) TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987817#comment-14987817 ] Wangda Tan commented on YARN-4326: -- Thank for working on this, [~mding]. Fix looks good to me. >

[jira] [Commented] (YARN-1509) Make AMRMClient support send increase container request and get increased/decreased containers

2015-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987878#comment-14987878 ] Hadoop QA commented on YARN-1509: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3849: - Labels: (was: 2.7.2-candidate) > Too much of preemption activity causing continuos killing of containers

[jira] [Updated] (YARN-4321) Incessant retries if NoAuthException is thrown by Zookeeper in non HA mode

2015-11-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4321: --- Target Version/s: 2.7.2 (was: 2.7.2, 2.6.3) > Incessant retries if NoAuthException is thrown by

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987669#comment-14987669 ] Varun Saxena commented on YARN-3862: Yes, you are correct. Will fix this in next patch > Decide which

[jira] [Resolved] (YARN-2055) Preemption: Jobs are failing due to AMs are getting launched and killed multiple times

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-2055. --- Resolution: Not A Problem Between YARN-2074, MAPREDUCE-5956 and YARN-2022,

[jira] [Commented] (YARN-4325) purge app state from NM state-store should be independent of log aggregation

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987678#comment-14987678 ] Vinod Kumar Vavilapalli commented on YARN-4325: --- [~djp], the JIRA is a little light on

[jira] [Updated] (YARN-4321) Incessant retries if NoAuthException is thrown by Zookeeper in non HA mode

2015-11-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4321: --- Target Version/s: 2.7.2, 2.6.3 (was: 2.7.2) > Incessant retries if NoAuthException is thrown by

[jira] [Updated] (YARN-4236) Metric for aggregated resources allocation per queue

2015-11-03 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4236: --- Attachment: (was: YARN-4236.patch) > Metric for aggregated resources allocation per queue >

[jira] [Updated] (YARN-4236) Metric for aggregated resources allocation per queue

2015-11-03 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4236: --- Attachment: YARN-4236.patch > Metric for aggregated resources allocation per queue >

[jira] [Updated] (YARN-4218) Metric for resource*time that was preempted

2015-11-03 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4218: --- Attachment: (was: YARN-4218.2.patch) > Metric for resource*time that was preempted >

[jira] [Updated] (YARN-4236) Metric for aggregated resources allocation per queue

2015-11-03 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4236: --- Attachment: (was: YARN-4236.patch) > Metric for aggregated resources allocation per queue >

[jira] [Commented] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987842#comment-14987842 ] Eric Payne commented on YARN-3769: -- Tests {{hadoop.yarn.server.resourcemanager.TestClientRMTokens}} and

[jira] [Created] (YARN-4328) Findbugs warning in resourcemanager in branch-2.7 and branch-2.6

2015-11-03 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-4328: -- Summary: Findbugs warning in resourcemanager in branch-2.7 and branch-2.6 Key: YARN-4328 URL: https://issues.apache.org/jira/browse/YARN-4328 Project: Hadoop YARN

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-03 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987876#comment-14987876 ] MENG DING commented on YARN-1510: - The mvn install test is flawed. It goes directly into

[jira] [Commented] (YARN-4127) RM fail with noAuth error if switched from failover mode to non-failover mode

2015-11-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987612#comment-14987612 ] Varun Saxena commented on YARN-4127: Filed YARN-4328 for the findbugs issue reported above > RM fail

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-03 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987636#comment-14987636 ] Sangjin Lee commented on YARN-3862: --- [~aw], sorry to bother you here, but our latest jenkins run is an

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987810#comment-14987810 ] Wangda Tan commented on YARN-1510: -- Rekicked Jenkins. > Make NMClient support change container resources

[jira] [Updated] (YARN-4325) purge app state from NM state-store should be independent of log aggregation

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4325: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Okay, moving it out while

[jira] [Updated] (YARN-3112) AM restart and keep containers from previous attempts, then new container launch failed

2015-11-03 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3112: --- Description: This error is very similar to YARN-1795, YARN-1839, but i have check the

[jira] [Commented] (YARN-1509) Make AMRMClient support send increase container request and get increased/decreased containers

2015-11-03 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987868#comment-14987868 ] MENG DING commented on YARN-1509: - The test failure should be related to YARN-4326. In addition, the mvn

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987893#comment-14987893 ] Wangda Tan commented on YARN-1510: -- I see, will run client tests locally. [~mding] could you file a ticket

[jira] [Updated] (YARN-4218) Metric for resource*time that was preempted

2015-11-03 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4218: --- Attachment: YARN-4218.2.patch > Metric for resource*time that was preempted >

[jira] [Updated] (YARN-4326) Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4326: - Summary: Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-11-03 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987902#comment-14987902 ] Sangjin Lee commented on YARN-3862: --- Thanks. We'll discuss when we should address the next rebase. Thanks

[jira] [Commented] (YARN-4236) Metric for aggregated resources allocation per queue

2015-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987932#comment-14987932 ] Hadoop QA commented on YARN-4236: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3877: -- Target Version/s: 2.8.0 (was: 2.7.2) Moving this improvement out of 2.7.2 and

[jira] [Commented] (YARN-4292) ResourceUtilization should be a part of NodeInfo REST API

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988303#comment-14988303 ] Wangda Tan commented on YARN-4292: -- Thanks [~sunilg] working on this, general approach of this patch looks

[jira] [Updated] (YARN-3946) Allow fetching exact reason as to why a submitted app is in ACCEPTED state.

2015-11-03 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3946: Attachment: YARN-3946.v1.001.patch YARN3946_attemptDiagnistic message.png Hi

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988182#comment-14988182 ] Hadoop QA commented on YARN-1510: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988238#comment-14988238 ] Wangda Tan commented on YARN-3769: -- [~eepayne], Thanks for update. bq. If you want, we can pull this out

[jira] [Commented] (YARN-4326) Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988249#comment-14988249 ] Hudson commented on YARN-4326: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1356 (See

[jira] [Commented] (YARN-4326) Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988436#comment-14988436 ] Hudson commented on YARN-4326: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #622 (See

[jira] [Commented] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

2015-11-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988106#comment-14988106 ] Jason Lowe commented on YARN-2014: -- No, AFAIK this was never fixed. As I mentioned earlier, my best guess

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2015-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988114#comment-14988114 ] Hadoop QA commented on YARN-4311: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-03 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988091#comment-14988091 ] MENG DING commented on YARN-1510: - I logged YETUS-159 for this issue. > Make NMClient support change

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3136: - Attachment: YARN-3136.branch-2.7.patch > getTransferredContainers can be a bottleneck during AM

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988110#comment-14988110 ] Wangda Tan commented on YARN-3136: -- Backport and commit to branch-2.7. Ran all tests of resourcemanager

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-03 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987966#comment-14987966 ] MENG DING commented on YARN-1510: - [~leftnoteasy], should I log this in the Apache Yetus community? > Make

[jira] [Updated] (YARN-4236) Metric for aggregated resources allocation per queue

2015-11-03 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4236: --- Attachment: YARN-4236.2.patch .2 patch address checkstyle issue > Metric for aggregated resources allocation

[jira] [Commented] (YARN-4326) Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988083#comment-14988083 ] Hudson commented on YARN-4326: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2563 (See

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3136: - Fix Version/s: 2.7.2 > getTransferredContainers can be a bottleneck during AM registration >

[jira] [Commented] (YARN-4326) Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988003#comment-14988003 ] Hudson commented on YARN-4326: -- FAILURE: Integrated in Hadoop-trunk-Commit #8748 (See

[jira] [Commented] (YARN-4326) Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988457#comment-14988457 ] Hudson commented on YARN-4326: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2504 (See

[jira] [Updated] (YARN-4184) Remove update reservation state api from state store as its not used by ReservationSystem

2015-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4184: - Assignee: Sean Po (was: Subru Krishnan) > Remove update reservation state api from state store as

[jira] [Commented] (YARN-3946) Allow fetching exact reason as to why a submitted app is in ACCEPTED state.

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988640#comment-14988640 ] Wangda Tan commented on YARN-3946: -- Hi [~Naganarasimha], Thanks for working on this, general idea of this

[jira] [Created] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2015-11-03 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-4329: --- Summary: Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler Key: YARN-4329 URL: https://issues.apache.org/jira/browse/YARN-4329

[jira] [Commented] (YARN-4091) Improvement: Introduce more debug/diagnostics information to detail out scheduler activity

2015-11-03 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988740#comment-14988740 ] Naganarasimha G R commented on YARN-4091: - Hi [~sunilg], I think we need to update the document as

[jira] [Commented] (YARN-1510) Make NMClient support change container resources

2015-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988513#comment-14988513 ] Wangda Tan commented on YARN-1510: -- I run failed tests locally (yarn-client). There're some tests failed

[jira] [Updated] (YARN-2681) Support bandwidth enforcement for containers while reading from HDFS

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2681: -- Target Version/s: 2.8.0 (was: 2.7.2) Moving new-features out of 2.7 maintenance

[jira] [Resolved] (YARN-3575) Job using 2.5 jars fails on a 2.6 cluster whose RM has been restarted

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-3575. --- Resolution: Won't Fix Agreed. I requested that this be filed largely for

[jira] [Commented] (YARN-4236) Metric for aggregated resources allocation per queue

2015-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988485#comment-14988485 ] Hadoop QA commented on YARN-4236: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4226) Make capacity scheduler queue's preemption status REST API consistent with GUI

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4226: -- Target Version/s: 2.7.3 (was: 3.0.0, 2.8.0, 2.7.2) Moving out all non-critical

[jira] [Updated] (YARN-3755) Log the command of launching containers

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3755: -- Target Version/s: 2.7.3 (was: 2.7.2) Moving out all non-critical / non-blocker

[jira] [Updated] (YARN-3477) TimelineClientImpl swallows exceptions

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3477: -- Target Version/s: 2.7.3 (was: 2.7.2) Moving out all non-critical / non-blocker

[jira] [Updated] (YARN-3898) YARN web console only proxies GET to application master but doesn't provide any feedback for other HTTP methods

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3898: -- Target Version/s: 2.7.3 (was: 2.7.2) Moving out all non-critical / non-blocker

[jira] [Updated] (YARN-3344) procfs stat file is not in the expected format warning

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3344: -- Target Version/s: 2.7.3 (was: 2.8.0, 2.7.2) Moving out all non-critical /

[jira] [Updated] (YARN-4225) Add preemption status to yarn queue -status for capacity scheduler

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4225: -- Target Version/s: 2.7.3 (was: 3.0.0, 2.8.0, 2.7.2) Moving out all non-critical

[jira] [Updated] (YARN-3687) We should be able to remove node-label if there's no queue can use it.

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3687: -- Target Version/s: 2.7.3 (was: 2.7.2) Moving out all non-critical / non-blocker

[jira] [Updated] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3769: -- Target Version/s: 2.7.3 (was: 2.8.0, 2.7.2) Moving out all non-critical /

[jira] [Updated] (YARN-3946) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in CS

2015-11-03 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3946: Component/s: capacity scheduler > Allow fetching exact reason as to why a submitted app is

[jira] [Updated] (YARN-3946) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in CS

2015-11-03 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3946: Summary: Allow fetching exact reason as to why a submitted app is in ACCEPTED state in CS

[jira] [Updated] (YARN-2746) YARNDelegationTokenID misses serializing version from the common abstract ID

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2746: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-1480) RM web services getApps() accepts many more filters than ApplicationCLI "list" command

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1480: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-3478) FairScheduler page not performed because different enum of YarnApplicationState and RMAppState

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3478: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-2014) Performance: AM scaleability is 10% slower in 2.4 compared to 0.23.9

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2014: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-1848) Persist ClusterMetrics across RM HA transitions

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1848: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-1767) Windows: Allow a way for users to augment classpath of YARN daemons

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1767: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-4060) Revisit default retry config for connection with RM

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4060: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-2599) Standby RM should also expose some jmx and metrics

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2599: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-2657) MiniYARNCluster to (optionally) add MicroZookeeper service

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2657: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-2037) Add restart support for Unmanaged AMs

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2037: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1856: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Updated] (YARN-2038) Revisit how AMs learn of containers from previous attempts

2015-11-03 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2038: -- Target Version/s: 2.6.3, 2.7.3 (was: 2.7.2, 2.6.3) Moving out all non-critical

[jira] [Commented] (YARN-4326) Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988623#comment-14988623 ] Hudson commented on YARN-4326: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #567 (See

[jira] [Commented] (YARN-4091) Improvement: Introduce more debug/diagnostics information to detail out scheduler activity

2015-11-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988765#comment-14988765 ] Sunil G commented on YARN-4091: --- Hi [~Naganarasimha Garla] Thank you for the comment. I will update doc with

[jira] [Commented] (YARN-3946) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in CS

2015-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988810#comment-14988810 ] Hadoop QA commented on YARN-3946: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4326) Fix TestDistributedShell timeout as AHS in MiniYarnCluster no longer binds to default port 8188

2015-11-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14988227#comment-14988227 ] Hudson commented on YARN-4326: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #633 (See

[jira] [Commented] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

2015-11-03 Thread qiang xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989049#comment-14989049 ] qiang xu commented on YARN-3432: I think we need to think about the vcore too. In current code, it is:

[jira] [Commented] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

2015-11-03 Thread qiang xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989055#comment-14989055 ] qiang xu commented on YARN-3432: Sorry, should be this.totalVirtualCores = availableVirtualCores +

[jira] [Commented] (YARN-4127) RM fail with noAuth error if switched from failover mode to non-failover mode

2015-11-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14989060#comment-14989060 ] Varun Saxena commented on YARN-4127: Thanks [~jianhe] for the review and commit > RM fail with noAuth

[jira] [Updated] (YARN-1509) Make AMRMClient support send increase container request and get increased/decreased containers

2015-11-03 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1509: Attachment: YARN-1509.9.patch Thanks [~jianhe] for reviewing the patch and giving feedback offline. To

[jira] [Updated] (YARN-1509) Make AMRMClient support send increase container request and get increased/decreased containers

2015-11-03 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1509: Attachment: YARN-1509.10.patch Please ignore the previous patch, and see the latest one. > Make AMRMClient

[jira] [Commented] (YARN-4127) RM fail with noAuth error if switched from failover mode to non-failover mode

2015-11-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14987591#comment-14987591 ] Varun Saxena commented on YARN-4127: Test failures are unrelated. Except the one related to node