[jira] [Updated] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is minimumAllocation

[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-2637: -- Attachment: YARN-2637.2.patch Go ahead and allow cores to be part of the am resource limit...

[jira] [Updated] (YARN-2875) Bump SLF4J to 1.7.7 from 1.7.5

[ https://issues.apache.org/jira/browse/YARN-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tim Robertson updated YARN-2875: Description: hadoop-yarn-common [uses log4j

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217667#comment-14217667 ] Steve Loughran commented on YARN-2877: -- Linking to HADOOP-11317 to cover project-wide

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217668#comment-14217668 ] Steve Loughran commented on YARN-2877: -- (ignore that comment, was for YARN-2875)

[jira] [Commented] (YARN-2875) Bump SLF4J to 1.7.7 from 1.7.5

[ https://issues.apache.org/jira/browse/YARN-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217669#comment-14217669 ] Steve Loughran commented on YARN-2875: -- Linking to HADOOP-11317 to cover project-wide

[jira] [Commented] (YARN-2301) Improve yarn container command

[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217671#comment-14217671 ] Naganarasimha G R commented on YARN-2301: - Hi [~jianhe], Thanks for reviewing, but

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217672#comment-14217672 ] Sunil G commented on YARN-1963: --- Hi Wangda, Thank for sharing your comments. bq. Does this

[jira] [Commented] (YARN-2356) yarn status command for non-existent application/application attempt/container is too verbose

[ https://issues.apache.org/jira/browse/YARN-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217706#comment-14217706 ] Devaraj K commented on YARN-2356: - Sorry for coming late here. Thanks [~sunilg] for the

[jira] [Commented] (YARN-2870) Update examples in document of Timeline Server

[ https://issues.apache.org/jira/browse/YARN-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217720#comment-14217720 ] Hudson commented on YARN-2870: -- FAILURE: Integrated in Hadoop-Yarn-trunk #748 (See

[jira] [Commented] (YARN-2870) Update examples in document of Timeline Server

[ https://issues.apache.org/jira/browse/YARN-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217928#comment-14217928 ] Hudson commented on YARN-2870: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #10 (See

[jira] [Commented] (YARN-2157) Document YARN metrics

[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217931#comment-14217931 ] Hudson commented on YARN-2157: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #10 (See

[jira] [Commented] (YARN-2157) Document YARN metrics

[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217949#comment-14217949 ] Hudson commented on YARN-2157: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1938 (See

[jira] [Commented] (YARN-2870) Update examples in document of Timeline Server

[ https://issues.apache.org/jira/browse/YARN-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14217946#comment-14217946 ] Hudson commented on YARN-2870: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1938 (See

[jira] [Updated] (YARN-2878) Fix DockerContainerExecutor.apt.vm formatting

[ https://issues.apache.org/jira/browse/YARN-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-2878: Component/s: documentation Fix DockerContainerExecutor.apt.vm formatting

[jira] [Commented] (YARN-2870) Update examples in document of Timeline Server

[ https://issues.apache.org/jira/browse/YARN-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218014#comment-14218014 ] Hudson commented on YARN-2870: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #10 (See

[jira] [Updated] (YARN-2865) Application recovery continuously fails with Application with id already present. Cannot duplicate

[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2865: - Attachment: YARN-2865.1.patch Application recovery continuously fails with Application with id already present.

[jira] [Commented] (YARN-2865) Application recovery continuously fails with Application with id already present. Cannot duplicate

[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218044#comment-14218044 ] Rohith commented on YARN-2865: -- Attached patch, the changes from previous patch are 1. Karthik

[jira] [Commented] (YARN-2875) Bump SLF4J to 1.7.7 from 1.7.5

[ https://issues.apache.org/jira/browse/YARN-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218160#comment-14218160 ] Tim Robertson commented on YARN-2875: - Sadly no. It is used in the

[jira] [Commented] (YARN-2865) Application recovery continuously fails with Application with id already present. Cannot duplicate

[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218171#comment-14218171 ] Hadoop QA commented on YARN-2865: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2299) inconsistency at identifying node

[ https://issues.apache.org/jira/browse/YARN-2299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218195#comment-14218195 ] Bruno Alexandre Rosa commented on YARN-2299: What are the affected versions?

[jira] [Commented] (YARN-2299) inconsistency at identifying node

[ https://issues.apache.org/jira/browse/YARN-2299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218207#comment-14218207 ] Bruno Alexandre Rosa commented on YARN-2299: Which* inconsistency at

[jira] [Updated] (YARN-2356) yarn status command for non-existent application/application attempt/container is too verbose

[ https://issues.apache.org/jira/browse/YARN-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2356: -- Attachment: 0001-YARN-2356.patch Thank you [~jianhe] , [~devaraj.k] for the comments. I have updated the patch

[jira] [Commented] (YARN-2375) Allow enabling/disabling timeline server per framework

[ https://issues.apache.org/jira/browse/YARN-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218254#comment-14218254 ] Hadoop QA commented on YARN-2375: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2495: Attachment: YARN-2495.20141119-1.patch Updating patch With [~wangda] 's review comments...

[jira] [Updated] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2729: Attachment: YARN-2729.20141120-1.patch Updating patch with [~wangda]'s review comments

[jira] [Created] (YARN-2879) Compatibility validation between YARN 2.2/2.4 and 2.6

Zhijie Shen created YARN-2879: - Summary: Compatibility validation between YARN 2.2/2.4 and 2.6 Key: YARN-2879 URL: https://issues.apache.org/jira/browse/YARN-2879 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2879) Compatibility validation between YARN 2.2/2.4 and 2.6

[ https://issues.apache.org/jira/browse/YARN-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218388#comment-14218388 ] Zhijie Shen commented on YARN-2879: --- a. In the following scenarios: 1. Either insecure

[jira] [Created] (YARN-2880) Add a test in TestRMRestart to make sure node labels will be recovered if it is enabled

Wangda Tan created YARN-2880: Summary: Add a test in TestRMRestart to make sure node labels will be recovered if it is enabled Key: YARN-2880 URL: https://issues.apache.org/jira/browse/YARN-2880 Project:

[jira] [Comment Edited] (YARN-2879) Compatibility validation between YARN 2.2/2.4 and 2.6

[ https://issues.apache.org/jira/browse/YARN-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218388#comment-14218388 ] Zhijie Shen edited comment on YARN-2879 at 11/19/14 7:50 PM: -

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

, YARN-2800-20141118-1.patch, YARN-2800-20141118-2.patch, YARN-2800-20141119-1.patch In the past, we have a MemoryNodeLabelStore, mostly for user to try this feature without configuring where to store node labels on file system. It seems convenient for user to try this, but actually it causes

[jira] [Updated] (YARN-2879) Compatibility validation between YARN 2.2/2.4 and 2.6

[ https://issues.apache.org/jira/browse/YARN-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2879: -- Description: Recently, I did some simple backward compatibility experiments. Bascially, I've taken the

[jira] [Commented] (YARN-2879) Compatibility validation between YARN 2.2/2.4 and 2.6

[ https://issues.apache.org/jira/browse/YARN-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218405#comment-14218405 ] Zhijie Shen commented on YARN-2879: --- In the following scenarios: 1. Either insecure or

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218439#comment-14218439 ] Hadoop QA commented on YARN-2495: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2375) Allow enabling/disabling timeline server per framework

[ https://issues.apache.org/jira/browse/YARN-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218507#comment-14218507 ] Jonathan Eagles commented on YARN-2375: --- This code looks good to me. [~zjshen], can

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12682473/YARN-2800-20141119-1.patch against trunk revision 5bd048e. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch appears

[jira] [Issue Comment Deleted] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2877: Comment: was deleted (was: (ignore that comment, was for YARN-2875)) Extend YARN to support

[jira] [Issue Comment Deleted] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2877: Comment: was deleted (was: Linking to HADOOP-11317 to cover project-wide use. I don't think

[jira] [Commented] (YARN-2865) Application recovery continuously fails with Application with id already present. Cannot duplicate

[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218598#comment-14218598 ] Jian He commented on YARN-2865: --- lgtm, test failures looks unrelated, re-kick jenkins

[jira] [Commented] (YARN-2878) Fix DockerContainerExecutor.apt.vm formatting

[ https://issues.apache.org/jira/browse/YARN-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218607#comment-14218607 ] Jian He commented on YARN-2878: --- +1, committing. thanks [~ashahab] for the patch and thanks

[jira] [Commented] (YARN-2301) Improve yarn container command

[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218629#comment-14218629 ] Zhijie Shen commented on YARN-2301: --- bq. i need to create new YARNConfigurations

[jira] [Commented] (YARN-2878) Fix DockerContainerExecutor.apt.vm formatting

[ https://issues.apache.org/jira/browse/YARN-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218651#comment-14218651 ] Hudson commented on YARN-2878: -- FAILURE: Integrated in Hadoop-trunk-Commit #6575 (See

[jira] [Commented] (YARN-2738) Add FairReservationSystem for FairScheduler

[ https://issues.apache.org/jira/browse/YARN-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218666#comment-14218666 ] Hadoop QA commented on YARN-2738: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2865) Application recovery continuously fails with Application with id already present. Cannot duplicate

[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218715#comment-14218715 ] Hadoop QA commented on YARN-2865: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2765) Add leveldb-based implementation for RMStateStore

[ https://issues.apache.org/jira/browse/YARN-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218766#comment-14218766 ] Jian He commented on YARN-2765: --- thanks Jason for working on this. It's useful to have

[jira] [Commented] (YARN-2301) Improve yarn container command

[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218794#comment-14218794 ] Jian He commented on YARN-2301: --- bq. he port will be node's http NM can setup SSL and so the

[jira] [Commented] (YARN-2604) Scheduler should consider max-allocation-* in conjunction with the largest node

[ https://issues.apache.org/jira/browse/YARN-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218855#comment-14218855 ] Karthik Kambatla commented on YARN-2604: Thanks for the updating the patch. I

[jira] [Commented] (YARN-2738) Add FairReservationSystem for FairScheduler

[ https://issues.apache.org/jira/browse/YARN-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218883#comment-14218883 ] Subru Krishnan commented on YARN-2738: -- Thanks [~adhoot] for the updated patch. It

[jira] [Updated] (YARN-2784) Yarn project module names in POM needs to consistent acros hadoop project

[ https://issues.apache.org/jira/browse/YARN-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2784: - Fix Version/s: (was: 2.6.0) 2.7.0 Yarn project module names in POM needs to consistent

[jira] [Assigned] (YARN-2880) Add a test in TestRMRestart to make sure node labels will be recovered if it is enabled

[ https://issues.apache.org/jira/browse/YARN-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-2880: Assignee: Rohith Add a test in TestRMRestart to make sure node labels will be recovered if it is enabled

[jira] [Assigned] (YARN-2599) Standby RM should also expose some jmx and metrics

[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-2599: Assignee: Rohith Standby RM should also expose some jmx and metrics

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218956#comment-14218956 ] Karthik Kambatla commented on YARN-2802: This should be very useful. The patch

[jira] [Updated] (YARN-2802) ClusterMetrics to include AM launch and register delays

[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2802: --- Summary: ClusterMetrics to include AM launch and register delays (was: add AM container

[jira] [Commented] (YARN-2675) the containersKilled metrics is not updated when the container is killed during localization.

[ https://issues.apache.org/jira/browse/YARN-2675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218965#comment-14218965 ] Karthik Kambatla commented on YARN-2675: Can we add unit tests to exercise all the

[jira] [Commented] (YARN-2802) ClusterMetrics to include AM launch and register delays

[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218969#comment-14218969 ] Hudson commented on YARN-2802: -- FAILURE: Integrated in Hadoop-trunk-Commit #6578 (See

[jira] [Commented] (YARN-2679) add container launch prepare time metrics to NM.

[ https://issues.apache.org/jira/browse/YARN-2679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218970#comment-14218970 ] Karthik Kambatla commented on YARN-2679: How about renaming the metric to

[jira] [Commented] (YARN-2315) Should use setCurrentCapacity instead of setCapacity to configure used resource capacity for FairScheduler.

[ https://issues.apache.org/jira/browse/YARN-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218977#comment-14218977 ] Karthik Kambatla commented on YARN-2315: +1. Should use setCurrentCapacity

[jira] [Updated] (YARN-2315) FairScheduler: Should use setCurrentCapacity instead of setCapacity to configure used resource capacity for FairScheduler.

[ https://issues.apache.org/jira/browse/YARN-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2315: --- Summary: FairScheduler: Should use setCurrentCapacity instead of setCapacity to configure used

[jira] [Updated] (YARN-2315) FairScheduler: Set current capacity in addition to capacity

[ https://issues.apache.org/jira/browse/YARN-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2315: --- Summary: FairScheduler: Set current capacity in addition to capacity (was: FairScheduler:

[jira] [Commented] (YARN-2315) FairScheduler: Set current capacity in addition to capacity

[ https://issues.apache.org/jira/browse/YARN-2315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218986#comment-14218986 ] Hudson commented on YARN-2315: -- FAILURE: Integrated in Hadoop-trunk-Commit #6579 (See

[jira] [Commented] (YARN-2865) Application recovery continuously fails with Application with id already present. Cannot duplicate

[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14219009#comment-14219009 ] Rohith commented on YARN-2865: -- Thanks Karthik JianHe and Tsuyoshi for your reviews.

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14219019#comment-14219019 ] Sunil G commented on YARN-1963: --- Thank you [~leftnoteasy] bq. I'd prefer highest + default

[jira] [Updated] (YARN-2679) add container launch prepare time metrics to NM.

[ https://issues.apache.org/jira/browse/YARN-2679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2679: Attachment: YARN-2679.001.patch add container launch prepare time metrics to NM.

[jira] [Commented] (YARN-2679) add container launch prepare time metrics to NM.

[ https://issues.apache.org/jira/browse/YARN-2679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14219090#comment-14219090 ] zhihai xu commented on YARN-2679: - Hi [~kasha], Good suggestion, I uploaded a new patch

[jira] [Commented] (YARN-2356) yarn status command for non-existent application/application attempt/container is too verbose

[ https://issues.apache.org/jira/browse/YARN-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14219089#comment-14219089 ] Devaraj K commented on YARN-2356: - Thanks Sunil for the updated patch. 1. bq. I could see