[jira] [Commented] (YARN-2865) Application recovery continuously fails with "Application with id already present. Cannot duplicate"

2014-11-18 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215871#comment-14215871 ] Rohith commented on YARN-2865: -- bq. In addition, we need to clear "systemCredentials, schedul

[jira] [Commented] (YARN-2690) Make ReservationSystem and its dependent classes independent of Scheduler type

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216087#comment-14216087 ] Hudson commented on YARN-2690: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #9 (See [https

[jira] [Commented] (YARN-2574) Add support for FairScheduler to the ReservationSystem

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216093#comment-14216093 ] Hudson commented on YARN-2574: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #9 (See [https

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216086#comment-14216086 ] Hudson commented on YARN-2414: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #9 (See [https

[jira] [Commented] (YARN-2690) Make ReservationSystem and its dependent classes independent of Scheduler type

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216100#comment-14216100 ] Hudson commented on YARN-2690: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #747 (See [https://b

[jira] [Commented] (YARN-2574) Add support for FairScheduler to the ReservationSystem

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216106#comment-14216106 ] Hudson commented on YARN-2574: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #747 (See [https://b

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216099#comment-14216099 ] Hudson commented on YARN-2414: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #747 (See [https://b

[jira] [Commented] (YARN-2865) Application recovery continuously fails with "Application with id already present. Cannot duplicate"

2014-11-18 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216134#comment-14216134 ] Rohith commented on YARN-2865: -- bq. Is it YARN-1874 ? This is different issue that move RMActi

[jira] [Updated] (YARN-2865) Application recovery continuously fails with "Application with id already present. Cannot duplicate"

2014-11-18 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-2865: - Attachment: YARN-2865.patch > Application recovery continuously fails with "Application with id already > present.

[jira] [Commented] (YARN-2865) Application recovery continuously fails with "Application with id already present. Cannot duplicate"

2014-11-18 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216180#comment-14216180 ] Rohith commented on YARN-2865: -- Attached patch that separates RMContext and RMActiveServiceCon

[jira] [Commented] (YARN-2574) Add support for FairScheduler to the ReservationSystem

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216205#comment-14216205 ] Hudson commented on YARN-2574: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1937 (See [https://

[jira] [Commented] (YARN-2690) Make ReservationSystem and its dependent classes independent of Scheduler type

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216199#comment-14216199 ] Hudson commented on YARN-2690: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1937 (See [https://

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216198#comment-14216198 ] Hudson commented on YARN-2414: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1937 (See [https://

[jira] [Commented] (YARN-2690) Make ReservationSystem and its dependent classes independent of Scheduler type

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216213#comment-14216213 ] Hudson commented on YARN-2690: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #9 (See [https

[jira] [Commented] (YARN-2574) Add support for FairScheduler to the ReservationSystem

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216219#comment-14216219 ] Hudson commented on YARN-2574: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #9 (See [https

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216212#comment-14216212 ] Hudson commented on YARN-2414: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #9 (See [https

[jira] [Updated] (YARN-2165) Timelineserver should validate that yarn.timeline-service.ttl-ms is greater than zero

2014-11-18 Thread Vasanth kumar RJ (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasanth kumar RJ updated YARN-2165: --- Attachment: YARN-2165.1.patch [~zjshen] Implemented your comments. Please give comments if any

[jira] [Commented] (YARN-2865) Application recovery continuously fails with "Application with id already present. Cannot duplicate"

2014-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216242#comment-14216242 ] Hadoop QA commented on YARN-2865: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2874) Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps

2014-11-18 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-2874: --- Summary: Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps Key: YARN-2874 URL: https://issues.apache.org/jira/browse/YARN-2874 P

[jira] [Commented] (YARN-2738) Add FairReservationSystem for FairScheduler

2014-11-18 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216246#comment-14216246 ] Anubhav Dhoot commented on YARN-2738: - The minimal configuration we need is ability to

[jira] [Commented] (YARN-2873) improve LevelDB error handling for missing files DBException to avoid NM start failure.

2014-11-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216259#comment-14216259 ] Jason Lowe commented on YARN-2873: -- I have some serious concerns about this approach. As

[jira] [Updated] (YARN-2874) Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps

2014-11-18 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2874: Attachment: YARN-2874.20141118-1.patch > Dead lock in "DelegationTokenRenewer" which blocks R

[jira] [Commented] (YARN-2574) Add support for FairScheduler to the ReservationSystem

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216279#comment-14216279 ] Hudson commented on YARN-2574: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1961 (See [htt

[jira] [Commented] (YARN-2690) Make ReservationSystem and its dependent classes independent of Scheduler type

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216273#comment-14216273 ] Hudson commented on YARN-2690: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1961 (See [htt

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216272#comment-14216272 ] Hudson commented on YARN-2414: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1961 (See [htt

[jira] [Commented] (YARN-2165) Timelineserver should validate that yarn.timeline-service.ttl-ms is greater than zero

2014-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216289#comment-14216289 ] Hadoop QA commented on YARN-2165: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216293#comment-14216293 ] Hudson commented on YARN-2414: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #9 (See [

[jira] [Commented] (YARN-2574) Add support for FairScheduler to the ReservationSystem

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216300#comment-14216300 ] Hudson commented on YARN-2574: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #9 (See [

[jira] [Commented] (YARN-2690) Make ReservationSystem and its dependent classes independent of Scheduler type

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216294#comment-14216294 ] Hudson commented on YARN-2690: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #9 (See [

[jira] [Commented] (YARN-2874) Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps

2014-11-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216307#comment-14216307 ] Jason Lowe commented on YARN-2874: -- Thanks for the report and the patch, [~Naganarasimha].

[jira] [Commented] (YARN-2874) Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps

2014-11-18 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216315#comment-14216315 ] Naganarasimha G R commented on YARN-2874: - Sorry was suppose to remove synchronized

[jira] [Updated] (YARN-2874) Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps

2014-11-18 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2874: Attachment: YARN-2874.20141118-2.patch Updated patch with fixes for review comment > Dead lo

[jira] [Commented] (YARN-2165) Timelineserver should validate that yarn.timeline-service.ttl-ms is greater than zero

2014-11-18 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216407#comment-14216407 ] Chen He commented on YARN-2165: --- Hi [~vasanthkumar], thank you for the patch. A small nit in

[jira] [Commented] (YARN-2165) Timelineserver should validate that yarn.timeline-service.ttl-ms is greater than zero

2014-11-18 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216413#comment-14216413 ] Chen He commented on YARN-2165: --- Agree with [~zhijie shen] to combine parameter checking toge

[jira] [Updated] (YARN-2375) Allow enabling/disabling timeline server per framework

2014-11-18 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-2375: Attachment: YARN-2375.patch Attaching the patch > Allow enabling/disabling timeline server per framework > -

[jira] [Commented] (YARN-2375) Allow enabling/disabling timeline server per framework

2014-11-18 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216422#comment-14216422 ] Mit Desai commented on YARN-2375: - Some changes missed. I will upload another patch > Allo

[jira] [Updated] (YARN-2375) Allow enabling/disabling timeline server per framework

2014-11-18 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-2375: Attachment: YARN-2375.patch Attaching the patch. [~jeagles], [~zjshen] can you see if this approach is good?

[jira] [Commented] (YARN-2675) the containersKilled metrics is not updated when the container is killed during localization.

2014-11-18 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216452#comment-14216452 ] zhihai xu commented on YARN-2675: - Hi [~vinodkv], Are you ok with the new patch? The new

[jira] [Resolved] (YARN-2863) ResourceManager will shutdown when job's queuename is empty

2014-11-18 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K resolved YARN-2863. - Resolution: Invalid > ResourceManager will shutdown when job's queuename is empty > ---

[jira] [Commented] (YARN-2873) improve LevelDB error handling for missing files DBException to avoid NM start failure.

2014-11-18 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216464#comment-14216464 ] zhihai xu commented on YARN-2873: - Hi [~jlowe], I agree with you. The root cause is the So

[jira] [Commented] (YARN-2351) YARN CLI should provide a command to list the configurations in use

2014-11-18 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216465#comment-14216465 ] Rohith commented on YARN-2351: -- hdfs has command like {{hdfs -namenodes}} to determine cluster

[jira] [Assigned] (YARN-2351) YARN CLI should provide a command to list the configurations in use

2014-11-18 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-2351: -- Assignee: Varun Saxena > YARN CLI should provide a command to list the configurations in use > -

[jira] [Created] (YARN-2875) Bump SLF4J to 1.7.7 from 1.7.5

2014-11-18 Thread Tim Robertson (JIRA)
Tim Robertson created YARN-2875: --- Summary: Bump SLF4J to 1.7.7 from 1.7.5 Key: YARN-2875 URL: https://issues.apache.org/jira/browse/YARN-2875 Project: Hadoop YARN Issue Type: Bug R

[jira] [Commented] (YARN-2351) YARN CLI should provide a command to list the configurations in use

2014-11-18 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216556#comment-14216556 ] Allen Wittenauer commented on YARN-2351: We really just need to move getconf to com

[jira] [Updated] (YARN-2874) Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps

2014-11-18 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2874: --- Priority: Blocker (was: Critical) > Dead lock in "DelegationTokenRenewer" which blocks RM to e

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-18 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216635#comment-14216635 ] Anubhav Dhoot commented on YARN-2802: - This metric probably will not catch issues with

[jira] [Updated] (YARN-2874) Dead lock in "DelegationTokenRenewer" which blocks RM to execute any further apps

2014-11-18 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2874: --- Target Version/s: 2.7.0 Affects Version/s: (was: 2.4.1) (was

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216674#comment-14216674 ] Wangda Tan commented on YARN-1963: -- Thanks [~sunilg], [~vinodkv] for your great effort on

[jira] [Commented] (YARN-2738) Add FairReservationSystem for FairScheduler

2014-11-18 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216693#comment-14216693 ] Subru Krishnan commented on YARN-2738: -- [~adhoot], [~kasha] the approach suggested by

[jira] [Updated] (YARN-2165) Timelineserver should validate that yarn.timeline-service.ttl-ms is greater than zero

2014-11-18 Thread Vasanth kumar RJ (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasanth kumar RJ updated YARN-2165: --- Attachment: YARN-2165.2.patch [~airbots] Implemented your suggestion and attached patch > Time

[jira] [Updated] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-18 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2802: Attachment: YARN-2802.004.patch > add AM container launch and register delay metrics in QueueMetrics to help

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-18 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216741#comment-14216741 ] zhihai xu commented on YARN-2802: - Hi [~adhoot], thanks for the review. Good finding, I up

[jira] [Commented] (YARN-2165) Timelineserver should validate that yarn.timeline-service.ttl-ms is greater than zero

2014-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216765#comment-14216765 ] Hadoop QA commented on YARN-2165: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2865) Application recovery continuously fails with "Application with id already present. Cannot duplicate"

2014-11-18 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216806#comment-14216806 ] Karthik Kambatla commented on YARN-2865: Patch looks mostly good. Minor comments -

[jira] [Commented] (YARN-2745) YARN new pluggable scheduler which does multi-resource packing

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216828#comment-14216828 ] Wangda Tan commented on YARN-2745: -- [~srikanthkandula], Exactly, but I think YARN-314 is p

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216853#comment-14216853 ] Hadoop QA commented on YARN-2802: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2375) Allow enabling/disabling timeline server per framework

2014-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216865#comment-14216865 ] Hadoop QA commented on YARN-2375: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to disable

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Summary: Remove MemoryNodeLabelsStore and add a way to disable (was: Should print WARN log in both RM/RMA

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Summary: Remove MemoryNodeLabelsStore and add a way to disable node labels feature (was: Remove MemoryNode

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Summary: Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature (was: Remove Mem

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Description: In the past, we have a MemoryNodeLabelStore, mostly for user to try this feature without conf

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Description: In the past, we have a MemoryNodeLabelStore, mostly for user to try this feature without conf

[jira] [Commented] (YARN-2865) Application recovery continuously fails with "Application with id already present. Cannot duplicate"

2014-11-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216893#comment-14216893 ] Jian He commented on YARN-2865: --- looks good to me too. minor thing: In RMActiveServices, some

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216897#comment-14216897 ] Wangda Tan commented on YARN-2800: -- [~vinodkv], [~ozawa], thanks for your comments, I've e

[jira] [Commented] (YARN-2165) Timelineserver should validate that yarn.timeline-service.ttl-ms is greater than zero

2014-11-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216914#comment-14216914 ] Zhijie Shen commented on YARN-2165: --- [~vasanthkumar], thanks for your contribution! Some

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-18 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216915#comment-14216915 ] Anubhav Dhoot commented on YARN-2802: - LGTM > add AM container launch and register del

[jira] [Commented] (YARN-2301) Improve yarn container command

2014-11-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216945#comment-14216945 ] Jian He commented on YARN-2301: --- thanks [~Naganarasimha], looked at the latest patch, some co

[jira] [Created] (YARN-2876) In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for subqueues

2014-11-18 Thread Siqi Li (JIRA)
Siqi Li created YARN-2876: - Summary: In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for subqueues Key: YARN-2876 URL: https://issues.apache.org/jira/browse/YARN-2876 Project: Hadoop YA

[jira] [Commented] (YARN-2375) Allow enabling/disabling timeline server per framework

2014-11-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14216973#comment-14216973 ] Zhijie Shen commented on YARN-2375: --- [~mitdesai], thanks for the patch. Two suggestions:

[jira] [Updated] (YARN-2876) In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for subqueues

2014-11-18 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2876: -- Description: If a subqueue doesn't have a maxResource set in fair-scheduler.xml, JMX and Scheduler UI will displ

[jira] [Updated] (YARN-2876) In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for subqueues

2014-11-18 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2876: -- Attachment: screenshot-1.png > In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for > subq

[jira] [Updated] (YARN-2876) In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for subqueues

2014-11-18 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2876: -- Attachment: YARN-2876.v1.patch > In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for > su

[jira] [Updated] (YARN-2157) Document YARN metrics

2014-11-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2157: -- Attachment: YARN-2157.3.patch > Document YARN metrics > - > > Key: YARN-2157

[jira] [Commented] (YARN-2157) Document YARN metrics

2014-11-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217006#comment-14217006 ] Jian He commented on YARN-2157: --- thanks [~ajisakaa], sorry for the late feedback. looks good

[jira] [Commented] (YARN-2876) In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for subqueues

2014-11-18 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217008#comment-14217008 ] Siqi Li commented on YARN-2876: --- Hi [~sandyr], Can you take a look at this? Although, this pr

[jira] [Commented] (YARN-2375) Allow enabling/disabling timeline server per framework

2014-11-18 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217010#comment-14217010 ] Mit Desai commented on YARN-2375: - Thanks for reviewing [~zjshen]. One clarification. bq. 1

[jira] [Commented] (YARN-2876) In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for subqueues

2014-11-18 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217012#comment-14217012 ] Wei Yan commented on YARN-2876: --- {code} +if (maxShare.equals(Resources.unbounded()) && p

[jira] [Updated] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-18 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2802: Attachment: YARN-2802.005.patch > add AM container launch and register delay metrics in QueueMetrics to help

[jira] [Commented] (YARN-2876) In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for subqueues

2014-11-18 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217034#comment-14217034 ] Siqi Li commented on YARN-2876: --- No, If parent queue is also not configured, it will keep que

[jira] [Commented] (YARN-2876) In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for subqueues

2014-11-18 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217036#comment-14217036 ] Wei Yan commented on YARN-2876: --- Oh, you're right, I misunderstood it. > In Fair Scheduler,

[jira] [Commented] (YARN-2375) Allow enabling/disabling timeline server per framework

2014-11-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217049#comment-14217049 ] Zhijie Shen commented on YARN-2375: --- bq. Do you mean that we should not check for TIMELIN

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Attachment: YARN-2800-20141118-1.patch Uploaded patch and kick Jenkins > Remove MemoryNodeLabelsStore

[jira] [Updated] (YARN-2870) Update examples in document of Timeline Server

2014-11-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2870: -- Assignee: Masatake Iwasaki > Update examples in document of Timeline Server > ---

[jira] [Commented] (YARN-2870) Update examples in document of Timeline Server

2014-11-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217074#comment-14217074 ] Zhijie Shen commented on YARN-2870: --- It's better to completely update the document (YARN-

[jira] [Commented] (YARN-2157) Document YARN metrics

2014-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217084#comment-14217084 ] Hadoop QA commented on YARN-2157: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2870) Update examples in document of Timeline Server

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217105#comment-14217105 ] Hudson commented on YARN-2870: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6569 (See [https:

[jira] [Commented] (YARN-2157) Document YARN metrics

2014-11-18 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217122#comment-14217122 ] Hudson commented on YARN-2157: -- FAILURE: Integrated in Hadoop-trunk-Commit #6570 (See [https:

[jira] [Commented] (YARN-2876) In Fair Scheduler, JMX and Scheduler UI display wrong maxResource info for subqueues

2014-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217126#comment-14217126 ] Hadoop QA commented on YARN-2876: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-2522) AHSClient may be not necessary

2014-11-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2522: -- Target Version/s: 2.7.0 > AHSClient may be not necessary > -- > >

[jira] [Commented] (YARN-2802) add AM container launch and register delay metrics in QueueMetrics to help diagnose performance issue.

2014-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217188#comment-14217188 ] Hadoop QA commented on YARN-2802: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2877) Extend YARN to support distributed scheduling

2014-11-18 Thread Sriram Rao (JIRA)
Sriram Rao created YARN-2877: Summary: Extend YARN to support distributed scheduling Key: YARN-2877 URL: https://issues.apache.org/jira/browse/YARN-2877 Project: Hadoop YARN Issue Type: New Featu

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

2014-11-18 Thread Sriram Rao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217207#comment-14217207 ] Sriram Rao commented on YARN-2877: -- The proposal: # Extend the NM to support task queuein

[jira] [Commented] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Hadoop QA (JIRA)
s of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12682292/YARN-2800-20141118-1.patch against trunk revision fbf81fb. {color:green}+1 @author{color}. The patch does not contain any @author tags. {color:green}+1 tests included{color}. The patch app

[jira] [Updated] (YARN-2800) Remove MemoryNodeLabelsStore and add a way to enable/disable node labels feature

2014-11-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2800: - Attachment: YARN-2800-20141118-2.patch Updated patch, fixed UT > Remove MemoryNodeLabelsStore and ad

[jira] [Commented] (YARN-2157) Document YARN metrics

2014-11-18 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217268#comment-14217268 ] Akira AJISAKA commented on YARN-2157: - Thank you, [~jianhe]! > Document YARN metrics >

[jira] [Commented] (YARN-2206) Update document for applications REST API response examples

2014-11-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217280#comment-14217280 ] Jian He commented on YARN-2206: --- [~kj-ki], thanks for working on this. Patch not applying any

[jira] [Commented] (YARN-2404) Remove ApplicationAttemptState and ApplicationState class in RMStateStore class

2014-11-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217302#comment-14217302 ] Jian He commented on YARN-2404: --- [~ozawa], sorry for the late response, patch not applying an

[jira] [Commented] (YARN-2404) Remove ApplicationAttemptState and ApplicationState class in RMStateStore class

2014-11-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217308#comment-14217308 ] Hadoop QA commented on YARN-2404: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2356) yarn status command for non-existent application/application attempt/container is too verbose

2014-11-18 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217334#comment-14217334 ] Jian He commented on YARN-2356: --- [~sunilg], thanks for working on this. Patch looks good, one

[jira] [Commented] (YARN-2404) Remove ApplicationAttemptState and ApplicationState class in RMStateStore class

2014-11-18 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217337#comment-14217337 ] Tsuyoshi OZAWA commented on YARN-2404: -- [~jianhe], Thanks for your pinging me. I'll up

  1   2   >