[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391142#comment-14391142 ] Junping Du commented on YARN-3046: -- Hi [~rkanter], as I mentioned offline early, can I

[jira] [Commented] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390996#comment-14390996 ] Bibin A Chundatt commented on YARN-3425: [~leftnoteasy] Thank you for looking into

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14390995#comment-14390995 ] Sunil G commented on YARN-2003: --- Thank You [~leftnoteasy] I will rebase YARN-2004 and will

[jira] [Commented] (YARN-2268) Disallow formatting the RMStateStore when there is an RM running

[ https://issues.apache.org/jira/browse/YARN-2268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391166#comment-14391166 ] Karthik Kambatla commented on YARN-2268: IIRR, the store formatting is actually

[jira] [Created] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

Zhijie Shen created YARN-3431: - Summary: Sub resources of timeline entity needs to be passed to a separate endpoint. Key: YARN-3431 URL: https://issues.apache.org/jira/browse/YARN-3431 Project: Hadoop

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391067#comment-14391067 ] Wangda Tan commented on YARN-2729: -- Hi [~Naganarasimha], Sorry for my late response, bq.

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391102#comment-14391102 ] Naganarasimha G R commented on YARN-2729: - Thanks [~wangda] for the review, bq. I

[jira] [Commented] (YARN-3374) Collector's web server should randomly bind an available port

[ https://issues.apache.org/jira/browse/YARN-3374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391131#comment-14391131 ] Junping Du commented on YARN-3374: -- Patch looks good. +1. Will commit it soon.

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391152#comment-14391152 ] Wangda Tan commented on YARN-3410: -- bq. I think there is choice between start up option

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391179#comment-14391179 ] Vrushali C commented on YARN-3391: -- bq. Otherwise, if we use the job name, for example,

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391218#comment-14391218 ] Sandy Ryza commented on YARN-3415: -- +1 Non-AM containers can be counted towards

[jira] [Commented] (YARN-1876) Document the REST APIs of timeline and generic history services

[ https://issues.apache.org/jira/browse/YARN-1876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391226#comment-14391226 ] Naganarasimha G R commented on YARN-1876: - [~zjshen] [~jianhe], Hope this is not

[jira] [Commented] (YARN-3424) Change logs for ContainerMonitorImpl's resourse monitoring from info to debug

[ https://issues.apache.org/jira/browse/YARN-3424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391248#comment-14391248 ] Anubhav Dhoot commented on YARN-3424: - Thanks [~ozawa] for the quick review and commit!

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391296#comment-14391296 ] Vrushali C commented on YARN-3391: -- I have some semantic level comments. 1) bq. public

[jira] [Assigned] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-3046: --- Assignee: Junping Du (was: Robert Kanter) Sure; go ahead. [Event producers] Implement

[jira] [Commented] (YARN-3425) NPE from RMNodeLabelsManager.serviceStop when NodeLabelsManager.serviceInit failed

[ https://issues.apache.org/jira/browse/YARN-3425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391021#comment-14391021 ] Hudson commented on YARN-3425: -- FAILURE: Integrated in Hadoop-trunk-Commit #7485 (See

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391106#comment-14391106 ] Wangda Tan commented on YARN-2740: -- [~Naganarasimha], Took a look, some comments: 1)

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391549#comment-14391549 ] Zhijie Shen commented on YARN-3391: --- I have offline discussion with Vrushali. Here's some

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391554#comment-14391554 ] Joep Rottinghuis commented on YARN-3391: Whether the app_id needs to be part of the

[jira] [Updated] (YARN-3413) Node label attributes (like exclusive or not) should be able to set when addToClusterNodeLabels and shouldn't be changed during runtime

[ https://issues.apache.org/jira/browse/YARN-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3413: - Attachment: YARN-3413.1.patch Attached ver.1 patch contains changes - Removed updateNodeLabel interface in

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391584#comment-14391584 ] Junping Du commented on YARN-3334: -- bq. I probably know the problem. I'll fix it

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391590#comment-14391590 ] Hudson commented on YARN-3430: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7488 (See

[jira] [Updated] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kareem El Gebaly updated YARN-1572: --- Attachment: 0001-Fix-for-YARN-1572.patch Fix for YARN-1572 applies to 2.3.0 Low chance to

[jira] [Created] (YARN-3432) Cluster metrics have wrong Total Memory when there is reserved memory on CS

Thomas Graves created YARN-3432: --- Summary: Cluster metrics have wrong Total Memory when there is reserved memory on CS Key: YARN-3432 URL: https://issues.apache.org/jira/browse/YARN-3432 Project:

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391118#comment-14391118 ] Wangda Tan commented on YARN-2729: -- bq. i dint want to add a new configuration to enable

[jira] [Commented] (YARN-2467) Add SpanReceiverHost to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391367#comment-14391367 ] Hadoop QA commented on YARN-2467: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391403#comment-14391403 ] Zhijie Shen commented on YARN-3430: --- +1 LGTM Test it locally, and it works fine.

[jira] [Updated] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2729: Attachment: YARN-2729.20150402-1.patch Attaching a patch to disable the timer and include

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391436#comment-14391436 ] Junping Du commented on YARN-3046: -- Thanks [~rkanter]! I will try to deliver a patch soon.

[jira] [Updated] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kareem El Gebaly updated YARN-1572: --- Release Note: (was: Fix for YARN-1572 added if !null guarding condition) Low chance to hit

[jira] [Commented] (YARN-656) In scheduler UI, including reserved memory in Memory Total can make it exceed cluster capacity.

[ https://issues.apache.org/jira/browse/YARN-656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391472#comment-14391472 ] Thomas Graves commented on YARN-656: Note this broke the UI, at least for the capacity

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391361#comment-14391361 ] Zhijie Shen commented on YARN-3430: --- Target 2.7 as it seems to be introduced by

[jira] [Updated] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3430: -- Description: (was: Target 2.7 as it seems to be introduced by YARN-3379.) RMAppAttempt headroom

[jira] [Updated] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3430: -- Description: Target 2.7 as it seems to be introduced by YARN-3379. Target Version/s: 2.7.0

[jira] [Commented] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391406#comment-14391406 ] Wangda Tan commented on YARN-1572: -- This is a bad bug, adding null check seems enough to

[jira] [Updated] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3431: -- Attachment: YARN-3431.1.patch Create a patch to treat the extended classes as the sub resources and put

[jira] [Commented] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391363#comment-14391363 ] Kareem El Gebaly commented on YARN-1572: I agree with solution. It affects version

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391617#comment-14391617 ] Zhijie Shen commented on YARN-3391: --- Thanks for your input, Joep! bq. Therefore it seems

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391624#comment-14391624 ] Sandy Ryza commented on YARN-3415: -- [~ragarwal] did you have any more comments before I

[jira] [Commented] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391658#comment-14391658 ] Zhijie Shen commented on YARN-3430: --- Sigh, it breaks branch-2.7 because YARN-3273 is not

[jira] [Reopened] (YARN-3430) RMAppAttempt headroom data is missing in RM Web UI

[ https://issues.apache.org/jira/browse/YARN-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reopened YARN-3430: --- RMAppAttempt headroom data is missing in RM Web UI --

[jira] [Commented] (YARN-3415) Non-AM containers can be counted towards amResourceUsage of a fairscheduler queue

[ https://issues.apache.org/jira/browse/YARN-3415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391674#comment-14391674 ] Rohit Agarwal commented on YARN-3415: - It looks good. I have one minor comment: {code}

[jira] [Commented] (YARN-3273) Improve web UI to facilitate scheduling analysis and debugging

[ https://issues.apache.org/jira/browse/YARN-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391692#comment-14391692 ] Zhijie Shen commented on YARN-3273: --- [~jianhe], is it okay to pull it into 2.7? Improve

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14391701#comment-14391701 ] Jian Fang commented on YARN-796: Thanks Wangda for your clarification. Unfortunately the

<    1   2