[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344082#comment-16344082 ] Miklos Szegedi commented on YARN-7815: -- Thank you, for the replies [~jlowe] and [~eyang]. I understand

[jira] [Updated] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-29 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-7677: -- Attachment: YARN-7677.001.patch > HADOOP_CONF_DIR should not be automatically put in task environment >

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344071#comment-16344071 ] Eric Yang commented on YARN-7815: - [~miklos.szeg...@cloudera.com] It will be hard to enforce read-only to

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344123#comment-16344123 ] Jason Lowe commented on YARN-7815: -- bq. Can we break anything if we move localized user-private files from

[jira] [Created] (YARN-7846) Ss

2018-01-29 Thread Said Ali Alshwqbi (JIRA)
Said Ali Alshwqbi created YARN-7846: --- Summary: Ss Key: YARN-7846 URL: https://issues.apache.org/jira/browse/YARN-7846 Project: Hadoop YARN Issue Type: Improvement Components:

[jira] [Created] (YARN-7848) Force removal of docker containers that do not get removed on first try

2018-01-29 Thread Eric Badger (JIRA)
Eric Badger created YARN-7848: - Summary: Force removal of docker containers that do not get removed on first try Key: YARN-7848 URL: https://issues.apache.org/jira/browse/YARN-7848 Project: Hadoop YARN

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344154#comment-16344154 ] Konstantinos Karanasos commented on YARN-7778: -- Hi [~cheersyang], just checked your proposal.

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344052#comment-16344052 ] Miklos Szegedi commented on YARN-7815: -- Thank you [~jlowe] for the response. I agree with 1. and 2.

[jira] [Created] (YARN-7847) Provide permalinks for container logs

2018-01-29 Thread Gera Shegalov (JIRA)
Gera Shegalov created YARN-7847: --- Summary: Provide permalinks for container logs Key: YARN-7847 URL: https://issues.apache.org/jira/browse/YARN-7847 Project: Hadoop YARN Issue Type: New

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344067#comment-16344067 ] Jason Lowe commented on YARN-7815: -- This would break a framework where containers on the same node act as

[jira] [Commented] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-29 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344137#comment-16344137 ] Jim Brennan commented on YARN-7677: --- Based on the discussion here and in YARN-7226, and after discussing

[jira] [Commented] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-01-29 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344130#comment-16344130 ] Xuan Gong commented on YARN-7598: - [~djp] Thanks for the comment. Attached a new patch for this > Document

[jira] [Updated] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-01-29 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7598: Attachment: YARN-7598.2.patch > Document how to use classpath isolation for aux-services in YARN >

[jira] [Updated] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-01-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6675: - Attachment: YARN-6675-YARN-1011.prelim0.patch > Add NM support to launch opportunistic containers based on

[jira] [Resolved] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-7846. --- Resolution: Invalid > Ss > -- > > Key: YARN-7846 > URL:

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343871#comment-16343871 ] Haibo Chen commented on YARN-7835: -- [~rohithsharma] Trying to understand the issue here. It seems like a

[jira] [Commented] (YARN-2175) Container localization has no timeouts and tasks can be stuck there for a long time

2018-01-29 Thread Tao Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343997#comment-16343997 ] Tao Zhang commented on YARN-2175: - We're facing this issue too. Localization in part of containers may take

[jira] [Commented] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343825#comment-16343825 ] Shane Kumpf commented on YARN-7846: --- Another that I'm going to close this as invalid. If you intended to

[jira] [Updated] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7846: -- Hadoop Flags: (was: Incompatible change,Reviewed) > Ss > -- > > Key: YARN-7846 >

[jira] [Updated] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7846: -- Flags: (was: Patch,Important) > Ss > -- > > Key: YARN-7846 > URL:

[jira] [Commented] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343887#comment-16343887 ] genericqa commented on YARN-7841: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7811) Service AM should use configured default docker network

2018-01-29 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344011#comment-16344011 ] Gour Saha commented on YARN-7811: - /cc [~shaneku...@gmail.com] . I remember a discussion where there were

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343897#comment-16343897 ] Konstantinos Karanasos commented on YARN-7822: -- Patch looks good, thanks [~cheersyang]. I

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344007#comment-16344007 ] Jason Lowe commented on YARN-7815: -- bq. Would it make sense to detach the appcache and mount a separate

[jira] [Commented] (YARN-7845) H

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343823#comment-16343823 ] Shane Kumpf commented on YARN-7845: --- I'm going to close this as invalid. If you intended to open this

[jira] [Updated] (YARN-7845) H

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7845: -- Affects Version/s: (was: 2.7.5) Target Version/s: (was: 3.0.0-alpha2) Fix Version/s:

[jira] [Resolved] (YARN-7845) H

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf resolved YARN-7845. --- Resolution: Invalid > H > - > > Key: YARN-7845 > URL:

[jira] [Updated] (YARN-7846) Ss

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7846: -- Affects Version/s: (was: 2.7.5) Target Version/s: (was: 3.0.0-alpha2) Fix Version/s:

[jira] [Commented] (YARN-7598) Document how to use classpath isolation for aux-services in YARN

2018-01-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343874#comment-16343874 ] Junping Du commented on YARN-7598: -- Thanks [~vinodkv] for comments. I agree that's a reasonable

[jira] [Commented] (YARN-7829) Rebalance UI2 cluster overview page

2018-01-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343819#comment-16343819 ] Eric Yang commented on YARN-7829: - [~GergelyNovak] Thank you for the patch.  The dashboard looks better

[jira] [Commented] (YARN-7780) Documentation for Placement Constraints

2018-01-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343904#comment-16343904 ] Konstantinos Karanasos commented on YARN-7780: -- Thanks for the comments, [~sunilg]. I will

[jira] [Commented] (YARN-7811) Service AM should use configured default docker network

2018-01-29 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344022#comment-16344022 ] Shane Kumpf commented on YARN-7811: --- There has been discussion, but no work has started that I am aware

[jira] [Commented] (YARN-7723) Avoid using docker volume --format option to compatible to older docker releases

2018-01-29 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344211#comment-16344211 ] Eric Badger commented on YARN-7723: --- Sorry for the long hiatus. Patch looks good to me. +1 (non-binding)

[jira] [Updated] (YARN-7851) Graph view does not show all AM attempts

2018-01-29 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-7851: - Attachment: Screen Shot 2018-01-29 at 4.16.47 PM.png > Graph view does not show all AM attempts >

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344379#comment-16344379 ] Weiwei Yang commented on YARN-7778: --- Thanks for the feedback [~kkaranasos], I will work on a patch once

[jira] [Comment Edited] (YARN-7853) SLS failed to startup due to java.lang.NoClassDefFoundError

2018-01-29 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344382#comment-16344382 ] Yufei Gu edited comment on YARN-7853 at 1/30/18 1:56 AM: - TimelineCollectorManager

[jira] [Commented] (YARN-7853) SLS failed to startup due to java.lang.NoClassDefFoundError

2018-01-29 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344382#comment-16344382 ] Yufei Gu commented on YARN-7853: We probably want to put

[jira] [Created] (YARN-7844) Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX

2018-01-29 Thread Wei Yan (JIRA)
Wei Yan created YARN-7844: - Summary: Expose metrics for scheduler operation (allocate, schedulerEvent) to JMX Key: YARN-7844 URL: https://issues.apache.org/jira/browse/YARN-7844 Project: Hadoop YARN

[jira] [Updated] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7841: - Attachment: YARN-7841-002.patch > Cleanup AllocationFileLoaderService's reloadAllocations method >

[jira] [Commented] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343702#comment-16343702 ] Szilard Nemeth commented on YARN-7841: -- fixed reasonable checkstyle issues. The unit test failure is

[jira] [Created] (YARN-7845) H

2018-01-29 Thread Said Ali Alshwqbi (JIRA)
Said Ali Alshwqbi created YARN-7845: --- Summary: H Key: YARN-7845 URL: https://issues.apache.org/jira/browse/YARN-7845 Project: Hadoop YARN Issue Type: Improvement Components:

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343069#comment-16343069 ] Weiwei Yang commented on YARN-7839: --- Hi [~asuresh] When there is multiple threads running placement

[jira] [Commented] (YARN-7765) [Atsv2] GSSException: No valid credentials provided - Failed to find any Kerberos tgt thrown by Timelinev2Client & HBaseClient in NM

2018-01-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343080#comment-16343080 ] Rohith Sharma K S commented on YARN-7765: - thanks Jian for the review and committing the patch!

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343062#comment-16343062 ] genericqa commented on YARN-7822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-4490) RM restart the finished app shows wrong Diagnostics status

2018-01-29 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shen Yinjie reassigned YARN-4490: - Assignee: Shen Yinjie > RM restart the finished app shows wrong Diagnostics status >

[jira] [Updated] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7822: -- Attachment: YARN-7822-YARN-6592.004.patch > Constraint satisfaction checker support for composite OR and

[jira] [Created] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7840: - Summary: Update PB for prefix support of node attributes Key: YARN-7840 URL: https://issues.apache.org/jira/browse/YARN-7840 Project: Hadoop YARN Issue Type:

[jira] [Assigned] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-7840: - Assignee: Naganarasimha G R (was: Weiwei Yang) > Update PB for prefix support of node attributes

[jira] [Assigned] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-7840: - Assignee: Weiwei Yang > Update PB for prefix support of node attributes >

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-01-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343133#comment-16343133 ] Arun Suresh commented on YARN-7839: --- [~cheersyang], bq. Instead, I am thinking... can we generate a list

[jira] [Commented] (YARN-7698) A misleading variable's name in ApplicationAttemptEventDispatcher

2018-01-29 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343142#comment-16343142 ] Jinjiang Ling commented on YARN-7698: - Hi [~ajisakaa], could please you review it ? > A misleading

[jira] [Updated] (YARN-4490) RM restart the finished app shows wrong Diagnostics status

2018-01-29 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shen Yinjie updated YARN-4490: -- Attachment: YARN-4490_1.patch > RM restart the finished app shows wrong Diagnostics status >

[jira] [Commented] (YARN-4490) RM restart the finished app shows wrong Diagnostics status

2018-01-29 Thread Shen Yinjie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343128#comment-16343128 ] Shen Yinjie commented on YARN-4490: --- Hi,[~mohdshahidkhan],we applied YARN-5437 and found this problem

[jira] [Updated] (YARN-7842) PB changes to carry node-attributes in NM heartbeat

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7842: -- Attachment: YARN-7842-YARN-3409.001.patch > PB changes to carry node-attributes in NM heartbeat >

[jira] [Created] (YARN-7842) PB changes to carry node-attributes in NM heartbeat

2018-01-29 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7842: - Summary: PB changes to carry node-attributes in NM heartbeat Key: YARN-7842 URL: https://issues.apache.org/jira/browse/YARN-7842 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343132#comment-16343132 ] Rohith Sharma K S commented on YARN-7835: - cc:/ [~vrushalic] > [Atsv2] Race condition in NM while

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343154#comment-16343154 ] Weiwei Yang commented on YARN-7839: --- Hi [~asuresh] OK, I think I was talking about the

[jira] [Created] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-7841: Summary: Cleanup AllocationFileLoaderService's reloadAllocations method Key: YARN-7841 URL: https://issues.apache.org/jira/browse/YARN-7841 Project: Hadoop YARN

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343108#comment-16343108 ] Weiwei Yang commented on YARN-7822: --- Thanks [~asuresh] {quote}Maybe instead of stating in the doc that

[jira] [Commented] (YARN-7820) Fix the currentAppAttemptId error in AHS when an application is running

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343113#comment-16343113 ] genericqa commented on YARN-7820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7698) A misleading variable's name in ApplicationAttemptEventDispatcher

2018-01-29 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343139#comment-16343139 ] Jinjiang Ling commented on YARN-7698: - This patch is just changing two variables' name, so I think the

[jira] [Comment Edited] (YARN-7839) Check node capacity before placing in the Algorithm

2018-01-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343133#comment-16343133 ] Arun Suresh edited comment on YARN-7839 at 1/29/18 9:36 AM: [~cheersyang], bq.

[jira] [Updated] (YARN-7820) Fix the currentAppAttemptId error in AHS when an application is running

2018-01-29 Thread Jinjiang Ling (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinjiang Ling updated YARN-7820: Attachment: YARN-7820.003.patch > Fix the currentAppAttemptId error in AHS when an application is

[jira] [Commented] (YARN-7793) Lots of parsing error reported on nodemanager after activating yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343359#comment-16343359 ] genericqa commented on YARN-7793: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7841: - Attachment: YARN-7841-001.patch > Cleanup AllocationFileLoaderService's reloadAllocations method >

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-29 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343304#comment-16343304 ] Gergo Repas commented on YARN-7796: --- [~Jim_Brennan] I have the same gcc version (gcc version 4.4.7

[jira] [Commented] (YARN-7820) Fix the currentAppAttemptId error in AHS when an application is running

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343341#comment-16343341 ] genericqa commented on YARN-7820: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7793) Lots of parsing error reported on nodemanager after activating yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled

2018-01-29 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated YARN-7793: -- Attachment: YARN-7793.002.patch > Lots of parsing error reported on nodemanager after activating

[jira] [Updated] (YARN-7840) Update PB for prefix support of node attributes

2018-01-29 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-7840: Attachment: YARN-7840-YARN-3409.001.patch > Update PB for prefix support of node attributes

[jira] [Commented] (YARN-3687) We should be able to remove node-label if there's no queue can use it.

2018-01-29 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343236#comment-16343236 ] Manikandan R commented on YARN-3687: [~leftnoteasy] Is this still valid? I was able to remove the label

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343244#comment-16343244 ] genericqa commented on YARN-7822: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-7835: --- Assignee: Rohith Sharma K S > [Atsv2] Race condition in NM while publishing events if

[jira] [Commented] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343519#comment-16343519 ] Hudson commented on YARN-7790: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13575 (See

[jira] [Commented] (YARN-7698) A misleading variable's name in ApplicationAttemptEventDispatcher

2018-01-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343518#comment-16343518 ] Hudson commented on YARN-7698: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13575 (See

[jira] [Updated] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2018-01-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5148: -- Attachment: Screen Shot 2018-01-29 at 9.39.07 PM.png Screen Shot 2018-01-29 at 9.38.53 PM.png >

[jira] [Created] (YARN-7843) Container Localizer is failing with NPE

2018-01-29 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-7843: --- Summary: Container Localizer is failing with NPE Key: YARN-7843 URL: https://issues.apache.org/jira/browse/YARN-7843 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343599#comment-16343599 ] genericqa commented on YARN-7841: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7811) Service AM should use configured default docker network

2018-01-29 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343513#comment-16343513 ] Billie Rinaldi commented on YARN-7811: -- Thanks for taking a look, [~gsaha]. Yes, a list of allowed

[jira] [Commented] (YARN-7842) PB changes to carry node-attributes in NM heartbeat

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343528#comment-16343528 ] genericqa commented on YARN-7842: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343541#comment-16343541 ] genericqa commented on YARN-7835: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2018-01-29 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343552#comment-16343552 ] Manikandan R commented on YARN-7159: [~templedf] Had a chance to look into this? > Normalize unit of

[jira] [Commented] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2018-01-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343560#comment-16343560 ] Sunil G commented on YARN-5148: --- Sure. Thanks [~leftnoteasy]. Attached screen shots with 29th Jan date. We

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-01-29 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343593#comment-16343593 ] Gergo Repas commented on YARN-5028: --- Hi [~templedf] - can I please pick this ticket up? > RMStateStore

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16343449#comment-16343449 ] Weiwei Yang commented on YARN-7822: --- [~asuresh], [~kkaranasos], how about v4 patch looks to you?  >

[jira] [Commented] (YARN-7528) Resource types that use units need to be defined at RM level and NM level or when using small units you will overflow max_allocation calculation

2018-01-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344290#comment-16344290 ] Daniel Templeton commented on YARN-7528: Sorry it took me a while to respond.  Did you try

[jira] [Commented] (YARN-7811) Service AM should use configured default docker network

2018-01-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344318#comment-16344318 ] Eric Yang commented on YARN-7811: - +1 This patch works on my cluster.  I will commit this tomorrow if no

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization

2018-01-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344214#comment-16344214 ] Jason Lowe commented on YARN-7849: -- Looks like this started failing after YARN-7102. I think the unit

[jira] [Created] (YARN-7850) New UI does not show status for Log Aggregation

2018-01-29 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7850: Summary: New UI does not show status for Log Aggregation Key: YARN-7850 URL: https://issues.apache.org/jira/browse/YARN-7850 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2018-01-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344252#comment-16344252 ] Daniel Templeton commented on YARN-7556: During my break I realized that I need to make sure that

[jira] [Assigned] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization

2018-01-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang reassigned YARN-7849: -- Assignee: Botong Huang > TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization >

[jira] [Created] (YARN-7853) SLS failed to startup due to java.lang.NoClassDefFoundError

2018-01-29 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-7853: -- Summary: SLS failed to startup due to java.lang.NoClassDefFoundError Key: YARN-7853 URL: https://issues.apache.org/jira/browse/YARN-7853 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7853) SLS failed to startup due to java.lang.NoClassDefFoundError

2018-01-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344393#comment-16344393 ] Rohith Sharma K S commented on YARN-7853: - It is dup of YARN-7794. > SLS failed to startup due to

[jira] [Commented] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344394#comment-16344394 ] Wangda Tan commented on YARN-7790: -- Thanks [~sunilg] , it's better to commit to branch-2.9 s well. >

[jira] [Updated] (YARN-7842) PB changes to carry node-attributes in NM heartbeat

2018-01-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7842: -- Attachment: YARN-7842-YARN-3409.002.patch > PB changes to carry node-attributes in NM heartbeat >

[jira] [Created] (YARN-7851) Graph view does not show all AM attempts

2018-01-29 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7851: Summary: Graph view does not show all AM attempts Key: YARN-7851 URL: https://issues.apache.org/jira/browse/YARN-7851 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7851) Graph view does not show all AM attempts

2018-01-29 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-7851: - Description: Scenario: 1) Run an application where all AM attempt fails 2) Go to Graph view for

[jira] [Updated] (YARN-7852) FlowRunReader constructs min_start_time filter for both createdtimestart and createdtimeend.

2018-01-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7852: - Description: {code:java} protected FilterList constructFilterListBasedOnFilters() throws IOException {    

[jira] [Updated] (YARN-7852) FlowRunReader constructs min_start_time filter for both createdtimestart and createdtimeend.

2018-01-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7852: - Issue Type: Sub-task (was: Bug) Parent: YARN-7055 > FlowRunReader constructs min_start_time

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-29 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16344367#comment-16344367 ] Rohith Sharma K S commented on YARN-7835: - [~haibochen] As per the design

[jira] [Created] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization

2018-01-29 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7849: Summary: TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization Key: YARN-7849 URL: https://issues.apache.org/jira/browse/YARN-7849 Project: Hadoop YARN

  1   2   >