[jira] [Commented] (YARN-5714) ContainerExecutor does not order environment map

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350359#comment-16350359 ] Jason Lowe commented on YARN-5714: -- On second thought, it's extremely unlikely that NM whitelist variables

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350372#comment-16350372 ] Weiwei Yang commented on YARN-7838: --- Hello [~asuresh] Today I spent a few hours working on this one, to

[jira] [Updated] (YARN-7880) FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls

2018-02-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Description: {code} 18/02/02 20:54:28 INFO rmcontainer.RMContainerImpl:

[jira] [Created] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7879: - Summary: NM user is unable to access the application filecache due to permissions Key: YARN-7879 URL: https://issues.apache.org/jira/browse/YARN-7879 Project: Hadoop YARN

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350496#comment-16350496 ] Panagiotis Garefalakis commented on YARN-7839: --   Submitting a simple patch tracking

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350349#comment-16350349 ] genericqa commented on YARN-5028: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7839: - Description: Currently, the Algorithm assigns a node to a request purely based on

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-02 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350368#comment-16350368 ] Billie Rinaldi commented on YARN-7677: -- That sounds like a good approach, NM vars followed by

[jira] [Updated] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-02-02 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-5028: -- Attachment: YARN-5028.001.patch > RMStateStore should trim down app state for completed applications >

[jira] [Updated] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7838: -- Attachment: YARN-7838.prelim.patch > Support AND/OR constraints in Distributed Shell >

[jira] [Created] (YARN-7880) FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls

2018-02-02 Thread Jiandan Yang (JIRA)
Jiandan Yang created YARN-7880: --- Summary: FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls Key: YARN-7880 URL: https://issues.apache.org/jira/browse/YARN-7880 Project:

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350424#comment-16350424 ] Shane Kumpf commented on YARN-7815: --- Attached a patch that implements the proposal. Given I had to touch

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350353#comment-16350353 ] Jason Lowe commented on YARN-7677: -- I realize now that the theoretical example cannot work in practice.

[jira] [Assigned] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis reassigned YARN-7839: Assignee: Panagiotis Garefalakis > Check node capacity before placing in

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-02-02 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350500#comment-16350500 ] Jim Brennan commented on YARN-7677: --- Thanks everyone! I will work on a new patch using this approach.

[jira] [Updated] (YARN-7880) FiCaSchedulerApp.commonCheckContainerAllocation throws NPE when running sls

2018-02-02 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7880: Description: {code} 18/02/02 20:54:28 INFO rmcontainer.RMContainerImpl:

[jira] [Updated] (YARN-7876) Localized jars that are expanded during localization are not fully copied

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7876: - Affects Version/s: 3.1.0 Target Version/s: 3.1.0 Priority: Blocker (was: Major)

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350340#comment-16350340 ] Shane Kumpf commented on YARN-6456: --- [~miklos.szeg...@cloudera.com] - I believe YARN-7815 will address #1

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350375#comment-16350375 ] Shane Kumpf commented on YARN-7815: --- The localization issue appears to be unrelated. I see the same

[jira] [Assigned] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7879: Assignee: Jason Lowe Affects Version/s: 3.1.0 Priority: Critical (was:

[jira] [Updated] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7839: - Attachment: YARN-7839-YARN-6592.001.patch > Check node capacity before placing in

[jira] [Comment Edited] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350496#comment-16350496 ] Panagiotis Garefalakis edited comment on YARN-7839 at 2/2/18 3:13 PM: --

[jira] [Updated] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-02 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7838: -- Description: Extending DS placement spec syntax to support AND/OR constraints, something like {code} //

[jira] [Updated] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7815: -- Attachment: YARN-7815.001.patch > Mount the filecache as read-only in Docker containers >

[jira] [Commented] (YARN-7850) New UI does not show status for Log Aggregation

2018-02-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350625#comment-16350625 ] Gergely Novák commented on YARN-7850: - Created 

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350731#comment-16350731 ] Arun Suresh commented on YARN-7839: --- [~sunilg], regarding the {{CandidateNodeSet}}, lets move the

[jira] [Updated] (YARN-7876) Localized jars that are expanded during localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7876: - Attachment: YARN-7876.001.patch > Localized jars that are expanded during localization are not

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350762#comment-16350762 ] Miklos Szegedi commented on YARN-7876: -- Thank you [~grepas] for the review and [~jlowe] for updating

[jira] [Comment Edited] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350762#comment-16350762 ] Miklos Szegedi edited comment on YARN-7876 at 2/2/18 6:19 PM: -- Thank you

[jira] [Updated] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7879: - Attachment: YARN-7879.001.patch > NM user is unable to access the application filecache due to permissions

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350628#comment-16350628 ] Jason Lowe commented on YARN-7879: -- I also manually tested the patch on a secure cluster and verified

[jira] [Commented] (YARN-7850) New UI does not show status for Log Aggregation

2018-02-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350635#comment-16350635 ] Sunil G commented on YARN-7850: --- [~GergelyNovak] Change looks fine to me. One dbt, when log aggregation is

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350656#comment-16350656 ] Sunil G commented on YARN-7839: --- bq.despite the naming, as far as I know, the candidateNodeSet is currently

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350781#comment-16350781 ] Miklos Szegedi commented on YARN-7857: -- Thank you, [~Jim_Brennan] for the patch. I am a little bit

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350701#comment-16350701 ] genericqa commented on YARN-5028: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350775#comment-16350775 ] Eric Yang commented on YARN-7879: - Are we conformable in assuming all files in filecache are world

[jira] [Resolved] (YARN-7832) Logs page does not work for Running applications

2018-02-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7832. --- Resolution: Not A Problem Thanks [~yeshavora] for confirming, This is working fine with Combine System Metric

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350564#comment-16350564 ] Jason Lowe commented on YARN-7879: -- This was caused by YARN-2185. That change locked down the top-level

[jira] [Updated] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7876: - Summary: Localized jars that are expanded after localization are not fully copied (was: Localized

[jira] [Updated] (YARN-7839) Modify PlacementAlgorithm to Check node capacity before placing request on node

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7839: -- Summary: Modify PlacementAlgorithm to Check node capacity before placing request on node (was: Check

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350571#comment-16350571 ] genericqa commented on YARN-7815: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7866) [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350610#comment-16350610 ] genericqa commented on YARN-7866: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350732#comment-16350732 ] Arun Suresh commented on YARN-7839: --- Thanks for the patch [~pgaref] It looks pretty straight forward to

[jira] [Updated] (YARN-7881) Add Log Aggregation Status API to the RM Webservice

2018-02-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-7881: Attachment: YARN-7881.001.patch > Add Log Aggregation Status API to the RM Webservice >

[jira] [Commented] (YARN-7868) Provide improved error message when YARN service is disabled

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350632#comment-16350632 ] Eric Yang commented on YARN-7868: - [~csingh] Thank you for reviewing the patch. [~jianhe] Thanks for the

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350648#comment-16350648 ] genericqa commented on YARN-7879: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7839) Check node capacity before placing in the Algorithm

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350649#comment-16350649 ] genericqa commented on YARN-7839: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7881) Add Log Aggregation Status API to the RM Webservice

2018-02-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-7881: Description: The old YARN UI has a page:  /cluster/logaggregationstatus/\{app_id} which shows the log

[jira] [Created] (YARN-7881) Add Log Aggregation Status API to the RM Webservice

2018-02-02 Thread JIRA
Gergely Novák created YARN-7881: --- Summary: Add Log Aggregation Status API to the RM Webservice Key: YARN-7881 URL: https://issues.apache.org/jira/browse/YARN-7881 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7850) New UI does not show status for Log Aggregation

2018-02-02 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350642#comment-16350642 ] Gergely Novák commented on YARN-7850: - We show it with the default style (grey). > New UI does not

[jira] [Updated] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7791: -- Environment: (was: Set {{yarn.resourcemanager.placement-constraints.enabled}} to {{false}} Submit a

[jira] [Updated] (YARN-7732) Support Generic AM Simulator from SynthGenerator

2018-02-02 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Young Chen updated YARN-7732: - Attachment: YARN-7732.04.patch > Support Generic AM Simulator from SynthGenerator >

[jira] [Commented] (YARN-7868) Provide improved error message when YARN service is disabled

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350851#comment-16350851 ] Eric Yang commented on YARN-7868: - [~jianhe] Thank you for the commit. > Provide improved error message

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350787#comment-16350787 ] Miklos Szegedi commented on YARN-6456: -- Sure, I made it as a subtask. Are you referring to #3 as this?

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350794#comment-16350794 ] Jason Lowe commented on YARN-7879: -- bq. Are we conformable in assuming all files in filecache are world

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350831#comment-16350831 ] Yufei Gu commented on YARN-7655: The patch looks good to me generally. Only some nits: # Add Java doc to

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350974#comment-16350974 ] Vinod Kumar Vavilapalli commented on YARN-7572: --- This is a generally better presentation than

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-02-02 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350873#comment-16350873 ] Zian Chen commented on YARN-7626: - Update patch 006 per Miklos's suggestions. [~leftnoteasy] ,[~sunilg] ,

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350942#comment-16350942 ] Miklos Szegedi commented on YARN-6456: -- Sure, I would keep the description just for context but let

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350981#comment-16350981 ] Eric Yang commented on YARN-7879: - [~jlowe] Thank you for the reply. We are allowing file cache to be

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-02 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350798#comment-16350798 ] Arun Suresh commented on YARN-7838: --- Thanks for taking a stab at this [~cheersyang]. Yup, I agree we

[jira] [Commented] (YARN-7732) Support Generic AM Simulator from SynthGenerator

2018-02-02 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350853#comment-16350853 ] Young Chen commented on YARN-7732: -- Added back compatibility with JobStory and JobStoryProducer interfaces

[jira] [Commented] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350904#comment-16350904 ] Shane Kumpf commented on YARN-6456: --- Thanks [~miklos.szeg...@cloudera.com]. {quote}Are you referring to

[jira] [Updated] (YARN-7720) Race condition between second app attempt and UAM timeout when first attempt node is down

2018-02-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7720: --- Summary: Race condition between second app attempt and UAM timeout when first attempt node is down

[jira] [Updated] (YARN-6456) Isolation of Docker containers In LinuxContainerExecutor

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6456: - Issue Type: Sub-task (was: Bug) Parent: YARN-3611 > Isolation of Docker containers In

[jira] [Created] (YARN-7882) Server side proxy for UI2 log viewer

2018-02-02 Thread Eric Yang (JIRA)
Eric Yang created YARN-7882: --- Summary: Server side proxy for UI2 log viewer Key: YARN-7882 URL: https://issues.apache.org/jira/browse/YARN-7882 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350938#comment-16350938 ] Chandni Singh commented on YARN-7572: -  Do we want something like this? Due to space constraints the

[jira] [Commented] (YARN-7881) Add Log Aggregation Status API to the RM Webservice

2018-02-02 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350954#comment-16350954 ] Giovanni Matteo Fumarola commented on YARN-7881: Thanks [~GergelyNovak] for the patch. Can

[jira] [Comment Edited] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350938#comment-16350938 ] Chandni Singh edited comment on YARN-7572 at 2/2/18 9:37 PM: -  Do we want

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350895#comment-16350895 ] Robert Kanter commented on YARN-7876: - +1 LGTM pending Jenkins Thanks for adding the directory to the

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350994#comment-16350994 ] Eric Yang commented on YARN-7572: - Num Container, State and Lifetime on the Service line seems to have

[jira] [Assigned] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7889: --- Assignee: Eric Yang > Missing kerberos token when check for RM REST API availability >

[jira] [Commented] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351267#comment-16351267 ] Miklos Szegedi commented on YARN-6739: -- Thank you, [~haibochen] for the patch. {code:java} void

[jira] [Updated] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7889: Attachment: YARN-7889.001.patch > Missing kerberos token when check for RM REST API availability >

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351213#comment-16351213 ] genericqa commented on YARN-7876: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350832#comment-16350832 ] Jason Lowe commented on YARN-7876: -- Right, thanks for clarifying the title further. +1 lgtm pending

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-02 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16350833#comment-16350833 ] Jim Brennan commented on YARN-7857: --- Thanks [~miklos.szeg...@cloudera.com]! That is a good suggestion. I

[jira] [Updated] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-02-02 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7626: Attachment: YARN-7626.006.patch > Allow regular expression matching in container-executor.cfg for devices

[jira] [Created] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-02 Thread Eric Yang (JIRA)
Eric Yang created YARN-7889: --- Summary: Missing kerberos token when check for RM REST API availability Key: YARN-7889 URL: https://issues.apache.org/jira/browse/YARN-7889 Project: Hadoop YARN

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351059#comment-16351059 ] Jason Lowe commented on YARN-7879: -- bq. We are allowing file cache to be mounted in docker container as

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351083#comment-16351083 ] Eric Yang commented on YARN-7879: - {quote} The only way I can see it being an issue specific to Docker is

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-02-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351084#comment-16351084 ] Botong Huang commented on YARN-7849: Hi Jason, A gentle reminder about this thread. I realize I didn't

[jira] [Issue Comment Deleted] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-02-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7849: --- Comment: was deleted (was: Hi Jason, A gentle reminder about this thread. I realize I didn't @ you in

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-02 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351184#comment-16351184 ] genericqa commented on YARN-7655: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7888) container-log4j.properties is in hadoop-yarn-node-manager.jar

2018-02-02 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7888: Summary: container-log4j.properties is in hadoop-yarn-node-manager.jar Key: YARN-7888 URL: https://issues.apache.org/jira/browse/YARN-7888 Project: Hadoop YARN

[jira] [Updated] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6456: -- Description:   With LCE, there are multiple ContainerRuntimes available for handling different types

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351035#comment-16351035 ] Chandni Singh commented on YARN-7572: - [~vinodkv] I don't think we currently have any command that

[jira] [Created] (YARN-7883) Make HAR tool support IndexedLogAggregtionController

2018-02-02 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-7883: --- Summary: Make HAR tool support IndexedLogAggregtionController Key: YARN-7883 URL: https://issues.apache.org/jira/browse/YARN-7883 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7883) Make HAR tool support IndexedLogAggregtionController

2018-02-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351050#comment-16351050 ] Xuan Gong commented on YARN-7883: - Created a MapReduce ticket to track the work progress. Close this one

[jira] [Resolved] (YARN-7883) Make HAR tool support IndexedLogAggregtionController

2018-02-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong resolved YARN-7883. - Resolution: Duplicate > Make HAR tool support IndexedLogAggregtionController >

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351061#comment-16351061 ] Miklos Szegedi commented on YARN-7879: -- Thank you, [~shaneku...@gmail.com] for the report, [~jlowe]

[jira] [Created] (YARN-7885) [GQ] Generator for queue hierarchies over federated clusters

2018-02-02 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-7885: Summary: [GQ] Generator for queue hierarchies over federated clusters Key: YARN-7885 URL: https://issues.apache.org/jira/browse/YARN-7885 Project:

[jira] [Created] (YARN-7887) SchedulingMonitor#PolicyInvoker catches all throwables

2018-02-02 Thread Young Chen (JIRA)
Young Chen created YARN-7887: Summary: SchedulingMonitor#PolicyInvoker catches all throwables Key: YARN-7887 URL: https://issues.apache.org/jira/browse/YARN-7887 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351162#comment-16351162 ] Yufei Gu commented on YARN-7859: I kind of understand the issue. Here is an example, please let me know if

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351171#comment-16351171 ] Hudson commented on YARN-7879: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13610 (See

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351028#comment-16351028 ] Vinod Kumar Vavilapalli commented on YARN-7572: --- [~eyang], see my first comment. I'm

[jira] [Created] (YARN-7884) Race condition in registering YARN service in ZooKeeper

2018-02-02 Thread Eric Yang (JIRA)
Eric Yang created YARN-7884: --- Summary: Race condition in registering YARN service in ZooKeeper Key: YARN-7884 URL: https://issues.apache.org/jira/browse/YARN-7884 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7879) NM user is unable to access the application filecache due to permissions

2018-02-02 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351065#comment-16351065 ] Shane Kumpf commented on YARN-7879: --- Thanks for the patch [~jlowe] - I've tested the patch and it fixes

[jira] [Commented] (YARN-7868) Provide improved error message when YARN service is disabled

2018-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351105#comment-16351105 ] Hudson commented on YARN-7868: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13608 (See

[jira] [Commented] (YARN-7839) Modify PlacementAlgorithm to Check node capacity before placing request on node

2018-02-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16351104#comment-16351104 ] Hudson commented on YARN-7839: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13608 (See

  1   2   >