[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112271#comment-16112271 ] Varun Vasudev commented on YARN-6623: - Just to note - we should document this in the release notes

[jira] [Commented] (YARN-6727) Improve getQueueUserAcls API to query for specific queue and user

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112277#comment-16112277 ] Hadoop QA commented on YARN-6727: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: YARN-6130-6d72ddab0a3b564e2396ec5101463b5794f1e148.01.patch > [ATSv2 Security] Generate a

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112281#comment-16112281 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6033) Add support for sections in container-executor configuration file

2017-08-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112257#comment-16112257 ] Varun Vasudev commented on YARN-6033: - {quote} How about the name? I think we should should call trim

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: (was: YARN-6130-6d72ddab0a3b564e2396ec5101463b5794f1e148.01.patch) > [ATSv2 Security]

[jira] [Commented] (YARN-4081) Add support for multiple resource types in the Resource class

2017-08-03 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112305#comment-16112305 ] Varun Vasudev commented on YARN-4081: - The reason I added units was primarily to allow the NMs, the RMs

[jira] [Updated] (YARN-6937) Admin cannot post entities when domain is not exists

2017-08-03 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6937: -- Description: When I post entities to timeline server, and found that it throw the following exception:

[jira] [Updated] (YARN-5977) ContainerManagementProtocol changes to support change of container ExecutionType

2017-08-03 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated YARN-5977: Attachment: (was: YARN-5977.005.patch) > ContainerManagementProtocol changes to support

[jira] [Updated] (YARN-5977) ContainerManagementProtocol changes to support change of container ExecutionType

2017-08-03 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated YARN-5977: Attachment: YARN-5977.005.patch > ContainerManagementProtocol changes to support change of

[jira] [Commented] (YARN-6727) Improve getQueueUserAcls API to query for specific queue and user

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112420#comment-16112420 ] Hadoop QA commented on YARN-6727: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112436#comment-16112436 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6937) Admin cannot post entities when domain is not exists

2017-08-03 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-6937: - Summary: Admin cannot post entities when domain is not exists Key: YARN-6937 URL: https://issues.apache.org/jira/browse/YARN-6937 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-6939) Upgrade JUnit from 4 to 5 in hadoop-yarn

2017-08-03 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created YARN-6939: --- Summary: Upgrade JUnit from 4 to 5 in hadoop-yarn Key: YARN-6939 URL: https://issues.apache.org/jira/browse/YARN-6939 Project: Hadoop YARN Issue Type: Test

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112448#comment-16112448 ] Varun Saxena commented on YARN-6130: The build is failing because Oracle JDK 7 is not installed on

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-03 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112236#comment-16112236 ] Rohith Sharma K S commented on YARN-6820: - Apologies for pitching in late for discussion. From last

[jira] [Commented] (YARN-6133) [ATSv2 Security] Renew delegation token for app automatically if an app collector is active

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112273#comment-16112273 ] Hadoop QA commented on YARN-6133: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6916) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-08-03 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112300#comment-16112300 ] Akira Ajisaka commented on YARN-6916: - Thanks [~bibinchundatt] for the review. bq. Any plan to modify

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112310#comment-16112310 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6937) Admin cannot post entities when domain is not exists

2017-08-03 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6937: -- Description: When I post entities to timeline server, and found that it throw the following exception:

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: YARN-6130-YARN-5355_branch2.01.patch > [ATSv2 Security] Generate a delegation token for AM

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: (was: YARN-6130-YARN-5355-branch-2.01.patch) > [ATSv2 Security] Generate a delegation

[jira] [Created] (YARN-6938) Add a flag to indicate whether timeline server acl enabled

2017-08-03 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-6938: - Summary: Add a flag to indicate whether timeline server acl enabled Key: YARN-6938 URL: https://issues.apache.org/jira/browse/YARN-6938 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112438#comment-16112438 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112444#comment-16112444 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112443#comment-16112443 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-08-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.022.patch Thanks [~templedf] Updating new patch. Addressed comments as

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-08-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.022.patch Thanks [~templedf] Updating new patch. Addressed comments as

[jira] [Assigned] (YARN-3989) Show messages only for NodeLabel commmands in RMAdminCLI

2017-08-03 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt reassigned YARN-3989: -- Assignee: (was: Bibin A Chundatt) > Show messages only for NodeLabel commmands in

[jira] [Commented] (YARN-6894) RM Apps API returns only active apps when query parameter queue used

2017-08-03 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112522#comment-16112522 ] Gergely Novák commented on YARN-6894: - Check YARN-807: it changed the implementation from what I

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112815#comment-16112815 ] Jason Lowe commented on YARN-6820: -- As I understand things from [this

[jira] [Commented] (YARN-6133) [ATSv2 Security] Renew delegation token for app automatically if an app collector is active

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112822#comment-16112822 ] Hadoop QA commented on YARN-6133: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-08-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112970#comment-16112970 ] Shane Kumpf commented on YARN-5534: --- >From a usability stand point, I have to agree with

[jira] [Commented] (YARN-6940) Enable Container Resize testcase for FairScheduler

2017-08-03 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113038#comment-16113038 ] Daniel Templeton commented on YARN-6940: Two initial questions: # I don't see anything in the tests

[jira] [Updated] (YARN-6133) [ATSv2 Security] Renew delegation token for app automatically if an app collector is active

2017-08-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6133: --- Attachment: YARN-6133-YARN-5355.03.patch > [ATSv2 Security] Renew delegation token for app

[jira] [Commented] (YARN-6678) Handle IllegalStateException in Async Scheduling mode of CapacityScheduler

2017-08-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112805#comment-16112805 ] Hudson commented on YARN-6678: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12109 (See

[jira] [Commented] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

2017-08-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112850#comment-16112850 ] Jason Lowe commented on YARN-6901: -- Yep, that sounds good to me. > A CapacityScheduler app->LeafQueue

[jira] [Created] (YARN-6941) Allow Queue placement policies to be ordered by attribute

2017-08-03 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6941: -- Summary: Allow Queue placement policies to be ordered by attribute Key: YARN-6941 URL: https://issues.apache.org/jira/browse/YARN-6941 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112769#comment-16112769 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6811) [ATS1.5] All history logs should be kept under its own User Directory.

2017-08-03 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6811: Attachment: YARN-6811.02.patch Updated the patch fixing review comments > [ATS1.5] All

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-08-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112863#comment-16112863 ] Shane Kumpf commented on YARN-6726: --- /cc [~sunilg], [~chris.douglas], [~vvasudev] - any feedback here?

[jira] [Commented] (YARN-6940) Enable Container Resize testcase for FairScheduler

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113011#comment-16113011 ] Hadoop QA commented on YARN-6940: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-6917) Queue path is recomputed from scratch on every allocation

2017-08-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reassigned YARN-6917: Assignee: Eric Payne > Queue path is recomputed from scratch on every allocation >

[jira] [Commented] (YARN-6932) Fix TestFederationRMFailoverProxyProvider test case

2017-08-03 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112817#comment-16112817 ] Botong Huang commented on YARN-6932: Thanks [~subru] for the patch. I've investigated a bit, it is

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113001#comment-16113001 ] Shane Kumpf commented on YARN-6930: --- Thanks [~miklos.szeg...@cloudera.com] for pointing that out. It

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2017-08-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112846#comment-16112846 ] Jason Lowe commented on YARN-6929: -- The timestamp in the application ID is the cluster start timestamp

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-08-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112855#comment-16112855 ] Sunil G commented on YARN-4161: --- Extremely sorry for sharing a quick doubt last moment here.

[jira] [Commented] (YARN-6932) Fix TestFederationRMFailoverProxyProvider test case

2017-08-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112793#comment-16112793 ] Arun Suresh commented on YARN-6932: --- +1. Thanks subru > Fix TestFederationRMFailoverProxyProvider test

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-08-03 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113051#comment-16113051 ] Daniel Templeton commented on YARN-6788: Thanks, [~sunilg]. LGTM. +1 Shall I commit it, or would

[jira] [Commented] (YARN-6940) Enable Container Resize testcase for FairScheduler

2017-08-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113058#comment-16113058 ] Arun Suresh commented on YARN-6940: --- bq. don't see anything in the tests that looks like it enables

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113089#comment-16113089 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6942) Add examples for placement constraints usage in applications

2017-08-03 Thread Konstantinos Karanasos (JIRA)
Konstantinos Karanasos created YARN-6942: Summary: Add examples for placement constraints usage in applications Key: YARN-6942 URL: https://issues.apache.org/jira/browse/YARN-6942 Project:

[jira] [Commented] (YARN-6940) Enable Container Resize testcase for FairScheduler

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113284#comment-16113284 ] Hadoop QA commented on YARN-6940: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5304) Ship single node HBase config option with single startup command

2017-08-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5304: - Labels: YARN-5355 yarn-5355-atsv2-blocker (was: YARN-5355 yarn-5355-atsv2-blocker

[jira] [Commented] (YARN-6133) [ATSv2 Security] Renew delegation token for app automatically if an app collector is active

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113108#comment-16113108 ] Hadoop QA commented on YARN-6133: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5304) Ship single node HBase config option with single startup command

2017-08-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5304: - Labels: YARN-5355 yarn-5355-atsv2-blocker yarn-5355-merge-blocker (was: YARN-5355

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-03 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113170#comment-16113170 ] Shane Kumpf commented on YARN-6930: --- Thanks [~miklos.szeg...@cloudera.com] - I did notice how it is being

[jira] [Commented] (YARN-6811) [ATS1.5] All history logs should be kept under its own User Directory.

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113181#comment-16113181 ] Hadoop QA commented on YARN-6811: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-08-03 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113123#comment-16113123 ] Wei Yan commented on YARN-4161: --- Yes, here we introduce one more condition check. But by default, the new

[jira] [Updated] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2017-08-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-6929: Description: The current directory structure for yarn.nodemanager.remote-app-log-dir is not

[jira] [Commented] (YARN-6505) Define the strings used in SLS JSON input file format

2017-08-03 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113142#comment-16113142 ] Carlo Curino commented on YARN-6505: Sorry I tune in only now... I don't like talking in term of

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-08-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113155#comment-16113155 ] Sunil G commented on YARN-4161: --- Thanks [~ywskycn] That clarifies my doubt.. multiple-assignments-enabled is

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2017-08-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113198#comment-16113198 ] Jason Lowe commented on YARN-6929: -- bq. Hoping 1 hour will have less than millions of apps I think the

[jira] [Updated] (YARN-5977) ContainerManagementProtocol changes to support change of container ExecutionType

2017-08-03 Thread kartheek muthyala (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kartheek muthyala updated YARN-5977: Attachment: YARN-5977.006.patch > ContainerManagementProtocol changes to support change of

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2017-08-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113219#comment-16113219 ] Sunil G commented on YARN-6492: --- Thanks for working on this patch. Few thoughts {code}

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-03 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-002.patch > ZooKeeper based implementation of the FederationStateStore >

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-03 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: (was: YARN-6900-002.patch) > ZooKeeper based implementation of the FederationStateStore

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-03 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: (was: YARN-6900-002.patch) > ZooKeeper based implementation of the FederationStateStore

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

2017-08-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113179#comment-16113179 ] Hudson commented on YARN-6673: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12110 (See

[jira] [Commented] (YARN-6674) Add memory cgroup settings for opportunistic containers

2017-08-03 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113178#comment-16113178 ] Hudson commented on YARN-6674: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12110 (See

[jira] [Commented] (YARN-6920) Fix TestNMClient failure due to YARN-6706

2017-08-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113188#comment-16113188 ] Arun Suresh commented on YARN-6920: --- {{TestFederationRMFailoverProxyProvider}} failure has been tracked

[jira] [Commented] (YARN-6871) Add additional deSelects params in getAppReport

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113213#comment-16113213 ] Hadoop QA commented on YARN-6871: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-08-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113231#comment-16113231 ] Miklos Szegedi commented on YARN-5534: -- [~ebadger], only the ones that need root access. > Allow

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2017-08-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113232#comment-16113232 ] Prabhu Joseph commented on YARN-6929: - Yes got it. I think Max Bucket Size can be derived from

[jira] [Commented] (YARN-6674) Add memory cgroup settings for opportunistic containers

2017-08-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113069#comment-16113069 ] Haibo Chen commented on YARN-6674: -- Checking in this. > Add memory cgroup settings for opportunistic

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-08-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113114#comment-16113114 ] Miklos Szegedi commented on YARN-5534: -- Thank you, [~shaneku...@gmail.com] and [~vinodkv] for the

[jira] [Commented] (YARN-5977) ContainerManagementProtocol changes to support change of container ExecutionType

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113146#comment-16113146 ] Hadoop QA commented on YARN-5977: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-03 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-002.patch > ZooKeeper based implementation of the FederationStateStore >

[jira] [Commented] (YARN-6929) yarn.nodemanager.remote-app-log-dir structure is not scalable

2017-08-03 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113176#comment-16113176 ] Prabhu Joseph commented on YARN-6929: - Thanks, missed it. Hash can be generated from

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-08-03 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113194#comment-16113194 ] Sunil G commented on YARN-6788: --- Thanks [~templedf] By some mistake, v22 patch got attached twice. And its

[jira] [Commented] (YARN-5534) Allow whitelisted volume mounts

2017-08-03 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113207#comment-16113207 ] Eric Badger commented on YARN-5534: --- So is the assumption here that yarn-site.xml is untrusted and can be

[jira] [Commented] (YARN-6505) Define the strings used in SLS JSON input file format

2017-08-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113102#comment-16113102 ] Yufei Gu commented on YARN-6505: Thanks for new patch. My thought is the benefits of consistency we got

[jira] [Commented] (YARN-6133) [ATSv2 Security] Renew delegation token for app automatically if an app collector is active

2017-08-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113168#comment-16113168 ] Hadoop QA commented on YARN-6133: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-03 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-002.patch * Rebase to trunk * Refactored ZK utils > ZooKeeper based

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-08-03 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113268#comment-16113268 ] Konstantinos Karanasos commented on YARN-6594: -- I see the use case for container upgrades,

[jira] [Commented] (YARN-6832) Tests use assertTrue(....equals(...)) instead of assertEquals()

2017-08-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113270#comment-16113270 ] Yufei Gu commented on YARN-6832: Thanks for the patch, [~templedf]. Thanks for the review [~maya].

[jira] [Comment Edited] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113095#comment-16113095 ] Miklos Szegedi edited comment on YARN-6930 at 8/3/17 5:06 PM: -- The disable

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-08-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113095#comment-16113095 ] Miklos Szegedi commented on YARN-6930: -- The disable config is actually smart enough to set the mode in

[jira] [Comment Edited] (YARN-5534) Allow whitelisted volume mounts

2017-08-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113114#comment-16113114 ] Miklos Szegedi edited comment on YARN-5534 at 8/3/17 5:18 PM: -- Thank you,

[jira] [Commented] (YARN-4081) Add support for multiple resource types in the Resource class

2017-08-03 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113120#comment-16113120 ] Daniel Templeton commented on YARN-4081: Got it. Makes sense. Thanks. > Add support for multiple

[jira] [Commented] (YARN-6832) Tests use assertTrue(....equals(...)) instead of assertEquals()

2017-08-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113248#comment-16113248 ] Yufei Gu commented on YARN-6832: +1 > Tests use assertTrue(equals(...)) instead of assertEquals() >

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-08-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113337#comment-16113337 ] Miklos Szegedi commented on YARN-6668: -- Thanks for the review [~haibo.chen]. 3)

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-08-03 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113362#comment-16113362 ] Daniel Templeton commented on YARN-6788: I'll wait for Jenkins. I did just notice one more little

[jira] [Updated] (YARN-6832) Tests use assertTrue(....equals(...)) instead of assertEquals()

2017-08-03 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6832: --- Attachment: YARN-6832.branch-2.001.patch Here's a branch-2 patch. > Tests use

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-08-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113489#comment-16113489 ] Wangda Tan commented on YARN-6593: -- [~kkaranasos], you were asking this question in good time, I'm

[jira] [Created] (YARN-6943) Update Yarn to YARN in documentation

2017-08-03 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6943: Summary: Update Yarn to YARN in documentation Key: YARN-6943 URL: https://issues.apache.org/jira/browse/YARN-6943 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-08-03 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113509#comment-16113509 ] Varun Saxena commented on YARN-6130: Pulled in HADOOP-14474 into YARN-5355_branch2. The build should be

[jira] [Commented] (YARN-6811) [ATS1.5] All history logs should be kept under its own User Directory.

2017-08-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113524#comment-16113524 ] Junping Du commented on YARN-6811: -- Thanks for updating the patch and addressing my comments,

[jira] [Commented] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-08-03 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113525#comment-16113525 ] Daniel Templeton commented on YARN-6757: LGTM. +1 > Refactor the usage of >

[jira] [Commented] (YARN-6920) Fix TestNMClient failure due to YARN-6706

2017-08-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113296#comment-16113296 ] Haibo Chen commented on YARN-6920: -- Hmm.. It still does not fix TestNMClient for me. Is this the same

  1   2   >