[jira] [Commented] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2016-11-07 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646831#comment-15646831 ] Kai Sasaki commented on YARN-5148: -- [~sunilg] Thanks. I'll update as you said. > [YARN-3368] Add page to

[jira] [Updated] (YARN-4329) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in Fair Scheduler

2016-11-07 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4329: --- Attachment: YARN-4329.005.patch Thanks [~templedf] for the review. I've rebased and uploaded a new patch. >

[jira] [Created] (YARN-5854) Throw more accurate exceptions from LinuxContainerExecutor#init

2016-11-07 Thread Zhe Zhang (JIRA)
Zhe Zhang created YARN-5854: --- Summary: Throw more accurate exceptions from LinuxContainerExecutor#init Key: YARN-5854 URL: https://issues.apache.org/jira/browse/YARN-5854 Project: Hadoop YARN

[jira] [Updated] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4597: -- Attachment: YARN-4597.007.patch Updating patch to fix some rebasing errors. [~jianhe], I tried to reuse

[jira] [Commented] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2016-11-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646763#comment-15646763 ] Sunil G commented on YARN-5148: --- [~lewuathe]. Thank you very much for updated patch. We are mostly there and

[jira] [Commented] (YARN-5377) Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers

2016-11-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646700#comment-15646700 ] Hudson commented on YARN-5377: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10787 (See

[jira] [Comment Edited] (YARN-5846) Improve the fairscheduler attemptScheduler

2016-11-07 Thread zhengchenyu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646638#comment-15646638 ] zhengchenyu edited comment on YARN-5846 at 11/8/16 6:41 AM: Yeah! I thinks my

[jira] [Commented] (YARN-5820) yarn node CLI help should be clearer

2016-11-07 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646654#comment-15646654 ] Grant Sohn commented on YARN-5820: -- [~naganarasimha...@apache.org], by showing the hadoop command usage, I

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646647#comment-15646647 ] Hadoop QA commented on YARN-4597: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5853) TestDelegationTokenRenewer#testRMRestartWithExpiredToken fails intermittently on Power

2016-11-07 Thread Yussuf Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646641#comment-15646641 ] Yussuf Shaikh commented on YARN-5853: - The null value shown in the error is the value of the

[jira] [Commented] (YARN-5853) TestDelegationTokenRenewer#testRMRestartWithExpiredToken fails intermittently on Power

2016-11-07 Thread Yussuf Shaikh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646643#comment-15646643 ] Yussuf Shaikh commented on YARN-5853: - Fix would be to add a wait for the updatedToken to be generated

[jira] [Issue Comment Deleted] (YARN-5846) Improve the fairscheduler attemptScheduler

2016-11-07 Thread zhengchenyu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated YARN-5846: -- Comment: was deleted (was: Yeah! I thinks my suggestion may be a new scheduler. And YARN-5139 is indeed

[jira] [Commented] (YARN-5846) Improve the fairscheduler attemptScheduler

2016-11-07 Thread zhengchenyu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646638#comment-15646638 ] zhengchenyu commented on YARN-5846: --- Yeah! I thinks my suggestion may be a new scheduler. And YARN-5139

[jira] [Commented] (YARN-5846) Improve the fairscheduler attemptScheduler

2016-11-07 Thread zhengchenyu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646635#comment-15646635 ] zhengchenyu commented on YARN-5846: --- Yeah! I thinks my suggestion may be a new scheduler. And YARN-5139

[jira] [Updated] (YARN-5377) Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers

2016-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5377: -- Fix Version/s: 3.0.0-alpha2 > Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers >

[jira] [Updated] (YARN-5377) Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers

2016-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5377: -- Summary: Fix TestQueuingContainerManager.testKillMultipleOpportunisticContainers (was:

[jira] [Updated] (YARN-5669) Add support for Docker pull

2016-11-07 Thread luhuichun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luhuichun updated YARN-5669: Assignee: (was: luhuichun) > Add support for Docker pull > --- > >

[jira] [Created] (YARN-5853) TestDelegationTokenRenewer#testRMRestartWithExpiredToken fails intermittently on Power

2016-11-07 Thread Yussuf Shaikh (JIRA)
Yussuf Shaikh created YARN-5853: --- Summary: TestDelegationTokenRenewer#testRMRestartWithExpiredToken fails intermittently on Power Key: YARN-5853 URL: https://issues.apache.org/jira/browse/YARN-5853

[jira] [Commented] (YARN-5823) Update NMTokens in case of requests with only opportunistic containers

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646591#comment-15646591 ] Hadoop QA commented on YARN-5823: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646541#comment-15646541 ] Karthik Kambatla commented on YARN-5819: [~templedf] - would you like me to post the patch on

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646534#comment-15646534 ] Karthik Kambatla commented on YARN-5819: Thanks for the prompt and thorough first pass,

[jira] [Commented] (YARN-5720) Update document for "rmadmin -replaceLabelOnNode"

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646533#comment-15646533 ] Naganarasimha G R commented on YARN-5720: - Thanks for the contribution [~Tao Jie], have committed

[jira] [Updated] (YARN-4884) Fix missing documentation about rmadmin command regarding node labels

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4884: Fix Version/s: 2.8.0 > Fix missing documentation about rmadmin command regarding node labels

[jira] [Commented] (YARN-4884) Fix missing documentation about rmadmin command regarding node labels

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646529#comment-15646529 ] Naganarasimha G R commented on YARN-4884: - thanks [~vvasudev], cherry picked to branch-2.8 after

[jira] [Updated] (YARN-5819) Verify fairshare and minshare preemption

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5819: --- Attachment: yarn-5819.YARN-4752.2.patch > Verify fairshare and minshare preemption >

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646513#comment-15646513 ] Hadoop QA commented on YARN-5783: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5820) yarn node CLI help should be clearer

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646401#comment-15646401 ] Naganarasimha G R commented on YARN-5820: - Hi [~grant.sohn], Actually to say there are multiple

[jira] [Commented] (YARN-5736) YARN container executor config does not handle white space

2016-11-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646394#comment-15646394 ] Miklos Szegedi commented on YARN-5736: -- The unit test failure is unrelated. It appears to be YARN-5377

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646386#comment-15646386 ] Karthik Kambatla commented on YARN-5783: Fair point. That was actually my initial thought before

[jira] [Updated] (YARN-5783) Verify applications are identified starved

2016-11-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5783: --- Attachment: yarn-5783.YARN-4752.7.patch > Verify applications are identified starved >

[jira] [Updated] (YARN-5823) Update NMTokens in case of requests with only opportunistic containers

2016-11-07 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5823: - Attachment: YARN-5823.003.patch Adding new version of the patch, in which I am

[jira] [Commented] (YARN-5736) YARN container executor config does not handle white space

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646341#comment-15646341 ] Hadoop QA commented on YARN-5736: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2016-11-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646283#comment-15646283 ] Sunil G commented on YARN-5148: --- Yes [~kaisasak]. Its better to rebase to trunk. Apologies for delay here. I

[jira] [Updated] (YARN-5736) YARN container executor config does not handle white space

2016-11-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5736: - Attachment: YARN-5736.002.patch Adding unit test for trim > YARN container executor config does

[jira] [Commented] (YARN-5833) Change default port for AMRMProxy

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646234#comment-15646234 ] Hadoop QA commented on YARN-5833: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient in FSParentQueue.java

2016-11-07 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646181#comment-15646181 ] Xianyin Xin commented on YARN-4090: --- Sorry for the delay [~gsaha]. I attached the new patch based on the

[jira] [Updated] (YARN-4090) Make Collections.sort() more efficient in FSParentQueue.java

2016-11-07 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated YARN-4090: -- Attachment: YARN-4090.003.patch > Make Collections.sort() more efficient in FSParentQueue.java >

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient in FSParentQueue.java

2016-11-07 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646171#comment-15646171 ] Xianyin Xin commented on YARN-4090: --- Sorry for the delay [~He Tianyi]. and that i didn't examine the

[jira] [Commented] (YARN-5833) Change default port for AMRMProxy

2016-11-07 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646117#comment-15646117 ] Subru Krishnan commented on YARN-5833: -- Thanks [~kkaranasos] for the fix, especially the new test! +1

[jira] [Updated] (YARN-5833) Change default port for AMRMProxy

2016-11-07 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5833: - Attachment: YARN-5833.003.patch Attaching new version of the patch in which I

[jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646052#comment-15646052 ] Hadoop QA commented on YARN-5849: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5694) ZKRMStateStore should always start its verification thread to prevent accidental state store corruption

2016-11-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15646047#comment-15646047 ] Jian He commented on YARN-5694: --- One other thing is the normal state-store operation already piggybacks a

[jira] [Created] (YARN-5852) Consolidate CSAssignment, ContainerAllocation, ContainerAllocationContext class in CapacityScheduler

2016-11-07 Thread Jian He (JIRA)
Jian He created YARN-5852: - Summary: Consolidate CSAssignment, ContainerAllocation, ContainerAllocationContext class in CapacityScheduler Key: YARN-5852 URL: https://issues.apache.org/jira/browse/YARN-5852

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645994#comment-15645994 ] Arun Suresh commented on YARN-4597: --- bq. I also think that should be changed for existing code. The code

[jira] [Commented] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645979#comment-15645979 ] Jian He commented on YARN-4597: --- bq. scheduledToRunContainers sounds good bq. Using shouldLaunchContainer

[jira] [Commented] (YARN-5148) [YARN-3368] Add page to new YARN UI to view server side configurations/logs/JVM-metrics

2016-11-07 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645971#comment-15645971 ] Kai Sasaki commented on YARN-5148: -- [~sunilg] Would it be better to rebase for current trunk? Because

[jira] [Commented] (YARN-5556) Support for deleting queues without requiring a RM restart

2016-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645950#comment-15645950 ] Wangda Tan commented on YARN-5556: -- Thanks [~Naganarasimha], I'm OK with pulling YARN-5761 into

[jira] [Updated] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2016-11-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5849: - Attachment: YARN-5849.001.patch Fixing checkstyle issue. > Automatically create YARN control

[jira] [Commented] (YARN-5765) LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645887#comment-15645887 ] Haibo Chen commented on YARN-5765: -- As expected, your fix worked in my cluster test. >

[jira] [Commented] (YARN-5833) Change default port for AMRMProxy

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645874#comment-15645874 ] Hadoop QA commented on YARN-5833: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5746) The state of the parentQueue and its childQueues should be synchronized.

2016-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645858#comment-15645858 ] Wangda Tan commented on YARN-5746: -- [~xgong], thanks for working on the patch. Does it make sense to you

[jira] [Commented] (YARN-5761) Separate QueueManager from Scheduler

2016-11-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645844#comment-15645844 ] Wangda Tan commented on YARN-5761: -- Thanks [~xgong], overall approach looks good, some comments: 1)

[jira] [Commented] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645837#comment-15645837 ] Hadoop QA commented on YARN-5849: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5819) Verify fairshare and minshare preemption

2016-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645799#comment-15645799 ] Daniel Templeton commented on YARN-5819: This is just a first-pass review. After we settle on

[jira] [Updated] (YARN-5851) TestContainerManagerSecurity testContainerManager[1] failed

2016-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5851: - Labels: security (was: ) > TestContainerManagerSecurity testContainerManager[1] failed >

[jira] [Updated] (YARN-5851) TestContainerManagerSecurity testContainerManager[1] failed

2016-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5851: - Labels: security unittest (was: security) > TestContainerManagerSecurity testContainerManager[1] failed

[jira] [Created] (YARN-5851) TestContainerManagerSecurity testContainerManager[1] failed

2016-11-07 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-5851: Summary: TestContainerManagerSecurity testContainerManager[1] failed Key: YARN-5851 URL: https://issues.apache.org/jira/browse/YARN-5851 Project: Hadoop YARN

[jira] [Commented] (YARN-5139) [Umbrella] Move YARN scheduler towards global scheduler

2016-11-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645782#comment-15645782 ] Carlo Curino commented on YARN-5139: [~wangda] first of all, yes it is ok to do this in a later patch,

[jira] [Commented] (YARN-3053) [Security] Review and implement security in ATS v.2

2016-11-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645776#comment-15645776 ] Li Lu commented on YARN-3053: - Thanks [~varun_saxena] for the write up! After checking the doc I have a quick

[jira] [Commented] (YARN-5783) Verify applications are identified starved

2016-11-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645749#comment-15645749 ] Daniel Templeton commented on YARN-5783: According to your Stackoverflow link, the correct

[jira] [Updated] (YARN-3359) Recover collector list when RM fails over

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3359: --- Attachment: YARN-3359-addendum-YARN-5355.patch Attaching addendum patch committed to fix compilation

[jira] [Created] (YARN-5850) Document fair scheduler properties waitTimeBeforeKill and preemptionInterval

2016-11-07 Thread Grant Sohn (JIRA)
Grant Sohn created YARN-5850: Summary: Document fair scheduler properties waitTimeBeforeKill and preemptionInterval Key: YARN-5850 URL: https://issues.apache.org/jira/browse/YARN-5850 Project: Hadoop

[jira] [Updated] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2016-11-07 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5849: - Attachment: YARN-5849.000.patch The patch creates the yarn control group, if it does not exists. I

[jira] [Updated] (YARN-5833) Change default port for AMRMProxy

2016-11-07 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5833: - Attachment: YARN-5883.002.patch Thanks for the feedback, [~subru]. I added a new

[jira] [Updated] (YARN-5688) Make allocation of opportunistic containers asynchronous

2016-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5688: -- Issue Type: Improvement (was: Sub-task) Parent: (was: YARN-5220) > Make allocation of

[jira] [Created] (YARN-5849) Automatically create YARN control group for pre-mounted cgroups

2016-11-07 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-5849: Summary: Automatically create YARN control group for pre-mounted cgroups Key: YARN-5849 URL: https://issues.apache.org/jira/browse/YARN-5849 Project: Hadoop YARN

[jira] [Commented] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645416#comment-15645416 ] Hadoop QA commented on YARN-5280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645284#comment-15645284 ] Arun Suresh edited comment on YARN-4597 at 11/7/16 8:58 PM: Rebased patch after

[jira] [Commented] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645407#comment-15645407 ] Hadoop QA commented on YARN-5356: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645284#comment-15645284 ] Arun Suresh edited comment on YARN-4597 at 11/7/16 8:13 PM: Rebased patch after

[jira] [Updated] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-11-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4597: -- Attachment: YARN-4597.006.patch Rebased patch after YARN-2995 and latest commits to trunk. [~jianhe],

[jira] [Updated] (YARN-3955) Support for priority ACLs in CapacityScheduler

2016-11-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3955: -- Attachment: YARN-3955.v0.patch > Support for priority ACLs in CapacityScheduler >

[jira] [Created] (YARN-5848) public/crossdomain.xml is problematic

2016-11-07 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-5848: -- Summary: public/crossdomain.xml is problematic Key: YARN-5848 URL: https://issues.apache.org/jira/browse/YARN-5848 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-5842) spark job getting failed with memory not avail

2016-11-07 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved YARN-5842. Resolution: Invalid Please email u...@hadoop.apache.org for questions. JIRA is for reporting

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-11-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645172#comment-15645172 ] Allen Wittenauer commented on YARN-4734: I'll file a new bug to fix the crossdomain.xml issues that

[jira] [Updated] (YARN-5847) Revert health check exit code check

2016-11-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-5847: --- Description: Earlier fix to YARN-5567 is reverted because its not ideal to bring the whole

[jira] [Resolved] (YARN-5847) Revert health check exit code check

2016-11-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved YARN-5847. Resolution: Fixed > Revert health check exit code check >

[jira] [Created] (YARN-5847) Revert health check exit code check

2016-11-07 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-5847: -- Summary: Revert health check exit code check Key: YARN-5847 URL: https://issues.apache.org/jira/browse/YARN-5847 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-11-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-5635: --- Release Note: (was: This change reverts YARN-5567 from 3.0.0-alpha1. The exit codes of the

[jira] [Commented] (YARN-5635) Better handling when bad script is configured as Node's HealthScript

2016-11-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645146#comment-15645146 ] Allen Wittenauer commented on YARN-5635: OK, looks like I'm opening another JIRA issue so that

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645136#comment-15645136 ] Hadoop QA commented on YARN-5545: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5843) Documentation wrong for entityType/events rest end point

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645107#comment-15645107 ] Varun Saxena commented on YARN-5843: Thanks [~bibinchundatt] for the patch. Few comments. # In Response

[jira] [Updated] (YARN-5280) Allow YARN containers to run with Java Security Manager

2016-11-07 Thread Greg Phillips (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Phillips updated YARN-5280: Attachment: YARN-5280.004.patch Modified sandbox-mode to again use three operating modes. Added

[jira] [Commented] (YARN-5716) Add global scheduler interface definition and update CapacityScheduler to use it.

2016-11-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645073#comment-15645073 ] Hudson commented on YARN-5716: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10784 (See

[jira] [Commented] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645045#comment-15645045 ] Naganarasimha G R commented on YARN-5545: - Thanks [~bibinchundatt], Overall the approach seems to

[jira] [Commented] (YARN-5765) LinuxContainerExecutor creates appcache and its subdirectories with wrong group owner.

2016-11-07 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645043#comment-15645043 ] Haibo Chen commented on YARN-5765: -- Thanks [~Naganarasimha] for the patch! I'd expect this to work since I

[jira] [Commented] (YARN-5820) yarn node CLI help should be clearer

2016-11-07 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645042#comment-15645042 ] Grant Sohn commented on YARN-5820: -- The latest patch looks incorrect. The is on it's own line and

[jira] [Commented] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645000#comment-15645000 ] Naganarasimha G R commented on YARN-5845: - IMHO, i think the first approach mentioned by

[jira] [Commented] (YARN-5184) Fix up incompatible changes introduced on ContainerStatus and NodeReport

2016-11-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644984#comment-15644984 ] Sangjin Lee commented on YARN-5184: --- Thanks for your feedback Steve. I don't think there is a

[jira] [Updated] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5845: --- Attachment: YARN-5845.0002.patch Single entity publish we might need more clarity . Attaching

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

2016-11-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.011.patch Fixing ResourceCalculatorPlugin configs. > NodeManager should

[jira] [Updated] (YARN-5545) App submit failure on queue with label when default queue partition capacity is zero

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5545: --- Attachment: YARN-5545.0006.patch Attaching patch based after moving system max application

[jira] [Commented] (YARN-5820) yarn node CLI help should be clearer

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644920#comment-15644920 ] Naganarasimha G R commented on YARN-5820: - [~sunilg], yes *yarn application* also do not contain

[jira] [Commented] (YARN-5756) Add state-machine implementation for queues

2016-11-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644904#comment-15644904 ] Xuan Gong commented on YARN-5756: - In this patch, created a QueueStateManager to manage the state for the

[jira] [Updated] (YARN-5756) Add state-machine implementation for queues

2016-11-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5756: Attachment: YARN-5756.1.patch > Add state-machine implementation for queues >

[jira] [Commented] (YARN-5843) Documentation wrong for entityType/events rest end point

2016-11-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644848#comment-15644848 ] Hadoop QA commented on YARN-5843: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5843) Documentation wrong for entityType/events rest end point

2016-11-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5843: --- Attachment: YARN-5843.0001.patch Attaching patch after handling # Comments from

[jira] [Commented] (YARN-5556) Support for deleting queues without requiring a RM restart

2016-11-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644793#comment-15644793 ] Naganarasimha G R commented on YARN-5556: - Hi [~xgong] & [~wangda], please advice whether to have

[jira] [Commented] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644790#comment-15644790 ] Varun Saxena commented on YARN-5845: What I meant was report both the events from appCreated

[jira] [Comment Edited] (YARN-5845) Skip aclUpdated event publish to timelineserver or recovery

2016-11-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644790#comment-15644790 ] Varun Saxena edited comment on YARN-5845 at 11/7/16 5:26 PM: - What I meant was

  1   2   >