[jira] [Updated] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-10-01 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He updated YARN-1680: -- Attachment: YARN-1680-WIP.patch Working in progress patch. I will add unit test. availableResources sent to

[jira] [Updated] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-10-01 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abin Shahab updated YARN-1964: -- Attachment: YARN-1964.patch Harmonized changes between yarn-default.xml and YarnConfiguration. Updated

[jira] [Commented] (YARN-1964) Create Docker analog of the LinuxContainerExecutor in YARN

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154522#comment-14154522 ] Hadoop QA commented on YARN-1964: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2387) Resource Manager crashes with NPE due to lack of synchronization

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154687#comment-14154687 ] Hudson commented on YARN-2387: -- FAILURE: Integrated in Hadoop-Yarn-trunk #697 (See

[jira] [Commented] (YARN-2610) Hamlet should close table tags

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154684#comment-14154684 ] Hudson commented on YARN-2610: -- FAILURE: Integrated in Hadoop-Yarn-trunk #697 (See

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154679#comment-14154679 ] Hudson commented on YARN-1492: -- FAILURE: Integrated in Hadoop-Yarn-trunk #697 (See

[jira] [Commented] (YARN-2594) Potential deadlock in RM when querying ApplicationResourceUsageReport

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154690#comment-14154690 ] Hudson commented on YARN-2594: -- FAILURE: Integrated in Hadoop-Yarn-trunk #697 (See

[jira] [Commented] (YARN-2602) Generic History Service of TimelineServer sometimes not able to handle NPE

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154686#comment-14154686 ] Hudson commented on YARN-2602: -- FAILURE: Integrated in Hadoop-Yarn-trunk #697 (See

[jira] [Commented] (YARN-2627) Add logs when attemptFailuresValidityInterval is enabled

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154691#comment-14154691 ] Hudson commented on YARN-2627: -- FAILURE: Integrated in Hadoop-Yarn-trunk #697 (See

[jira] [Commented] (YARN-2610) Hamlet should close table tags

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154839#comment-14154839 ] Hudson commented on YARN-2610: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1888 (See

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154833#comment-14154833 ] Hudson commented on YARN-1492: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1888 (See

[jira] [Commented] (YARN-2602) Generic History Service of TimelineServer sometimes not able to handle NPE

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154841#comment-14154841 ] Hudson commented on YARN-2602: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1888 (See

[jira] [Commented] (YARN-2594) Potential deadlock in RM when querying ApplicationResourceUsageReport

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154845#comment-14154845 ] Hudson commented on YARN-2594: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1888 (See

[jira] [Commented] (YARN-2179) Initial cache manager structure and context

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154834#comment-14154834 ] Hudson commented on YARN-2179: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1888 (See

[jira] [Commented] (YARN-2627) Add logs when attemptFailuresValidityInterval is enabled

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154846#comment-14154846 ] Hudson commented on YARN-2627: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1888 (See

[jira] [Commented] (YARN-2387) Resource Manager crashes with NPE due to lack of synchronization

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154842#comment-14154842 ] Hudson commented on YARN-2387: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1888 (See

[jira] [Commented] (YARN-2179) Initial cache manager structure and context

2014-10-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154851#comment-14154851 ] Jason Lowe commented on YARN-2179: -- The pom versions are incorrect in branch-2 from the

[jira] [Created] (YARN-2633) TestContainerLauncherImpl sometimes fails

2014-10-01 Thread Mit Desai (JIRA)
Mit Desai created YARN-2633: --- Summary: TestContainerLauncherImpl sometimes fails Key: YARN-2633 URL: https://issues.apache.org/jira/browse/YARN-2633 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2179) Initial cache manager structure and context

2014-10-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154872#comment-14154872 ] Karthik Kambatla commented on YARN-2179: Thanks for catching it, Jason. Just pushed

[jira] [Commented] (YARN-2627) Add logs when attemptFailuresValidityInterval is enabled

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154914#comment-14154914 ] Hudson commented on YARN-2627: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1913 (See

[jira] [Commented] (YARN-2179) Initial cache manager structure and context

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154903#comment-14154903 ] Hudson commented on YARN-2179: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1913 (See

[jira] [Commented] (YARN-2387) Resource Manager crashes with NPE due to lack of synchronization

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154910#comment-14154910 ] Hudson commented on YARN-2387: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1913 (See

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154902#comment-14154902 ] Hudson commented on YARN-1492: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1913 (See

[jira] [Commented] (YARN-2610) Hamlet should close table tags

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154907#comment-14154907 ] Hudson commented on YARN-2610: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1913 (See

[jira] [Commented] (YARN-2602) Generic History Service of TimelineServer sometimes not able to handle NPE

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154909#comment-14154909 ] Hudson commented on YARN-2602: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1913 (See

[jira] [Commented] (YARN-2594) Potential deadlock in RM when querying ApplicationResourceUsageReport

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154913#comment-14154913 ] Hudson commented on YARN-2594: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1913 (See

[jira] [Commented] (YARN-2613) NMClient doesn't have retries for supporting rolling-upgrades

2014-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154931#comment-14154931 ] Junping Du commented on YARN-2613: -- +1. Patch looks good to me. Will commit it shortly.

[jira] [Commented] (YARN-2180) In-memory backing store for cache manager

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154934#comment-14154934 ] Hadoop QA commented on YARN-2180: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-2634) Test failure for TestClientRMTokens

2014-10-01 Thread Junping Du (JIRA)
Junping Du created YARN-2634: Summary: Test failure for TestClientRMTokens Key: YARN-2634 URL: https://issues.apache.org/jira/browse/YARN-2634 Project: Hadoop YARN Issue Type: Test

[jira] [Updated] (YARN-2634) Test failure for TestClientRMTokens

2014-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2634: - Target Version/s: 2.6.0 Test failure for TestClientRMTokens ---

[jira] [Commented] (YARN-2545) RMApp should transit to FAILED when AM calls finishApplicationMaster with FAILED

2014-10-01 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14154946#comment-14154946 ] Hong Zhiguo commented on YARN-2545: --- How about the state of appAttempt? should it finally

[jira] [Updated] (YARN-2615) ClientToAMTokenIdentifier and DelegationTokenIdentifier should allow extended fields

2014-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2615: - Attachment: YARN-2615.patch Upload the first patch, include the changes on ClientToAMTokenIdentifier (and

[jira] [Updated] (YARN-2634) Test failure for TestClientRMTokens

2014-10-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2634: - Priority: Blocker (was: Major) Test failure for TestClientRMTokens ---

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-10-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-015.patch parch -15; this is patch -14 rebased against trunk with a conflict

[jira] [Commented] (YARN-1063) Winutils needs ability to create task as domain user

2014-10-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155093#comment-14155093 ] Vinod Kumar Vavilapalli commented on YARN-1063: --- Tx for the updates

[jira] [Commented] (YARN-2616) Add CLI client to the registry to list/view entries

2014-10-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155098#comment-14155098 ] Steve Loughran commented on YARN-2616: -- thanks. I'm going to pull this down into the

[jira] [Updated] (YARN-2624) Resource Localization fails on a cluster due to existing cache directories

2014-10-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2624: --- Priority: Blocker (was: Major) Target Version/s: 2.6.0 Affects Version/s:

[jira] [Updated] (YARN-2632) Document NM Restart feature

2014-10-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2632: --- Priority: Blocker (was: Major) Marking this a blocker to ensure we don't miss it in 2.6.

[jira] [Updated] (YARN-1972) Implement secure Windows Container Executor

2014-10-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1972: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-732 Implement

[jira] [Updated] (YARN-732) YARN support for container isolation on Windows

2014-10-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-732: - Fix Version/s: (was: trunk-win) YARN support for container isolation on

[jira] [Updated] (YARN-2129) Add scheduling priority to the WindowsSecureContainerExecutor

2014-10-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2129: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-732 Add

[jira] [Commented] (YARN-1063) Winutils needs ability to create task as domain user

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155116#comment-14155116 ] Hudson commented on YARN-1063: -- FAILURE: Integrated in Hadoop-trunk-Commit #6164 (See

[jira] [Commented] (YARN-1972) Implement secure Windows Container Executor

2014-10-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155127#comment-14155127 ] Vinod Kumar Vavilapalli commented on YARN-1972: --- bq. Remus Rusanu Vinod Kumar

[jira] [Commented] (YARN-2630) TestDistributedShell#testDSRestartWithPreviousRunningContainers fails

2014-10-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155136#comment-14155136 ] Zhijie Shen commented on YARN-2630: --- Make sense. +1

[jira] [Commented] (YARN-2615) ClientToAMTokenIdentifier and DelegationTokenIdentifier should allow extended fields

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155139#comment-14155139 ] Hadoop QA commented on YARN-2615: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2635) TestRMRestart fails with FairScheduler

2014-10-01 Thread Wei Yan (JIRA)
Wei Yan created YARN-2635: - Summary: TestRMRestart fails with FairScheduler Key: YARN-2635 URL: https://issues.apache.org/jira/browse/YARN-2635 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1972) Implement secure Windows Container Executor

2014-10-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155151#comment-14155151 ] Hudson commented on YARN-1972: -- FAILURE: Integrated in Hadoop-trunk-Commit #6165 (See

[jira] [Commented] (YARN-1063) Winutils needs ability to create task as domain user

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155169#comment-14155169 ] Hadoop QA commented on YARN-1063: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-10-01 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-1879: Attachment: YARN-1879.16.patch [~ozawa] I have updated your patch to compile with latest trunk.

[jira] [Updated] (YARN-2630) TestDistributedShell#testDSRestartWithPreviousRunningContainers fails

2014-10-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2630: -- Attachment: YARN-2630.3.patch Uploaded a patch which renames

[jira] [Commented] (YARN-2617) NM does not need to send finished container whose APP is not running to RM

2014-10-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155220#comment-14155220 ] Jian He commented on YARN-2617: --- looks good, +1 NM does not need to send finished container

[jira] [Commented] (YARN-2630) TestDistributedShell#testDSRestartWithPreviousRunningContainers fails

2014-10-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155227#comment-14155227 ] Zhijie Shen commented on YARN-2630: --- Would you please check finishedContainersPulledByAM

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-10-01 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155235#comment-14155235 ] Jian Fang commented on YARN-1680: - I may be wrong because I don't understand the logic

[jira] [Updated] (YARN-2630) TestDistributedShell#testDSRestartWithPreviousRunningContainers fails

2014-10-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2630: -- Attachment: YARN-2630.4.patch thanks zhijie ! updated the patch to fix the inconsistency

[jira] [Updated] (YARN-1972) Implement secure Windows Container Executor

2014-10-01 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-1972: -- Attachment: YARN-1972.delta.5-branch-2.patch The patch doesn't apply on

[jira] [Commented] (YARN-1972) Implement secure Windows Container Executor

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155259#comment-14155259 ] Hadoop QA commented on YARN-1972: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-10-01 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155282#comment-14155282 ] Jian Fang commented on YARN-1680: - Also, seems the variable blackListedResources in

[jira] [Updated] (YARN-2628) Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free

2014-10-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2628: Attachment: apache-yarn-2628.0.patch Uploaded a patch with fix and test case. Capacity scheduler

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-10-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155295#comment-14155295 ] Craig Welch commented on YARN-1680: --- As I recall, blacklisted nodes are application level

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155302#comment-14155302 ] Hadoop QA commented on YARN-1879: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2630) TestDistributedShell#testDSRestartWithPreviousRunningContainers fails

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155318#comment-14155318 ] Hadoop QA commented on YARN-2630: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-10-01 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155344#comment-14155344 ] Jian Fang commented on YARN-1680: - Is there any behavior change from hadoop one to hadoop

[jira] [Commented] (YARN-2630) TestDistributedShell#testDSRestartWithPreviousRunningContainers fails

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155352#comment-14155352 ] Hadoop QA commented on YARN-2630: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2636) Windows Secure Container Executor: add unit tests for WSCE

2014-10-01 Thread Remus Rusanu (JIRA)
Remus Rusanu created YARN-2636: -- Summary: Windows Secure Container Executor: add unit tests for WSCE Key: YARN-2636 URL: https://issues.apache.org/jira/browse/YARN-2636 Project: Hadoop YARN

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-10-01 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155360#comment-14155360 ] Craig Welch commented on YARN-1680: --- There are different kinds of blacklisting, the one

[jira] [Updated] (YARN-2408) Resource Request REST API for YARN

2014-10-01 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle updated YARN-2408: - Description: I’m proposing a new REST API for YARN which exposes a snapshot of the Resource

[jira] [Updated] (YARN-2408) Resource Request REST API for YARN

2014-10-01 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle updated YARN-2408: - Attachment: YARN-2408.4.patch Clustered resource requests that have the same priority, same number

[jira] [Updated] (YARN-2408) Resource Request REST API for YARN

2014-10-01 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle updated YARN-2408: - Attachment: (was: YARN-2408-3.patch) Resource Request REST API for YARN

[jira] [Commented] (YARN-1063) Winutils needs ability to create task as domain user

2014-10-01 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155373#comment-14155373 ] Remus Rusanu commented on YARN-1063: Contributor credit should also got to Kyle Leckie

[jira] [Commented] (YARN-2408) Resource Request REST API for YARN

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155372#comment-14155372 ] Hadoop QA commented on YARN-2408: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1680) availableResources sent to applicationMaster in heartbeat should exclude blacklistedNodes free memory.

2014-10-01 Thread Jian Fang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155381#comment-14155381 ] Jian Fang commented on YARN-1680: - Thanks Craig for your clarification. Is the cluster

[jira] [Commented] (YARN-2628) Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155393#comment-14155393 ] Hadoop QA commented on YARN-2628: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2617) NM does not need to send finished container whose APP is not running to RM

2014-10-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-2617: -- Attachment: YARN-2617.5.patch just added one more log statement myself, pending jenkins NM does not need to

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-10-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155399#comment-14155399 ] Tsuyoshi OZAWA commented on YARN-1879: -- Sorry for the delay and thanks for updating

[jira] [Commented] (YARN-2628) Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free

2014-10-01 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155398#comment-14155398 ] Varun Vasudev commented on YARN-2628: - The release audit error is from a hdfs file and

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-10-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155400#comment-14155400 ] Tsuyoshi OZAWA commented on YARN-1879: -- About the release audit warning, it's also not

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-10-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155407#comment-14155407 ] Tsuyoshi OZAWA commented on YARN-1879: -- {quote} APIs that added trigger flag. APIs

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-10-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1879: - Attachment: YARN-1879.17.patch Mark Idempotent/AtMostOnce annotations to

[jira] [Updated] (YARN-2312) Marking ContainerId#getId as deprecated

2014-10-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-2312: - Attachment: YARN-2312.2-3.patch Marking ContainerId#getId as deprecated

[jira] [Commented] (YARN-2254) change TestRMWebServicesAppsModification to support FairScheduler.

2014-10-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155467#comment-14155467 ] Karthik Kambatla commented on YARN-2254: Patch looks mostly good. One nit: Can we

[jira] [Commented] (YARN-2312) Marking ContainerId#getId as deprecated

2014-10-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155473#comment-14155473 ] Tsuyoshi OZAWA commented on YARN-2312: -- I cannot reproduce the findbugs warning. Let

[jira] [Commented] (YARN-2617) NM does not need to send finished container whose APP is not running to RM

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155477#comment-14155477 ] Hadoop QA commented on YARN-2617: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155481#comment-14155481 ] Hadoop QA commented on YARN-1879: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-10-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-913: Attachment: YARN-913-016.patch patch -016: includes registry cli patch (-002) of YARN-2616 Add a

[jira] [Commented] (YARN-2616) Add CLI client to the registry to list/view entries

2014-10-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155530#comment-14155530 ] Steve Loughran commented on YARN-2616: -- the patch I just posted doesn't {{stop()}} the

[jira] [Updated] (YARN-2616) Add CLI client to the registry to list/view entries

2014-10-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2616: - Attachment: YARN-2616-003.patch Add CLI client to the registry to list/view entries

[jira] [Updated] (YARN-2254) change TestRMWebServicesAppsModification to support FairScheduler.

2014-10-01 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-2254: Attachment: YARN-2254.004.patch change TestRMWebServicesAppsModification to support FairScheduler.

[jira] [Commented] (YARN-2254) change TestRMWebServicesAppsModification to support FairScheduler.

2014-10-01 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1418#comment-1418 ] zhihai xu commented on YARN-2254: - Hi [~kasha], Good suggestion, I upload a new patch

[jira] [Updated] (YARN-1879) Mark Idempotent/AtMostOnce annotations to ApplicationMasterProtocol

2014-10-01 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1879: - Attachment: YARN-1879.18.patch Rebased on trunk. Mark Idempotent/AtMostOnce annotations to

[jira] [Commented] (YARN-2630) TestDistributedShell#testDSRestartWithPreviousRunningContainers fails

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155565#comment-14155565 ] Hadoop QA commented on YARN-2630: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2254) change TestRMWebServicesAppsModification to support FairScheduler.

2014-10-01 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155571#comment-14155571 ] Karthik Kambatla commented on YARN-2254: +1, pending Jenkins. I ll commit this

[jira] [Commented] (YARN-2628) Capacity scheduler with DominantResourceCalculator carries out reservation even though slots are free

2014-10-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155584#comment-14155584 ] Jian He commented on YARN-2628: --- looks good, one minor comment in the test case: - the

[jira] [Commented] (YARN-2616) Add CLI client to the registry to list/view entries

2014-10-01 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155624#comment-14155624 ] Steve Loughran commented on YARN-2616: -- features of 003 patch # registry instance

[jira] [Commented] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

2014-10-01 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155638#comment-14155638 ] Joep Rottinghuis commented on YARN-1414: @sandyr could we get some love on this

[jira] [Commented] (YARN-2583) Modify the LogDeletionService to support Log aggregation for LRS

2014-10-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155643#comment-14155643 ] Zhijie Shen commented on YARN-2583: --- Per discussion offline: 1. In

[jira] [Commented] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155649#comment-14155649 ] Hadoop QA commented on YARN-1414: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-2637) maximum-am-resource-percent will be violated when resource of AM is minimumAllocation

2014-10-01 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2637: Summary: maximum-am-resource-percent will be violated when resource of AM is minimumAllocation Key: YARN-2637 URL: https://issues.apache.org/jira/browse/YARN-2637 Project:

[jira] [Updated] (YARN-2637) maximum-am-resource-percent could be violated when resource of AM is minimumAllocation

2014-10-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2637: - Summary: maximum-am-resource-percent could be violated when resource of AM is minimumAllocation (was:

[jira] [Commented] (YARN-913) Add a way to register long-lived services in a YARN cluster

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155664#comment-14155664 ] Hadoop QA commented on YARN-913: {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2254) change TestRMWebServicesAppsModification to support FairScheduler.

2014-10-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14155669#comment-14155669 ] Hadoop QA commented on YARN-2254: - {color:red}-1 overall{color}. Here are the results of

  1   2   >