[jira] [Created] (YARN-1912) ResourceLocalizer started without any jvm memory control

2014-04-08 Thread stanley shi (JIRA)
stanley shi created YARN-1912: - Summary: ResourceLocalizer started without any jvm memory control Key: YARN-1912 URL: https://issues.apache.org/jira/browse/YARN-1912 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-1878) Yarn standby RM taking long to transition to active

2014-04-08 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1878: - Issue Type: Sub-task (was: Bug) Parent: YARN-149 Yarn standby RM taking long to

[jira] [Commented] (YARN-1912) ResourceLocalizer started without any jvm memory control

2014-04-08 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963010#comment-13963010 ] Nathan Roberts commented on YARN-1912: -- Doesn't it default to MIN(25%_of_memory,1GB)?

[jira] [Commented] (YARN-1906) TestRMRestart#testQueueMetricsOnRMRestart fails intermittently on trunk and branch2

2014-04-08 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963114#comment-13963114 ] Mit Desai commented on YARN-1906: - Thanks for the feedback Jon. I will take a look today

[jira] [Created] (YARN-1913) Cluster logjam when all resources are consumed by AM

2014-04-08 Thread bc Wong (JIRA)
bc Wong created YARN-1913: - Summary: Cluster logjam when all resources are consumed by AM Key: YARN-1913 URL: https://issues.apache.org/jira/browse/YARN-1913 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-1913) Cluster logjam when all resources are consumed by AM

2014-04-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963143#comment-13963143 ] Jason Lowe commented on YARN-1913: -- Which scheduler are you using? The CapacityScheduler

[jira] [Commented] (YARN-1913) With Fair Scheduler, cluster can logjam when all resources are consumed by AMs

2014-04-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963164#comment-13963164 ] Sandy Ryza commented on YARN-1913: -- This is a Fair Scheduler issue. We need to add an

[jira] [Updated] (YARN-1913) With Fair Scheduler, cluster can logjam when all resources are consumed by AMs

2014-04-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated YARN-1913: - Summary: With Fair Scheduler, cluster can logjam when all resources are consumed by AMs (was: Cluster

[jira] [Updated] (YARN-1757) NM Recovery. Auxiliary service support.

2014-04-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1757: --- Summary: NM Recovery. Auxiliary service support. (was: Auxiliary service support for

[jira] [Commented] (YARN-1757) NM Recovery. Auxiliary service support.

2014-04-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963218#comment-13963218 ] Hudson commented on YARN-1757: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5469 (See

[jira] [Commented] (YARN-1910) TestAMRMTokens fails on windows

2014-04-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963259#comment-13963259 ] Varun Vasudev commented on YARN-1910: - Patch looks good. Just one suggestion - rename

[jira] [Commented] (YARN-1537) TestLocalResourcesTrackerImpl.testLocalResourceCache often failed

2014-04-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963268#comment-13963268 ] Varun Vasudev commented on YARN-1537: - +1 looks fine to me.

[jira] [Commented] (YARN-596) In fair scheduler, intra-application container priorities affect inter-application preemption decisions

2014-04-08 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963271#comment-13963271 ] Sandy Ryza commented on YARN-596: - bq. Sandy Ryza, so here the ''safe'' means usage.memory

[jira] [Created] (YARN-1914) Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows

2014-04-08 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-1914: --- Summary: Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows Key: YARN-1914 URL: https://issues.apache.org/jira/browse/YARN-1914 Project: Hadoop YARN

[jira] [Updated] (YARN-1914) Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows

2014-04-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-1914: Attachment: apache-yarn-1914.0.patch Patch skipping test on windows Test

[jira] [Assigned] (YARN-1914) Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows

2014-04-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev reassigned YARN-1914: --- Assignee: Varun Vasudev Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows

[jira] [Commented] (YARN-1908) Distributed shell with custom script has permission error.

2014-04-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963382#comment-13963382 ] Xuan Gong commented on YARN-1908: - +1 LGTM Distributed shell with custom script has

[jira] [Updated] (YARN-1910) TestAMRMTokens fails on windows

2014-04-08 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1910: Attachment: YARN-1910.2.patch TestAMRMTokens fails on windows ---

[jira] [Commented] (YARN-1910) TestAMRMTokens fails on windows

2014-04-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963396#comment-13963396 ] Varun Vasudev commented on YARN-1910: - +1 looks good to me. TestAMRMTokens fails on

[jira] [Commented] (YARN-1914) Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows

2014-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963399#comment-13963399 ] Hadoop QA commented on YARN-1914: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1908) Distributed shell with custom script has permission error.

2014-04-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963401#comment-13963401 ] Jian He commented on YARN-1908: --- Patch looks good to me, + 1 Distributed shell with custom

[jira] [Commented] (YARN-1910) TestAMRMTokens fails on windows

2014-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963457#comment-13963457 ] Hadoop QA commented on YARN-1910: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1784) TestContainerAllocation assumes CapacityScheduler

2014-04-08 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-1784: Attachment: YARN-1784.patch The patch configures the tests to always use the CapcityScheduler

[jira] [Commented] (YARN-1907) TestRMApplicationHistoryWriter#testRMWritingMassiveHistory runs slow and intermittently fails

2014-04-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963480#comment-13963480 ] Zhijie Shen commented on YARN-1907: --- The patch makes sense to me. I tried the test in

[jira] [Commented] (YARN-1906) TestRMRestart#testQueueMetricsOnRMRestart fails intermittently on trunk and branch2

2014-04-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963491#comment-13963491 ] Zhijie Shen commented on YARN-1906: --- Maybe we can wait until, for example, the

[jira] [Commented] (YARN-1784) TestContainerAllocation assumes CapacityScheduler

2014-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963512#comment-13963512 ] Hadoop QA commented on YARN-1784: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1908) Distributed shell with custom script has permission error.

2014-04-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963517#comment-13963517 ] Vinod Kumar Vavilapalli commented on YARN-1908: --- Tx for the reviews [~xgong]

[jira] [Updated] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-04-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1341: - Attachment: YARN-1341v3.patch Updating patch after YARN-1757 was committed. Recover NMTokens upon

[jira] [Commented] (YARN-1908) Distributed shell with custom script has permission error.

2014-04-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963532#comment-13963532 ] Hudson commented on YARN-1908: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5471 (See

[jira] [Updated] (YARN-1342) Recover container tokens upon nodemanager restart

2014-04-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1342: - Attachment: YARN-1342v2.patch Updating patch after YARN-1757 was committed. Recover container tokens

[jira] [Commented] (YARN-1784) TestContainerAllocation assumes CapacityScheduler

2014-04-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963553#comment-13963553 ] Karthik Kambatla commented on YARN-1784: Instead of adding it to individual tests,

[jira] [Updated] (YARN-1339) Recover DeletionService state upon nodemanager restart

2014-04-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-1339: - Attachment: YARN-1339v2.patch Updating patch after YARN-1757 was committed. Recover DeletionService

[jira] [Commented] (YARN-1906) TestRMRestart#testQueueMetricsOnRMRestart fails intermittently on trunk and branch2

2014-04-08 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963539#comment-13963539 ] Mit Desai commented on YARN-1906: - I was going through the app state transitions and I have

[jira] [Created] (YARN-1915) ClientToAMTokenMasterKey should be provided to AM at launch time

2014-04-08 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-1915: - Summary: ClientToAMTokenMasterKey should be provided to AM at launch time Key: YARN-1915 URL: https://issues.apache.org/jira/browse/YARN-1915 Project: Hadoop YARN

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963581#comment-13963581 ] Hadoop QA commented on YARN-1341: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1784) TestContainerAllocation assumes CapacityScheduler

2014-04-08 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-1784: Attachment: YARN-1784.patch New patch uses a setup method. TestContainerAllocation assumes

[jira] [Commented] (YARN-1342) Recover container tokens upon nodemanager restart

2014-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963604#comment-13963604 ] Hadoop QA commented on YARN-1342: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1339) Recover DeletionService state upon nodemanager restart

2014-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963606#comment-13963606 ] Hadoop QA commented on YARN-1339: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1784) TestContainerAllocation assumes CapacityScheduler

2014-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963650#comment-13963650 ] Hadoop QA commented on YARN-1784: - {color:green}+1 overall{color}. Here are the results of

[jira] [Created] (YARN-1916) Leveldb timeline store applies secondary filters incorrectly

2014-04-08 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-1916: Summary: Leveldb timeline store applies secondary filters incorrectly Key: YARN-1916 URL: https://issues.apache.org/jira/browse/YARN-1916 Project: Hadoop YARN

[jira] [Updated] (YARN-1916) Leveldb timeline store applies secondary filters incorrectly

2014-04-08 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-1916: - Attachment: YARN-1916.1.patch Leveldb timeline store applies secondary filters incorrectly

[jira] [Commented] (YARN-1914) Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows

2014-04-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963681#comment-13963681 ] Sangjin Lee commented on YARN-1914: --- LGTM. Sorry for missing the windows build. Test

[jira] [Commented] (YARN-1914) Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows

2014-04-08 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963710#comment-13963710 ] Bikas Saha commented on YARN-1914: -- [~cnauroth] [~ivanmi] Was this specific issue not

[jira] [Commented] (YARN-1916) Leveldb timeline store applies secondary filters incorrectly

2014-04-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963712#comment-13963712 ] Hadoop QA commented on YARN-1916: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1912) ResourceLocalizer started without any jvm memory control

2014-04-08 Thread stanley shi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963789#comment-13963789 ] stanley shi commented on YARN-1912: --- No, it's not the minumum. On one of my environment

[jira] [Commented] (YARN-1784) TestContainerAllocation assumes CapacityScheduler

2014-04-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963802#comment-13963802 ] Karthik Kambatla commented on YARN-1784: +1. Will commit this tonight.