[jira] [Commented] (YARN-1801) NPE in public localizer

2014-08-22 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106555#comment-14106555 ] Hong Zhiguo commented on YARN-1801: --- I think YARN-1575 already fixed this NPE. We could

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread mai shurong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106583#comment-14106583 ] mai shurong commented on YARN-1458: --- George Wong , You can try our YARN-1458.patch and it

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-1458: Attachment: YARN-1458.002.patch In Fair Scheduler, size based weight can cause update thread to hold lock

[jira] [Created] (YARN-2439) Move winutils task related functionality under a yarn-servers-nodemanager project

2014-08-22 Thread Remus Rusanu (JIRA)
Remus Rusanu created YARN-2439: -- Summary: Move winutils task related functionality under a yarn-servers-nodemanager project Key: YARN-2439 URL: https://issues.apache.org/jira/browse/YARN-2439 Project:

[jira] [Commented] (YARN-2198) Remove the need to run NodeManager as privileged account for Windows Secure Container Executor

2014-08-22 Thread Remus Rusanu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106605#comment-14106605 ] Remus Rusanu commented on YARN-2198: I have created YARN-2439 to track the separation

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106606#comment-14106606 ] zhihai xu commented on YARN-1458: - I added a test case testFairShareWithZeroWeight in new

[jira] [Commented] (YARN-2345) yarn rmadmin -report

2014-08-22 Thread Hao Gao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106630#comment-14106630 ] Hao Gao commented on YARN-2345: --- yarn node -status nodeid will list the status of a single

[jira] [Updated] (YARN-2345) yarn rmadmin -report

2014-08-22 Thread Hao Gao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Gao updated YARN-2345: -- Attachment: YARN-2345.1.patch Attached the patch. yarn rmadmin -report

[jira] [Updated] (YARN-2437) [post-HADOOP-9902] start-yarn.sh/stop-yarn needs to give info

2014-08-22 Thread Hao Gao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Gao updated YARN-2437: -- Assignee: Hao Gao [post-HADOOP-9902] start-yarn.sh/stop-yarn needs to give info

[jira] [Created] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-2440: --- Summary: Cgroups should limit YARN containers to cores allocated in yarn-site.xml Key: YARN-2440 URL: https://issues.apache.org/jira/browse/YARN-2440 Project: Hadoop

[jira] [Commented] (YARN-2345) yarn rmadmin -report

2014-08-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106669#comment-14106669 ] Wangda Tan commented on YARN-2345: -- Hi Hao, I think we already have a NodeCLI, which is

[jira] [Updated] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2440: Attachment: screenshot-current-implementation.jpg Screenshot with the CPU usage in the current

[jira] [Updated] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-2440: Attachment: apache-yarn-2440.0.patch Attached patch with fix. Cgroups should limit YARN

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106671#comment-14106671 ] Varun Vasudev commented on YARN-2440: - After applying the patch, the quota is set

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106687#comment-14106687 ] Varun Vasudev commented on YARN-810: [~sandyr] [~ywskycn] are you still working on this?

[jira] [Commented] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106720#comment-14106720 ] Hudson commented on YARN-2436: -- FAILURE: Integrated in Hadoop-Yarn-trunk #654 (See

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106717#comment-14106717 ] Hudson commented on YARN-2434: -- FAILURE: Integrated in Hadoop-Yarn-trunk #654 (See

[jira] [Created] (YARN-2441) NPE in nodemanager after restart

2014-08-22 Thread Nishan Shetty (JIRA)
Nishan Shetty created YARN-2441: --- Summary: NPE in nodemanager after restart Key: YARN-2441 URL: https://issues.apache.org/jira/browse/YARN-2441 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-2442) ResourceManager JMX UI does not give HA State

2014-08-22 Thread Nishan Shetty (JIRA)
Nishan Shetty created YARN-2442: --- Summary: ResourceManager JMX UI does not give HA State Key: YARN-2442 URL: https://issues.apache.org/jira/browse/YARN-2442 Project: Hadoop YARN Issue Type:

[jira] [Comment Edited] (YARN-2345) yarn rmadmin -report

2014-08-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106816#comment-14106816 ] Allen Wittenauer edited comment on YARN-2345 at 8/22/14 1:26 PM:

[jira] [Commented] (YARN-2345) yarn rmadmin -report

2014-08-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106816#comment-14106816 ] Allen Wittenauer commented on YARN-2345: [~wangda], this is to bring consistency

[jira] [Comment Edited] (YARN-2345) yarn rmadmin -report

2014-08-22 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106816#comment-14106816 ] Allen Wittenauer edited comment on YARN-2345 at 8/22/14 1:28 PM:

[jira] [Commented] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106863#comment-14106863 ] Hudson commented on YARN-2436: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1845 (See

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106860#comment-14106860 ] Hudson commented on YARN-2434: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1845 (See

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106889#comment-14106889 ] Nathan Roberts commented on YARN-2440: -- Thanks Varun for the patch. I'm wondering if

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106893#comment-14106893 ] Varun Vasudev commented on YARN-2440: - [~nroberts] there's already a ticket for your

[jira] [Commented] (YARN-2441) NPE in nodemanager after restart

2014-08-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106902#comment-14106902 ] Jason Lowe commented on YARN-2441: -- Was this truly running trunk as the Affected Versions

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106932#comment-14106932 ] Hudson commented on YARN-2434: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1871 (See

[jira] [Commented] (YARN-2436) [post-HADOOP-9902] yarn application help doesn't work

2014-08-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106935#comment-14106935 ] Hudson commented on YARN-2436: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1871 (See

[jira] [Updated] (YARN-2393) FairScheduler: Implement steady fair share

2014-08-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2393: --- Summary: FairScheduler: Implement steady fair share (was: Fair Scheduler : Implement steady

[jira] [Updated] (YARN-2442) ResourceManager JMX UI does not give HA State

2014-08-22 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty updated YARN-2442: Affects Version/s: (was: 3.0.0) 2.5.0 ResourceManager JMX UI does not

[jira] [Commented] (YARN-2441) NPE in nodemanager after restart

2014-08-22 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106987#comment-14106987 ] Nishan Shetty commented on YARN-2441: - [~jlowe] Sorry i mentioned the wrong Affected

[jira] [Commented] (YARN-2393) FairScheduler: Implement steady fair share

2014-08-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106990#comment-14106990 ] Karthik Kambatla commented on YARN-2393: One of the reasons we (Sandy and I) wanted

[jira] [Commented] (YARN-2393) FairScheduler: Implement steady fair share

2014-08-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106991#comment-14106991 ] Karthik Kambatla commented on YARN-2393: Committing this. FairScheduler:

[jira] [Updated] (YARN-2393) FairScheduler: Add the notion of steady fair share

2014-08-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2393: --- Summary: FairScheduler: Add the notion of steady fair share (was: FairScheduler: Implement

[jira] [Updated] (YARN-2393) FairScheduler: Add the notion of steady fair share

2014-08-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2393: --- Issue Type: New Feature (was: Improvement) FairScheduler: Add the notion of steady fair

[jira] [Commented] (YARN-160) nodemanagers should obtain cpu/memory values from underlying OS

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106995#comment-14106995 ] Varun Vasudev commented on YARN-160: [~djp] {quote} Both physical id and core id are not

[jira] [Commented] (YARN-2441) NPE in nodemanager after restart

2014-08-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106999#comment-14106999 ] Jason Lowe commented on YARN-2441: -- Ah, then this seems like a case where a client (likely

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107000#comment-14107000 ] Wei Yan commented on YARN-810: -- [~vvasudev], thanks for the offer. I'm still working on this.

[jira] [Commented] (YARN-2393) FairScheduler: Add the notion of steady fair share

2014-08-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107007#comment-14107007 ] Hudson commented on YARN-2393: -- FAILURE: Integrated in Hadoop-trunk-Commit #6097 (See

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107005#comment-14107005 ] Wei Yan commented on YARN-2440: --- [~vvasudev], for general cases, we shouldn't strictly limit

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107012#comment-14107012 ] Varun Vasudev commented on YARN-2440: - [~ywskycn] this patch doesn't limit containers

[jira] [Commented] (YARN-2431) NM restart: cgroup is not removed for reacquired containers

2014-08-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107008#comment-14107008 ] Jason Lowe commented on YARN-2431: -- Release audit problems are unrelated, see HDFS-6905.

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107025#comment-14107025 ] Wei Yan commented on YARN-2440: --- [~vvasudev], I misunderstood this jira. Will post comment

[jira] [Commented] (YARN-2393) FairScheduler: Add the notion of steady fair share

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107050#comment-14107050 ] Wei Yan commented on YARN-2393: --- Thanks, [~kasha], [~ashwinshankar77]. Will post a patch for

[jira] [Updated] (YARN-2441) NPE in nodemanager after restart

2014-08-22 Thread Nishan Shetty (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nishan Shetty updated YARN-2441: Priority: Major (was: Minor) NPE in nodemanager after restart

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107057#comment-14107057 ] Jason Lowe commented on YARN-2440: -- I think cfs_quota_us has a maximum value of 100,

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107066#comment-14107066 ] zhihai xu commented on YARN-1458: - [~shurong.mai], YARN-1458.patch will cause regression.

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107068#comment-14107068 ] Varun Vasudev commented on YARN-2440: - [~jlowe] does it make sense to get the number of

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107069#comment-14107069 ] Varun Vasudev commented on YARN-2440: - I'll update the patch to limit cfs_quota_us.

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107093#comment-14107093 ] Jason Lowe commented on YARN-2440: -- bq. does it make sense to get the number of physical

[jira] [Created] (YARN-2443) Log Handling for Long Running Service

2014-08-22 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-2443: --- Summary: Log Handling for Long Running Service Key: YARN-2443 URL: https://issues.apache.org/jira/browse/YARN-2443 Project: Hadoop YARN Issue Type: Task

[jira] [Updated] (YARN-1104) NMs to support rolling logs of stdout stderr

2014-08-22 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1104: Parent Issue: YARN-2443 (was: YARN-896) NMs to support rolling logs of stdout stderr

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107172#comment-14107172 ] Varun Vasudev commented on YARN-810: [~ywskycn] thanks for letting me know! Some

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: (was: Screen_Shot_v3.png) Fair Scheduler : Display dynamic fair share for queues on the

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: Screen_Shot_v3.png Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: YARN-2360-v3.patch Update a patch after YARN-2393. The Screen_Shot_v3.png is the fair scheduler

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: Screen_Shot_v3.png Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107221#comment-14107221 ] Wei Yan commented on YARN-810: -- bq. With your current implementation, on a machine with 4

[jira] [Commented] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107244#comment-14107244 ] Karthik Kambatla commented on YARN-2360: I would rename the legend to Steady

[jira] [Commented] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107252#comment-14107252 ] Wei Yan commented on YARN-2360: --- Thanks, Karthik. Will update a patch with changes, also

[jira] [Updated] (YARN-2444) Primary filters added after first submission not indexed, cause exceptions in logs.

2014-08-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated YARN-2444: - Attachment: ats.java Primary filters added after first submission not indexed, cause exceptions

[jira] [Commented] (YARN-2444) Primary filters added after first submission not indexed, cause exceptions in logs.

2014-08-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107269#comment-14107269 ] Marcelo Vanzin commented on YARN-2444: -- The following search causes the problem

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107275#comment-14107275 ] Varun Vasudev commented on YARN-2440: - It might make things easier to go with [~sandyr]

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: Screen_Shot_v4.png Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: YARN-2360-v4.patch Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107331#comment-14107331 ] Jason Lowe commented on YARN-2440: -- Sure for this JIRA we can go with a percent of total

[jira] [Commented] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107351#comment-14107351 ] Ashwin Shankar commented on YARN-2360: -- [~ywskycn], patch looks good. Should we

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107379#comment-14107379 ] Hadoop QA commented on YARN-1458: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2408) Resource Request REST API for YARN

2014-08-22 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle updated YARN-2408: - Attachment: (was: YARN-2408-2.patch) Resource Request REST API for YARN

[jira] [Updated] (YARN-2408) Resource Request REST API for YARN

2014-08-22 Thread Renan DelValle (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renan DelValle updated YARN-2408: - Attachment: YARN-2408-3.patch Bug fix Resource Request REST API for YARN

[jira] [Commented] (YARN-2440) Cgroups should limit YARN containers to cores allocated in yarn-site.xml

2014-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107429#comment-14107429 ] Hadoop QA commented on YARN-2440: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-1458: Attachment: YARN-1458.003.patch In Fair Scheduler, size based weight can cause update thread to hold lock

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107471#comment-14107471 ] zhihai xu commented on YARN-1458: - I uploaded a new patch YARN-1458.003.patch to resolve

[jira] [Commented] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107479#comment-14107479 ] Hadoop QA commented on YARN-2360: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: Screen_Shot_v5.png Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: (was: Screen_Shot_v5.png) Fair Scheduler : Display dynamic fair share for queues on the

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: YARN-2360-v5.patch A new patch that adds description in the fair scheduler .apt.vm file, also

[jira] [Commented] (YARN-2408) Resource Request REST API for YARN

2014-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107563#comment-14107563 ] Hadoop QA commented on YARN-2408: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: (was: YARN-2360-v5.patch) Fair Scheduler : Display dynamic fair share for queues on the

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: Screen_Shot_v5.png Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[jira] [Updated] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2360: -- Attachment: YARN-2360-v5.patch Fair Scheduler : Display dynamic fair share for queues on the scheduler page

[jira] [Created] (YARN-2445) ATS does not reflect changes to uploaded TimelineEntity

2014-08-22 Thread Marcelo Vanzin (JIRA)
Marcelo Vanzin created YARN-2445: Summary: ATS does not reflect changes to uploaded TimelineEntity Key: YARN-2445 URL: https://issues.apache.org/jira/browse/YARN-2445 Project: Hadoop YARN

[jira] [Updated] (YARN-2445) ATS does not reflect changes to uploaded TimelineEntity

2014-08-22 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated YARN-2445: - Attachment: ats2.java ATS does not reflect changes to uploaded TimelineEntity

[jira] [Assigned] (YARN-321) Generic application history service

2014-08-22 Thread Yu Gao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Gao reassigned YARN-321: --- Assignee: Yu Gao Generic application history service ---

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107721#comment-14107721 ] Hadoop QA commented on YARN-1458: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2395) FairScheduler: Preemption timeout should be configurable per queue

2014-08-22 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-2395: -- Attachment: YARN-2395-2.patch Update a new patch which addresses Karthik's latest comments, and also add

[jira] [Updated] (YARN-321) Generic application history service

2014-08-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-321: - Assignee: (was: Yu Gao) Generic application history service ---

[jira] [Commented] (YARN-2360) Fair Scheduler : Display dynamic fair share for queues on the scheduler page

2014-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107754#comment-14107754 ] Hadoop QA commented on YARN-2360: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1326) RM should log using RMStore at startup time

2014-08-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi OZAWA updated YARN-1326: - Attachment: YARN-1326.4.patch Fixed failures of TestRMWebServices. RM should log using RMStore

[jira] [Commented] (YARN-2395) FairScheduler: Preemption timeout should be configurable per queue

2014-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107785#comment-14107785 ] Hadoop QA commented on YARN-2395: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-1458: Attachment: YARN-1458.004.patch In Fair Scheduler, size based weight can cause update thread to hold lock

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107807#comment-14107807 ] zhihai xu commented on YARN-1458: - I uploaded a new patch YARN-1458.004.patch to fix the

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107806#comment-14107806 ] Hadoop QA commented on YARN-1326: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2445) ATS does not reflect changes to uploaded TimelineEntity

2014-08-22 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107808#comment-14107808 ] Billie Rinaldi commented on YARN-2445: -- ATS is only designed to support aggregation.

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107822#comment-14107822 ] Hadoop QA commented on YARN-1458: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1326) RM should log using RMStore at startup time

2014-08-22 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107823#comment-14107823 ] Tsuyoshi OZAWA commented on YARN-1326: -- A patch is ready for review. [~kkambatl], .

[jira] [Updated] (YARN-2035) FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode

2014-08-22 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-2035: -- Attachment: YARN-2035-v3.patch Addressed failing tests with last patch.

[jira] [Commented] (YARN-1458) In Fair Scheduler, size based weight can cause update thread to hold lock indefinitely

2014-08-22 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107851#comment-14107851 ] zhihai xu commented on YARN-1458: - The test failure is not related to my change.

[jira] [Commented] (YARN-2035) FileSystemApplicationHistoryStore blocks RM and AHS while NN is in safemode

2014-08-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107852#comment-14107852 ] Hadoop QA commented on YARN-2035: - {color:green}+1 overall{color}. Here are the results of

  1   2   >