[jira] [Created] (YARN-1190) enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

2013-09-12 Thread Siqi Li (JIRA)
Siqi Li created YARN-1190: - Summary: enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb Key: YARN-1190 URL:

[jira] [Updated] (YARN-1190) enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

2013-09-12 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1190: -- Description: Since there is no reducer, the memory allocated to reducer is irrelevant to enable uber mode of a

[jira] [Reopened] (YARN-1190) enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

2013-09-16 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reopened YARN-1190: --- enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than

[jira] [Resolved] (YARN-1190) enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

2013-09-16 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li resolved YARN-1190. --- Resolution: Fixed enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be

[jira] [Updated] (YARN-1190) enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

2013-09-16 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1190: -- Attachment: YARN-1190_v1.patch.txt enabling uber mde with 0 reducer still requires

[jira] [Resolved] (YARN-1190) enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

2013-09-16 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li resolved YARN-1190. --- Resolution: Fixed enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be

[jira] [Reopened] (YARN-1190) enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

2013-09-16 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reopened YARN-1190: --- enabling uber mde with 0 reducer still requires mapreduce.reduce.memory.mb to be less than

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-23 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13774765#comment-13774765 ] Siqi Li commented on YARN-1221: --- According to the fairsheduler log, 2013-09-23 17:32:30,593

[jira] [Updated] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-25 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1221: -- Attachment: YARN1221_v1.patch.txt With Fair Scheduler, reserved MB reported in RM web UI increases

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-25 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13778196#comment-13778196 ] Siqi Li commented on YARN-1221: --- {code} - getMetrics().reserveResource(app.getUser(), -

[jira] [Created] (YARN-2366) Speed up history server startup time

2014-07-28 Thread Siqi Li (JIRA)
Siqi Li created YARN-2366: - Summary: Speed up history server startup time Key: YARN-2366 URL: https://issues.apache.org/jira/browse/YARN-2366 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-2366) Speed up history server startup time

2014-07-28 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2366: -- Description: When history server starts up, It scans every history directories and put all history files into a

[jira] [Assigned] (YARN-2366) Speed up history server startup time

2014-07-28 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reassigned YARN-2366: - Assignee: Siqi Li Speed up history server startup time

[jira] [Updated] (YARN-2366) Speed up history server startup time

2014-07-28 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2366: -- Attachment: YARN-2366.v1.patch Speed up history server startup time

[jira] [Updated] (YARN-2379) Scheduler UI can't sort by field 9(total memory) in both 2.0.5 and 2.4

2014-08-01 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2379: -- Affects Version/s: 2.0.5-alpha 2.4.0 Scheduler UI can't sort by field 9(total memory)

[jira] [Created] (YARN-2379) Scheduler UI can't sort by field 9(total memory) in both 2.0.5 and 2.4

2014-08-01 Thread Siqi Li (JIRA)
Siqi Li created YARN-2379: - Summary: Scheduler UI can't sort by field 9(total memory) in both 2.0.5 and 2.4 Key: YARN-2379 URL: https://issues.apache.org/jira/browse/YARN-2379 Project: Hadoop YARN

[jira] [Updated] (YARN-2379) Scheduler UI can't sort by field 9(total memory) in both 2.0.5 and 2.4

2014-08-01 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2379: -- Attachment: YARN-2379.v1.patch Scheduler UI can't sort by field 9(total memory) in both 2.0.5 and 2.4

[jira] [Assigned] (YARN-2379) Scheduler UI can't sort by field 9(total memory) in both 2.0.5 and 2.4

2014-08-01 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reassigned YARN-2379: - Assignee: Siqi Li Scheduler UI can't sort by field 9(total memory) in both 2.0.5 and 2.4

[jira] [Updated] (YARN-2379) Scheduler UI can't sort by field 9(total memory) in both 2.0.5 and 2.4

2014-08-01 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2379: -- Description: sorting field 9 total memory in Scheduler UI doesn't work correctly Scheduler UI can't sort by

[jira] [Created] (YARN-2417) Sorting by total memory doesn't work correctly

2014-08-13 Thread Siqi Li (JIRA)
Siqi Li created YARN-2417: - Summary: Sorting by total memory doesn't work correctly Key: YARN-2417 URL: https://issues.apache.org/jira/browse/YARN-2417 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-2417) Sorting by total memory doesn't work correctly

2014-08-13 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reassigned YARN-2417: - Assignee: Siqi Li Sorting by total memory doesn't work correctly

[jira] [Updated] (YARN-2417) Sorting by total memory doesn't work correctly

2014-08-13 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2417: -- Affects Version/s: 2.4.0 Sorting by total memory doesn't work correctly

[jira] [Updated] (YARN-2417) Sorting by total memory doesn't work correctly

2014-08-13 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2417: -- Attachment: YARN-2417.v1.patch Sorting by total memory doesn't work correctly

[jira] [Updated] (YARN-2417) Adding total Memory into AppsBlocks

2014-08-13 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2417: -- Summary: Adding total Memory into AppsBlocks (was: Sorting by total memory doesn't work correctly) Adding

[jira] [Commented] (YARN-2417) Adding total Memory into AppsBlocks

2014-08-13 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096374#comment-14096374 ] Siqi Li commented on YARN-2417: --- I think so, but that one didn't get committed yet. Adding

[jira] [Resolved] (YARN-1715) Per queue view in RM is not implemented correctly

2014-10-01 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li resolved YARN-1715. --- Resolution: Duplicate Per queue view in RM is not implemented correctly

[jira] [Updated] (YARN-1391) Lost node list should be identify by NodeId

2014-10-01 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1391: -- Attachment: YARN-1391.v2.patch Lost node list should be identify by NodeId

[jira] [Commented] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

2014-10-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156814#comment-14156814 ] Siqi Li commented on YARN-1414: --- Sure, I will submit a rebased patch shortly. with Fair

[jira] [Commented] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

2014-10-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156892#comment-14156892 ] Siqi Li commented on YARN-1414: --- I just found out that this problem has been fixed in the

[jira] [Updated] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2730: -- Description: The synchronized modifier appears to have been added by

[jira] [Created] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
Siqi Li created YARN-2730: - Summary: Only one localizer can run on a NodeManager at a time Key: YARN-2730 URL: https://issues.apache.org/jira/browse/YARN-2730 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2730: -- Description: We are seeing that when one of the localizerRunner stuck, the rest of the localizerRunners are

[jira] [Assigned] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reassigned YARN-2730: - Assignee: Siqi Li Only one localizer can run on a NodeManager at a time

[jira] [Updated] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2730: -- Affects Version/s: (was: 2.5.0) 2.4.0 Only one localizer can run on a NodeManager at

[jira] [Updated] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2730: -- Affects Version/s: 2.5.0 Only one localizer can run on a NodeManager at a time

[jira] [Updated] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2730: -- Attachment: YARN-2730.v1.patch Only one localizer can run on a NodeManager at a time

[jira] [Commented] (YARN-2730) Only one localizer can run on a NodeManager at a time

2014-10-22 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14180768#comment-14180768 ] Siqi Li commented on YARN-2730: --- in case of YARN-2714, all localizerRunner thread are getting

[jira] [Updated] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

2014-03-04 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1414: -- Attachment: YARN-1221-v2.patch with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

[jira] [Created] (YARN-1896) For FairScheduler expose MinimumQueueResource of each queu in QueueMetrics

2014-03-31 Thread Siqi Li (JIRA)
Siqi Li created YARN-1896: - Summary: For FairScheduler expose MinimumQueueResource of each queu in QueueMetrics Key: YARN-1896 URL: https://issues.apache.org/jira/browse/YARN-1896 Project: Hadoop YARN

[jira] [Updated] (YARN-1896) For FairScheduler expose MinimumQueueResource of each queu in QueueMetrics

2014-03-31 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1896: -- Attachment: YARN-1896.v1.patch For FairScheduler expose MinimumQueueResource of each queu in QueueMetrics

[jira] [Updated] (YARN-1896) For FairScheduler expose MinimumQueueResource of each queu in QueueMetrics

2014-04-01 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1896: -- Description: For FairScheduler, it's very useful to expose MinimumQueueResource and MaximumQueueResource of

[jira] [Resolved] (YARN-1190) enabling uber mode with 0 reducer still requires mapreduce.reduce.memory.mb to be less than yarn.app.mapreduce.am.resource.mb

2014-04-14 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li resolved YARN-1190. --- Resolution: Duplicate Assignee: Siqi Li enabling uber mode with 0 reducer still requires

[jira] [Commented] (YARN-1391) Lost node list should be identify by NodeId

2014-04-14 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13968906#comment-13968906 ] Siqi Li commented on YARN-1391: --- I think this patch can still be applied to the trunk Lost

[jira] [Resolved] (YARN-1415) In scheduler UI, including used memory in Memory Total seems to be inaccurate

2014-04-14 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li resolved YARN-1415. --- Resolution: Not a Problem In scheduler UI, including used memory in Memory Total seems to be inaccurate

[jira] [Commented] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

2014-04-14 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13968909#comment-13968909 ] Siqi Li commented on YARN-1414: --- For now, this patch is able to update leaf queues and root

[jira] [Created] (YARN-1945) Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml

2014-04-15 Thread Siqi Li (JIRA)
Siqi Li created YARN-1945: - Summary: Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml Key: YARN-1945 URL: https://issues.apache.org/jira/browse/YARN-1945 Project: Hadoop YARN

[jira] [Updated] (YARN-1896) For FairScheduler expose MinimumQueueResource of each queue in QueueMetrics

2014-04-23 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1896: -- Summary: For FairScheduler expose MinimumQueueResource of each queue in QueueMetrics (was: For FairScheduler

[jira] [Updated] (YARN-1945) Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml

2014-04-28 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1945: -- Attachment: YARN-1945.v1.patch Adding description for each pool in Fair Scheduler Page from

[jira] [Updated] (YARN-1945) Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml

2014-04-28 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1945: -- Attachment: (was: YARN-1945.v1.patch) Adding description for each pool in Fair Scheduler Page from

[jira] [Updated] (YARN-1945) Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml

2014-04-28 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1945: -- Attachment: YARN-1945.v2.patch Adding description for each pool in Fair Scheduler Page from

[jira] [Updated] (YARN-1945) Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml

2014-05-01 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1945: -- Attachment: YARN-1945.v3.patch Adding description for each pool in Fair Scheduler Page from

[jira] [Commented] (YARN-1945) Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml

2014-05-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13987971#comment-13987971 ] Siqi Li commented on YARN-1945: --- [~sjlee0] do you know what does that -1 javac mean? Adding

[jira] [Updated] (YARN-1945) Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml

2014-05-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1945: -- Attachment: (was: YARN-1945.v3.patch) Adding description for each pool in Fair Scheduler Page from

[jira] [Updated] (YARN-1945) Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml

2014-05-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1945: -- Attachment: YARN-1945.v4.patch Adding description for each pool in Fair Scheduler Page from

[jira] [Updated] (YARN-1945) Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml

2014-05-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1945: -- Attachment: YARN-1945.v5.patch Adding description for each pool in Fair Scheduler Page from

[jira] [Updated] (YARN-1896) For FairScheduler expose MinimumQueueResource of each queue in QueueMetrics

2014-05-05 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1896: -- Attachment: YARN-1896.v2.patch For FairScheduler expose MinimumQueueResource of each queue in QueueMetrics

[jira] [Updated] (YARN-2108) Show minShare on RM Scheduler page

2014-05-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2108: -- Description: Today RM Scheduler page shows FairShare, Used, Used (over fair share) and MaxCapacity. It would

[jira] [Updated] (YARN-2108) Show minShare on RM Fair Scheduler page

2014-05-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2108: -- Attachment: YARN-2108.v1.patch Show minShare on RM Fair Scheduler page

[jira] [Updated] (YARN-2108) Show minShare on RM Fair Scheduler page

2014-05-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2108: -- Attachment: YARN-2108.v2.patch Show minShare on RM Fair Scheduler page

[jira] [Created] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-02 Thread Siqi Li (JIRA)
Siqi Li created YARN-2120: - Summary: Coloring queues running over minShare on RM Scheduler page Key: YARN-2120 URL: https://issues.apache.org/jira/browse/YARN-2120 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2120: -- Description: Today RM Scheduler page shows FairShare, Used, Used (over fair share) and MaxCapacity. Since

[jira] [Updated] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2120: -- Attachment: AD45B623-9F14-420B-B1FB-1186E2B5EC4A.png Coloring queues running over minShare on RM Scheduler

[jira] [Resolved] (YARN-2108) Show minShare on RM Fair Scheduler page

2014-06-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li resolved YARN-2108. --- Resolution: Duplicate Show minShare on RM Fair Scheduler page ---

[jira] [Reopened] (YARN-2108) Show minShare on RM Fair Scheduler page

2014-06-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reopened YARN-2108: --- Show minShare on RM Fair Scheduler page --- Key:

[jira] [Commented] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14015732#comment-14015732 ] Siqi Li commented on YARN-2120: --- Attached screenshot for proposed coloring scheme Coloring

[jira] [Resolved] (YARN-2108) Show minShare on RM Fair Scheduler page

2014-06-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li resolved YARN-2108. --- Resolution: Duplicate Show minShare on RM Fair Scheduler page ---

[jira] [Updated] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2120: -- Attachment: YARN-2120.v1.patch Coloring queues running over minShare on RM Scheduler page

[jira] [Commented] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-02 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14016066#comment-14016066 ] Siqi Li commented on YARN-2120: --- [~ashwinshankar77] thanks for your feedback, let me see if I

[jira] [Updated] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-05 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2120: -- Attachment: 1595210E-C2D6-42D3-8C1D-73DFF1614CF9.png Coloring queues running over minShare on RM Scheduler

[jira] [Updated] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-05 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2120: -- Attachment: (was: AD45B623-9F14-420B-B1FB-1186E2B5EC4A.png) Coloring queues running over minShare on RM

[jira] [Commented] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-05 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019494#comment-14019494 ] Siqi Li commented on YARN-2120: --- [~ashwinshankar77] I have attached a new screenshot, which

[jira] [Updated] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2120: -- Attachment: 76AD6A72-9A0D-4F3A-A7B8-6EC1DCBD543A.png Coloring queues running over minShare on RM Scheduler

[jira] [Updated] (YARN-2120) Coloring queues running over minShare on RM Scheduler page

2014-06-06 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2120: -- Attachment: YARN-2120.v2.patch Coloring queues running over minShare on RM Scheduler page

[jira] [Created] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
Siqi Li created YARN-2281: - Summary: In RM webUI, apps are failed with inconsistent state and final state Key: YARN-2281 URL: https://issues.apache.org/jira/browse/YARN-2281 Project: Hadoop YARN

[jira] [Updated] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2281: -- Attachment: 3A0CA0E7-C070-4E18-A07C-E516AB959419.png In RM webUI, apps are failed with inconsistent state and

[jira] [Updated] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2281: -- Affects Version/s: 2.4.0 In RM webUI, apps are failed with inconsistent state and final state

[jira] [Updated] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-2281: -- Description: In the attached image, there are jobs failed, but their states are marked as finished. In RM

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059273#comment-14059273 ] Siqi Li commented on YARN-2281: --- [~jianhe] thanks for your explanation. If the state and

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059322#comment-14059322 ] Siqi Li commented on YARN-2281: --- If this is expected, then it doesn't quite make sense.

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059339#comment-14059339 ] Siqi Li commented on YARN-2281: --- yes, queue metrics currently will see this as completed

[jira] [Commented] (YARN-2281) In RM webUI, apps are failed with inconsistent state and final state

2014-07-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059412#comment-14059412 ] Siqi Li commented on YARN-2281: --- I see, thank you [~jianhe] In RM webUI, apps are failed

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-26 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13779030#comment-13779030 ] Siqi Li commented on YARN-1221: --- It will affect the amount shown in the web UI, since they

[jira] [Updated] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-26 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1221: -- Attachment: YARN1221_v2.patch.txt I've added a unit test. The reason I removed the following line is that

[jira] [Updated] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1221: -- Attachment: YARN1221_v3.patch.txt With Fair Scheduler, reserved MB reported in RM web UI increases

[jira] [Updated] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1221: -- Attachment: YARN1221_v4.patch With Fair Scheduler, reserved MB reported in RM web UI increases

[jira] [Updated] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-27 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1221: -- Attachment: YARN1221_v5.patch With Fair Scheduler, reserved MB reported in RM web UI increases

[jira] [Updated] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-30 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1221: -- Attachment: YARN1221_v6.patch With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-09-30 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13782324#comment-13782324 ] Siqi Li commented on YARN-1221: --- you are welcome With Fair Scheduler, reserved MB reported

[jira] [Created] (YARN-1391) Lost node list contains many active node with different port

2013-11-05 Thread Siqi Li (JIRA)
Siqi Li created YARN-1391: - Summary: Lost node list contains many active node with different port Key: YARN-1391 URL: https://issues.apache.org/jira/browse/YARN-1391 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-1391) Lost node list contains many active node with different port

2013-11-05 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1391: -- Description: When restarting node manager, the active node list in webUI will contain duplicate entries. Such

[jira] [Updated] (YARN-1391) Lost node list contains many active node with different port

2013-11-05 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1391: -- Component/s: resourcemanager Lost node list contains many active node with different port

[jira] [Updated] (YARN-1391) Lost node list contains many active node with different port

2013-11-05 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1391: -- Affects Version/s: 2.0.5-alpha Lost node list contains many active node with different port

[jira] [Commented] (YARN-1221) With Fair Scheduler, reserved MB reported in RM web UI increases indefinitely

2013-11-11 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13819565#comment-13819565 ] Siqi Li commented on YARN-1221: --- It seems that there is another place that leaking reserved

[jira] [Created] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

2013-11-15 Thread Siqi Li (JIRA)
Siqi Li created YARN-1414: - Summary: with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs Key: YARN-1414 URL: https://issues.apache.org/jira/browse/YARN-1414 Project: Hadoop YARN

[jira] [Updated] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

2013-11-15 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1414: -- Attachment: YARN-1221-subtask.v1.patch.txt with Fair Scheduler reserved MB in WebUI is leaking when killing

[jira] [Updated] (YARN-1414) with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

2013-11-15 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1414: -- Affects Version/s: 2.0.5-alpha with Fair Scheduler reserved MB in WebUI is leaking when killing waiting jobs

[jira] [Created] (YARN-1415) In scheduler UI, including used memory in Memory Total seems to be inaccurate

2013-11-15 Thread Siqi Li (JIRA)
Siqi Li created YARN-1415: - Summary: In scheduler UI, including used memory in Memory Total seems to be inaccurate Key: YARN-1415 URL: https://issues.apache.org/jira/browse/YARN-1415 Project: Hadoop YARN

[jira] [Updated] (YARN-1415) In scheduler UI, including used memory in Memory Total seems to be inaccurate

2013-11-15 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1415: -- Attachment: 2.png 1.png In scheduler UI, including used memory in Memory Total seems to be

[jira] [Updated] (YARN-1415) In scheduler UI, including used memory in Memory Total seems to be inaccurate

2013-11-15 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated YARN-1415: -- Description: Memory Total is currently a sum of availableMB, allocatedMB, and reservedMB. It seems that the

[jira] [Commented] (YARN-1415) In scheduler UI, including used memory in Memory Total seems to be inaccurate

2013-11-15 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13824154#comment-13824154 ] Siqi Li commented on YARN-1415: --- The first image shows that no job is running, and total

  1   2   3   4   >