[jira] [Commented] (YARN-1197) Add container merge support in YARN

2013-09-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766343#comment-13766343 ] Wangda Tan commented on YARN-1197: -- I don't know is it possible to add this in RM or NM

[jira] [Created] (YARN-1197) Add container merge support in YARN

2013-09-13 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1197: Summary: Add container merge support in YARN Key: YARN-1197 URL: https://issues.apache.org/jira/browse/YARN-1197 Project: Hadoop YARN Issue Type: Task

[jira] [Commented] (YARN-1197) Add container merge support in YARN

2013-09-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13767242#comment-13767242 ] Wangda Tan commented on YARN-1197: -- Hi Bikas, Thanks for reply, it helps me understanding

[jira] [Commented] (YARN-1197) Support increasing resources of an allocated container

2013-09-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13769256#comment-13769256 ] Wangda Tan commented on YARN-1197: -- {quote} Increasing resources for a container while in

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-09-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13770380#comment-13770380 ] Wangda Tan commented on YARN-1197: -- I totally agree with you, I'll work out a plan

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2013-09-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1197: - Attachment: yarn-1197.pdf Added a initial proposal for it, include increase/decrease a aquired or running

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063156#comment-14063156 ] Wangda Tan commented on YARN-2297: -- Hi [~chris.douglas], Thanks for your jumping in, bq.

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063249#comment-14063249 ] Wangda Tan commented on YARN-2297: -- Hi [~chris.douglas], Thanks for your reply, I think

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063255#comment-14063255 ] Wangda Tan commented on YARN-2297: -- Hi [~sunilg], Thanks for providing thoughts here! For

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063316#comment-14063316 ] Wangda Tan commented on YARN-796: - Hi [~john.jian.fang], Thanks for providing use cases. bq.

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063324#comment-14063324 ] Wangda Tan commented on YARN-796: - Hi [~sunilg], Thanks for reply, bq. 1. In our use case

[jira] [Commented] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063721#comment-14063721 ] Wangda Tan commented on YARN-2257: -- Hi [~sandyr], Thanks for pointing me this, I have a

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063725#comment-14063725 ] Wangda Tan commented on YARN-2285: -- Thanks comments from Vinod and Sunil, bq. From the

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064483#comment-14064483 ] Wangda Tan commented on YARN-415: - Hi [~eepayne], bq. Since every RMAppAttemptImpl object

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064492#comment-14064492 ] Wangda Tan commented on YARN-2285: -- I've verified this will still happen even if

[jira] [Commented] (YARN-2257) Add user to queue mappings to automatically place users' apps into specific queues

2014-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064512#comment-14064512 ] Wangda Tan commented on YARN-2257: -- Hi [~sandyr], I agree we should have an existing

[jira] [Commented] (YARN-2305) When a container is in reserved state then total cluster memory is displayed wrongly.

2014-07-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064749#comment-14064749 ] Wangda Tan commented on YARN-2305: -- Hi [~sunilg], Thanks for taking this issue, I think

[jira] [Created] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-07-17 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2308: Summary: NPE happened when RM restart after CapacityScheduler queue configuration changed Key: YARN-2308 URL: https://issues.apache.org/jira/browse/YARN-2308 Project:

[jira] [Updated] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-07-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2308: - Priority: Critical (was: Major) NPE happened when RM restart after CapacityScheduler queue

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065910#comment-14065910 ] Wangda Tan commented on YARN-415: - Hi [~eepayne], Thanks for updating your patch, the failed

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066145#comment-14066145 ] Wangda Tan commented on YARN-415: - Hi [~eepayne], I've spent some time to review and think

[jira] [Commented] (YARN-2305) When a container is in reserved state then total cluster memory is displayed wrongly.

2014-07-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066154#comment-14066154 ] Wangda Tan commented on YARN-2305: -- Thanks for your elaboration, I understand now, I think

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-07-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066156#comment-14066156 ] Wangda Tan commented on YARN-2308: -- I think it should doable, queue of application missing

[jira] [Commented] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

2014-07-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067542#comment-14067542 ] Wangda Tan commented on YARN-2008: -- Hi [~cwelch], Thanks for working on this patch.

[jira] [Commented] (YARN-2297) Preemption can prevent progress in small queues

2014-07-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067544#comment-14067544 ] Wangda Tan commented on YARN-2297: -- bq. I feel this can create a little bit more

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068116#comment-14068116 ] Wangda Tan commented on YARN-796: - Really thanks all your comments above, As Sandy,

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068124#comment-14068124 ] Wangda Tan commented on YARN-796: - Hi Alejandro, I totally understand the use case I

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068145#comment-14068145 ] Wangda Tan commented on YARN-796: - Alejandro, I think we've mentioned this in our design

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068147#comment-14068147 ] Wangda Tan commented on YARN-1198: -- I've just taken a look at all sub tasks of this JIRA,

[jira] [Commented] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

2014-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068148#comment-14068148 ] Wangda Tan commented on YARN-2008: -- Hi [~cwelch], [~airbots], I've put my comment on

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068163#comment-14068163 ] Wangda Tan commented on YARN-796: - Hi [~sunilg], bq. 2. Regarding reservations, how about

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068184#comment-14068184 ] Wangda Tan commented on YARN-796: - bq. You can solve this problem today by just running

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068248#comment-14068248 ] Wangda Tan commented on YARN-796: - Allen, I think what we was just talking about is how to

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069615#comment-14069615 ] Wangda Tan commented on YARN-796: - Hi Tucu, Thanks for providing thoughts about how to stage

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069619#comment-14069619 ] Wangda Tan commented on YARN-796: - Jian Fang, I think it's make sense to make RM has a

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-07-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069651#comment-14069651 ] Wangda Tan commented on YARN-1198: -- I agree with [~jlowe], [~airbots] and [~cwelch], used

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14072696#comment-14072696 ] Wangda Tan commented on YARN-415: - Hi Eric, Thanks for updating your patch, I think now

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-07-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073899#comment-14073899 ] Wangda Tan commented on YARN-2308: -- [~lichangleo], thanks for working on it! Looking

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074094#comment-14074094 ] Wangda Tan commented on YARN-415: - Hi Eric, Thanks for updating your patch again, *To your

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074249#comment-14074249 ] Wangda Tan commented on YARN-2069: -- Hi [~mayank_bansal], Thanks for working on this again.

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075220#comment-14075220 ] Wangda Tan commented on YARN-2069: -- Hi Mayank, Thanks for your detailed explanation, I

[jira] [Commented] (YARN-2362) Capacity Scheduler: apps with requests that exceed current capacity can starve pending apps

2014-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075970#comment-14075970 ] Wangda Tan commented on YARN-2362: -- I think we should fix this, {code} if

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076042#comment-14076042 ] Wangda Tan commented on YARN-1707: -- Thanks for uploading the patch [~curino], [~subru].

[jira] [Commented] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

2014-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076062#comment-14076062 ] Wangda Tan commented on YARN-2008: -- Hi Craig, As we discussed in YARN-1198, I think we

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077254#comment-14077254 ] Wangda Tan commented on YARN-1707: -- Hi [~subru], Thanks for your elaboration, it is very

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077262#comment-14077262 ] Wangda Tan commented on YARN-415: - Hi [~eepayne], Thanks for updating your patch, For e2e

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077296#comment-14077296 ] Wangda Tan commented on YARN-1707: -- Hi [~curino], Thanks for your reply, For regarding how

[jira] [Updated] (YARN-2215) Add preemption info to REST/CLI

2014-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2215: - Assignee: Kenji Kikushima Add preemption info to REST/CLI ---

[jira] [Commented] (YARN-2215) Add preemption info to REST/CLI

2014-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077303#comment-14077303 ] Wangda Tan commented on YARN-2215: -- Hi [~kj-ki], Thanks for working on this, I've assigned

[jira] [Commented] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

2014-07-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080388#comment-14080388 ] Wangda Tan commented on YARN-2008: -- Hi [~cwelch], Thanks for uploading patch, +1 for

[jira] [Commented] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

2014-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081718#comment-14081718 ] Wangda Tan commented on YARN-2008: -- Hi [~cwelch], I found the patch you updated is

[jira] [Commented] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

2014-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081844#comment-14081844 ] Wangda Tan commented on YARN-2008: -- Hi [~cwelch], Thanks for updating, now tests can cover

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-07-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14081845#comment-14081845 ] Wangda Tan commented on YARN-2069: -- Hi [~mayank_bansal], Thanks for uploading, reviewing

[jira] [Commented] (YARN-2008) CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

2014-08-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084245#comment-14084245 ] Wangda Tan commented on YARN-2008: -- Thanks [~cwelch] for updating, LGTM, +1 Wangda

[jira] [Commented] (YARN-2069) CS queue level preemption should respect user-limits

2014-08-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084279#comment-14084279 ] Wangda Tan commented on YARN-2069: -- Hi [~mayank_bansal], Thanks for your patience. I've

[jira] [Commented] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler

2014-08-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087723#comment-14087723 ] Wangda Tan commented on YARN-2378: -- Hi [~subru], Thanks for uploading patch, I took a

[jira] [Commented] (YARN-2248) Capacity Scheduler changes for moving apps between queues

2014-08-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088912#comment-14088912 ] Wangda Tan commented on YARN-2248: -- [~keyki], I agree we should get move-app committed in

[jira] [Commented] (YARN-2249) RM may receive container release request on AM resync before container is actually recovered

2014-08-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088965#comment-14088965 ] Wangda Tan commented on YARN-2249: -- Hi [~jianhe], Thanks for working on the patch, I've

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-08-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089002#comment-14089002 ] Wangda Tan commented on YARN-415: - Hi Eric, Thanks for your hard working to add to add these

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2014-08-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090098#comment-14090098 ] Wangda Tan commented on YARN-807: - Hi [~sandyr], While reading comment of YARN-2385:

[jira] [Commented] (YARN-2385) Adding support for listing all applications in a queue

2014-08-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090100#comment-14090100 ] Wangda Tan commented on YARN-2385: -- Hi Subru, I've commented on YARN-807,

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2014-08-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090183#comment-14090183 ] Wangda Tan commented on YARN-807: - Hi [~sandyr], Thanks for your comment. If you think it's

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-08-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090250#comment-14090250 ] Wangda Tan commented on YARN-415: - Hi [~eepayne], It's great to have so much cleanups in

[jira] [Commented] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler

2014-08-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090314#comment-14090314 ] Wangda Tan commented on YARN-2378: -- Hi [~subru], It's good to have more test from

[jira] [Commented] (YARN-2249) RM may receive container release request on AM resync before container is actually recovered

2014-08-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090318#comment-14090318 ] Wangda Tan commented on YARN-2249: -- Hi [~jianhe], Thanks for update, several minor

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2014-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090440#comment-14090440 ] Wangda Tan commented on YARN-807: - bq. It's also worth considering only holding this map for

[jira] [Commented] (YARN-807) When querying apps by queue, iterating over all apps is inefficient and limiting

2014-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090455#comment-14090455 ] Wangda Tan commented on YARN-807: - Hi Sandy, Thanks for your elaboration. As you said, I

[jira] [Commented] (YARN-2249) RM may receive container release request on AM resync before container is actually recovered

2014-08-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091658#comment-14091658 ] Wangda Tan commented on YARN-2249: -- Jian, Thanks for update, My last comment is, Could

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092301#comment-14092301 ] Wangda Tan commented on YARN-2308: -- [~lichangleo], Thanks for working on this, I took a

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092303#comment-14092303 ] Wangda Tan commented on YARN-415: - [~eepayne], bq. I created a common method that both of

[jira] [Commented] (YARN-2378) Adding support for moving apps between queues in Capacity Scheduler

2014-08-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093695#comment-14093695 ] Wangda Tan commented on YARN-2378: -- [~subru], I've ran the previous failed test locally,

[jira] [Commented] (YARN-415) Capture memory utilization at the app-level for chargeback

2014-08-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093696#comment-14093696 ] Wangda Tan commented on YARN-415: - [~jianhe], would you like to take a look at it? Capture

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093714#comment-14093714 ] Wangda Tan commented on YARN-2308: -- [~lichangleo], Thanks for updating, I think following

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14094999#comment-14094999 ] Wangda Tan commented on YARN-2308: -- Hi Zhijie, Thanks for looking at this issue, bq. It

[jira] [Commented] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-08-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095039#comment-14095039 ] Wangda Tan commented on YARN-2414: -- Assigned it to myself, will post a patch soon RM web

[jira] [Assigned] (YARN-2414) RM web UI: app page will crash if app is failed before any attempt has been created

2014-08-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2414: Assignee: Wangda Tan RM web UI: app page will crash if app is failed before any attempt has been

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095050#comment-14095050 ] Wangda Tan commented on YARN-2308: -- bq. I think we should catch exception in following

[jira] [Commented] (YARN-2308) NPE happened when RM restart after CapacityScheduler queue configuration changed

2014-08-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14095055#comment-14095055 ] Wangda Tan commented on YARN-2308: -- Typo: bq. We cannot catch exception here, because now

[jira] [Commented] (YARN-2385) Adding support for listing all applications in a queue

2014-08-13 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096329#comment-14096329 ] Wangda Tan commented on YARN-2385: -- I think we might not need maintain completed apps CS

[jira] [Commented] (YARN-2411) [Capacity Scheduler] support simple user and group mappings to queues

2014-08-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100316#comment-14100316 ] Wangda Tan commented on YARN-2411: -- Ram, Thanks for updating, LGTM, +1. Wangda

[jira] [Updated] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-08-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-796: Attachment: YARN-796.node-label.demo.patch.1 Hi guys, Thanks for your input in the past several weeks, I

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-08-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104926#comment-14104926 ] Wangda Tan commented on YARN-796: - bq. As I've said before, I basically want something

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-08-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104931#comment-14104931 ] Wangda Tan commented on YARN-2056: -- May a another way to do this is add a config in per

[jira] [Updated] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2434: - Summary: RM should not recover containers from previously failed attempt when AM restart is not enabled

[jira] [Commented] (YARN-2434) RM should not recover containers from previously failed attempt when AM restart is not enabled

2014-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105116#comment-14105116 ] Wangda Tan commented on YARN-2434: -- Jian, thanks for the patch, LGTM +1 RM should not

[jira] [Commented] (YARN-2433) Stale token used by restarted AM (with previous containers retained) to request new container

2014-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105119#comment-14105119 ] Wangda Tan commented on YARN-2433: -- [~yingdachen], thanks for reporting this issue, I can

[jira] [Commented] (YARN-2345) yarn rmadmin -report

2014-08-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106669#comment-14106669 ] Wangda Tan commented on YARN-2345: -- Hi Hao, I think we already have a NodeCLI, which is

[jira] [Commented] (YARN-2345) yarn rmadmin -report

2014-08-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108645#comment-14108645 ] Wangda Tan commented on YARN-2345: -- [~aw], I agree with you, user doesn't need understand

[jira] [Commented] (YARN-2385) Consider splitting getAppsinQueue to getRunningAppsInQueue + getPendingAppsInQueue

2014-08-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108646#comment-14108646 ] Wangda Tan commented on YARN-2385: -- I think splitting them to two APIs make sense to me.

[jira] [Commented] (YARN-2448) RM should expose the name of the ResourceCalculator being used when AMs register

2014-08-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108822#comment-14108822 ] Wangda Tan commented on YARN-2448: -- [~vvasudev], Thanks for working on the patch, it is

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108932#comment-14108932 ] Wangda Tan commented on YARN-1707: -- Hi [~curino], Thanks for updating, I just took a look,

[jira] [Commented] (YARN-1198) Capacity Scheduler headroom calculation does not work as expected

2014-08-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14108991#comment-14108991 ] Wangda Tan commented on YARN-1198: -- Hi [~cwelch], Thanks for updating, I went through your

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-08-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113124#comment-14113124 ] Wangda Tan commented on YARN-2056: -- Hi [~eepayne], Really sorry to come late, thanks for

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113147#comment-14113147 ] Wangda Tan commented on YARN-1707: -- Hi [~curino], Thanks for updating, I think current

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113187#comment-14113187 ] Wangda Tan commented on YARN-1707: -- Thanks for sharing this, Carlo! It's very helpful to

[jira] [Commented] (YARN-2447) RM web services app submission doesn't pass secrets correctly

2014-08-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14113515#comment-14113515 ] Wangda Tan commented on YARN-2447: -- Hi [~vvasudev], I think the fix is very straight

[jira] [Commented] (YARN-1707) Making the CapacityScheduler more dynamic

2014-08-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116184#comment-14116184 ] Wangda Tan commented on YARN-1707: -- Carlo, thanks updating the patch. In addition to

[jira] [Commented] (YARN-2056) Disable preemption at Queue level

2014-08-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14116613#comment-14116613 ] Wangda Tan commented on YARN-2056: -- Hi [~eepayne], Thanks for updating your patch, bq. Do

[jira] [Commented] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-09-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119515#comment-14119515 ] Wangda Tan commented on YARN-796: - Hi [~ViplavMadasu] Really thanks for reviewing patch and

[jira] [Updated] (YARN-796) Allow for (admin) labels on nodes and resource-requests

2014-09-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-796: Attachment: YARN-796.node-label.consolidate.1.patch Attached latest consolidated patch named

  1   2   3   4   5   6   7   8   9   10   >