[jira] [Assigned] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2285: Assignee: Wangda Tan Assigned it to me, working on this ... Preemption can cause capacity

[jira] [Assigned] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-2297: Assignee: Wangda Tan Preemption can hang in corner case by not allowing any task container to

[jira] [Commented] (YARN-2285) Preemption can cause capacity scheduler to show 5,000% queue capacity.

2014-07-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14062983#comment-14062983 ] Wangda Tan commented on YARN-2285: -- [~tassapola], one question, is the root queue usage

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063010#comment-14063010 ] Wangda Tan commented on YARN-2297: -- Took a look at this issue, there're two issues caused

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13784012#comment-13784012 ] Wangda Tan commented on YARN-1197: -- To [~tucu00], I think the heap size change (Xmx, etc.)

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13784061#comment-13784061 ] Wangda Tan commented on YARN-1197: -- To [~bikassaha], Thanks for your comments, see my

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13784803#comment-13784803 ] Wangda Tan commented on YARN-1197: -- Method mentioned by [~sandyr] can solve cheating

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-10-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13784906#comment-13784906 ] Wangda Tan commented on YARN-1197: -- {quote} For decreasing resources, if the RM is to

[jira] [Assigned] (YARN-1197) Support changing resources of an allocated container

2013-10-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1197: Assignee: Wangda Tan Support changing resources of an allocated container

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2013-10-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1197: - Attachment: yarn-1197-v2.pdf Guys, I attached an updated doc basic on our discussion, mainly focused

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2013-10-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1197: - Attachment: yarn-1197-v3.pdf Support changing resources of an allocated container

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813933#comment-13813933 ] Wangda Tan commented on YARN-1197: -- [~bikassaha] Actually I was on half way of

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2013-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1197: - Attachment: yarn-1197-v4.pdf I updated design doc mainly based on [~bikassaha] latest comment, I left

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-11-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13828374#comment-13828374 ] Wangda Tan commented on YARN-1197: -- [~sandyr] These bunch of code will be hard for review,

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2013-11-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1197: - Attachment: yarn-server-resourcemanager.patch.ver.1 yarn-server-nodemanager.patch.ver.1

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832175#comment-13832175 ] Wangda Tan commented on YARN-1197: -- OK, I'll create a series of JIRAs for easier

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13832211#comment-13832211 ] Wangda Tan commented on YARN-1197: -- Got it, I'll let you know if I have any questions :)

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2013-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1197: - Description: (was: Currently, YARN cannot support merge several containers in one node to a big

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2013-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1197: - Description: The current YARN resource management logic assumes resource allocated to a container is

[jira] [Created] (YARN-1447) Common PB types define for container resource change

2013-11-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1447: Summary: Common PB types define for container resource change Key: YARN-1447 URL: https://issues.apache.org/jira/browse/YARN-1447 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-1448) Protocol changes in RM side to support change container resources

2013-11-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1448: Summary: Protocol changes in RM side to support change container resources Key: YARN-1448 URL: https://issues.apache.org/jira/browse/YARN-1448 Project: Hadoop YARN

[jira] [Created] (YARN-1449) Protocol changes in NM side to support change container resource

2013-11-25 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1449: Summary: Protocol changes in NM side to support change container resource Key: YARN-1449 URL: https://issues.apache.org/jira/browse/YARN-1449 Project: Hadoop YARN

[jira] [Updated] (YARN-1447) Common PB types define for container resource change

2013-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1447: - Attachment: yarn-1447.1.patch Attached patch for review Common PB types define for container resource

[jira] [Updated] (YARN-1448) Protocol changes in RM side to support change container resources

2013-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1448: - Attachment: yarn-1448.1.patch Attached patch for review Protocol changes in RM side to support change

[jira] [Updated] (YARN-1449) Protocol changes in NM side to support change container resource

2013-11-25 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1449: - Attachment: yarn-1449.1.patch Attached patch for review Protocol changes in NM side to support change

[jira] [Commented] (YARN-1447) Common PB types define for container resource change

2013-11-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13835139#comment-13835139 ] Wangda Tan commented on YARN-1447: -- Thanks your review, I agree with your idea, the

[jira] [Updated] (YARN-1447) Common PB types define for container resource change

2013-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1447: - Attachment: yarn-1447.2.patch Attached updated patch according to [~sandyr]'s comments. Common PB types

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-12-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13837559#comment-13837559 ] Wangda Tan commented on YARN-1197: -- +1 for Junping's idea, I'm not sure if we can get

[jira] [Updated] (YARN-1447) Common PB types define for container resource change

2013-12-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1447: - Attachment: yarn-1447.3.patch Thanks Sandy's suggestions, attached updated patch Common PB types define

[jira] [Updated] (YARN-1447) Common PB types define for container resource change

2013-12-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1447: - Attachment: yarn-1447.4.patch Common PB types define for container resource change

[jira] [Updated] (YARN-1447) Common PB types define for container resource change

2013-12-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1447: - Attachment: yarn-1447.5.patch Thanks again, attached patch after fixed findbugs. Common PB types define

[jira] [Updated] (YARN-1448) Protocol changes in RM side to support change container resources

2013-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1448: - Attachment: yarn-1448.2.patch Attached patch updated according to finalized YARN-1447 Protocol changes

[jira] [Updated] (YARN-1449) Protocol changes in NM side to support change container resource

2013-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1449: - Attachment: yarn-1449.3.patch Attached patch updated according to finalized YARN-1447. I also found it's

[jira] [Updated] (YARN-1449) Protocol changes and implementations in NM side to support change container resource

2013-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1449: - Summary: Protocol changes and implementations in NM side to support change container resource (was:

[jira] [Updated] (YARN-1449) Protocol changes and implementations in NM side to support change container resource

2013-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1449: - Description: As described in YARN-1197, we need add API/implementation changes, 1) Add a

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842030#comment-13842030 ] Wangda Tan commented on YARN-1197: -- Guys, I attached patch for YARN-1448 and YARN-1449 for

[jira] [Updated] (YARN-1448) Protocol changes in RM side to support change container resources

2013-12-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1448: - Attachment: yarn-1448.3.patch Thanks Sandy, I attached a patch according to your suggestion. Protocol

[jira] [Commented] (YARN-1448) Protocol changes in RM side to support change container resources

2013-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13842984#comment-13842984 ] Wangda Tan commented on YARN-1448: -- Thanks :) Protocol changes in RM side to support

[jira] [Assigned] (YARN-1444) RM crashes when node resource request sent without corresponding rack request

2013-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1444: Assignee: Wangda Tan RM crashes when node resource request sent without corresponding rack request

[jira] [Updated] (YARN-1444) RM crashes when node resource request sent without corresponding rack request

2013-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1444: - Attachment: yarn-1444.ver1.patch I'm not sure if anybody on this, I take a shot at this, hope to get your

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2013-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1197: - Attachment: yarn-1197-v5.pdf I attached an updated design doc according to our discussion. Support

[jira] [Commented] (YARN-1449) Protocol changes and implementations in NM side to support change container resource

2013-12-09 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13843808#comment-13843808 ] Wangda Tan commented on YARN-1449: -- Hi Sandy, Thanks so much to give me such comments,

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-12-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13844926#comment-13844926 ] Wangda Tan commented on YARN-1197: -- Agree, I also think the scheduler part need some time

[jira] [Updated] (YARN-1449) Protocol changes and implementations in NM side to support change container resource

2013-12-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1449: - Attachment: yarn-1449.4.patch [~sandyr], I've updated my code according to your comments (thanks again!).

[jira] [Updated] (YARN-1449) Protocol changes and implementations in NM side to support change container resource

2013-12-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1449: - Attachment: yarn-1449.5.patch Updated patch to handle findbugs warning Protocol changes and

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-12-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845988#comment-13845988 ] Wangda Tan commented on YARN-1197: -- Hi Vinod, Thanks for jumping in, my idea on your

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-12-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845990#comment-13845990 ] Wangda Tan commented on YARN-1197: -- Sorry I missed the reply from Sandy :-p Support

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-12-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13846084#comment-13846084 ] Wangda Tan commented on YARN-1197: -- My thoughts after reading Bikas and Sandy's comments,

[jira] [Created] (YARN-1502) Protocol changes and implementations in RM side to support change container resource

2013-12-12 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1502: Summary: Protocol changes and implementations in RM side to support change container resource Key: YARN-1502 URL: https://issues.apache.org/jira/browse/YARN-1502 Project:

[jira] [Updated] (YARN-1502) Protocol changes and implementations in RM side to support change container resource

2013-12-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1502: - Attachment: yarn-1502.1.patch Attached the first patch of scheduler changes for preview, just to want to

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2013-12-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1197: - Attachment: yarn-1197-scheduler-v1.pdf Attached scheduler design doc for increasing and decreasing, I've

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-12-12 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13846389#comment-13846389 ] Wangda Tan commented on YARN-1197: -- Copy text from scheduler design doc to here for easier

[jira] [Created] (YARN-1509) Make AMRMClient support send increase container request and get increased/decreased containers

2013-12-16 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1509: Summary: Make AMRMClient support send increase container request and get increased/decreased containers Key: YARN-1509 URL: https://issues.apache.org/jira/browse/YARN-1509

[jira] [Created] (YARN-1510) Make NMClient support change container resources

2013-12-16 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1510: Summary: Make NMClient support change container resources Key: YARN-1510 URL: https://issues.apache.org/jira/browse/YARN-1510 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-1448) AM-RM protocol changes to support container resizing

2013-12-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13850011#comment-13850011 ] Wangda Tan commented on YARN-1448: -- I created YARN-1509 to track AMRMClient changes and

[jira] [Updated] (YARN-1502) Protocol changes and implementations in RM side to support change container resource

2013-12-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1502: - Attachment: yarn-1502.2.patch I attached patch for resource manager related changes, this patch support

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2013-12-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13851126#comment-13851126 ] Wangda Tan commented on YARN-1197: -- [~acmurthy], great, thanks :) Support changing

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2014-01-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13875509#comment-13875509 ] Wangda Tan commented on YARN-1197: -- Thanks Sandy, I'm working on breaking down RM patch

[jira] [Created] (YARN-1643) [YARN-1197] Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1643: Summary: [YARN-1197] Make ContainersMonitor can support change monitoring size of an allocated container in NM side Key: YARN-1643 URL: https://issues.apache.org/jira/browse/YARN-1643

[jira] [Created] (YARN-1644) [YARN-1197] Add newly decreased container to NodeStatus in NM side

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1644: Summary: [YARN-1197] Add newly decreased container to NodeStatus in NM side Key: YARN-1644 URL: https://issues.apache.org/jira/browse/YARN-1644 Project: Hadoop YARN

[jira] [Created] (YARN-1645) [YARN-1197] Add changeContainersResource interface and implementations to ContainerManagementProtocol

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1645: Summary: [YARN-1197] Add changeContainersResource interface and implementations to ContainerManagementProtocol Key: YARN-1645 URL: https://issues.apache.org/jira/browse/YARN-1645

[jira] [Created] (YARN-1646) [YARN-1197] Add increase container request to YarnScheduler allocate API

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1646: Summary: [YARN-1197] Add increase container request to YarnScheduler allocate API Key: YARN-1646 URL: https://issues.apache.org/jira/browse/YARN-1646 Project: Hadoop YARN

[jira] [Created] (YARN-1649) [YARN-1197] Modify ResourceTrackerService to support passing decreased containers to RMNode

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1649: Summary: [YARN-1197] Modify ResourceTrackerService to support passing decreased containers to RMNode Key: YARN-1649 URL: https://issues.apache.org/jira/browse/YARN-1649

[jira] [Created] (YARN-1651) [YARN-1197] Add methods in FiCaSchedulerApp to support add/reserve/unreserve/allocate/pull change container requests/results

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1651: Summary: [YARN-1197] Add methods in FiCaSchedulerApp to support add/reserve/unreserve/allocate/pull change container requests/results Key: YARN-1651 URL:

[jira] [Created] (YARN-1647) [YARN-1197] Add increased/decreased container to Allocation

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1647: Summary: [YARN-1197] Add increased/decreased container to Allocation Key: YARN-1647 URL: https://issues.apache.org/jira/browse/YARN-1647 Project: Hadoop YARN Issue

[jira] [Created] (YARN-1650) [YARN-1197] Add pullDecreasedContainer API to RMNode which can be used by scheduler to get newly decreased Containers

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1650: Summary: [YARN-1197] Add pullDecreasedContainer API to RMNode which can be used by scheduler to get newly decreased Containers Key: YARN-1650 URL:

[jira] [Created] (YARN-1648) [YARN-1197] Modify ApplicationMasterService to support changing container resource

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1648: Summary: [YARN-1197] Modify ApplicationMasterService to support changing container resource Key: YARN-1648 URL: https://issues.apache.org/jira/browse/YARN-1648 Project:

[jira] [Created] (YARN-1655) [YARN-1197] Add implementations to FairScheduler to support increase/decrease container resource

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1655: Summary: [YARN-1197] Add implementations to FairScheduler to support increase/decrease container resource Key: YARN-1655 URL: https://issues.apache.org/jira/browse/YARN-1655

[jira] [Created] (YARN-1652) [YARN-1197] Add methods in FiCaSchedulerNode to support increase/decrease/reserve/unreserve change container requests/results

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1652: Summary: [YARN-1197] Add methods in FiCaSchedulerNode to support increase/decrease/reserve/unreserve change container requests/results Key: YARN-1652 URL:

[jira] [Created] (YARN-1654) [YARN-1197] Add implementations to CapacityScheduler to support increase/decrease container resource

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1654: Summary: [YARN-1197] Add implementations to CapacityScheduler to support increase/decrease container resource Key: YARN-1654 URL: https://issues.apache.org/jira/browse/YARN-1654

[jira] [Created] (YARN-1653) [YARN-1197] Add APIs in CSQueue to support decrease container resource and unreserve increase request

2014-01-26 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-1653: Summary: [YARN-1197] Add APIs in CSQueue to support decrease container resource and unreserve increase request Key: YARN-1653 URL: https://issues.apache.org/jira/browse/YARN-1653

[jira] [Assigned] (YARN-1643) [YARN-1197] Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1643: Assignee: Wangda Tan [YARN-1197] Make ContainersMonitor can support change monitoring size of an

[jira] [Assigned] (YARN-1645) [YARN-1197] Add changeContainersResource interface and implementations to ContainerManagementProtocol

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1645: Assignee: Wangda Tan [YARN-1197] Add changeContainersResource interface and implementations to

[jira] [Assigned] (YARN-1644) [YARN-1197] Add newly decreased container to NodeStatus in NM side

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1644: Assignee: Wangda Tan [YARN-1197] Add newly decreased container to NodeStatus in NM side

[jira] [Assigned] (YARN-1646) [YARN-1197] Add increase container request to YarnScheduler allocate API

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1646: Assignee: Wangda Tan [YARN-1197] Add increase container request to YarnScheduler allocate API

[jira] [Assigned] (YARN-1650) [YARN-1197] Add pullDecreasedContainer API to RMNode which can be used by scheduler to get newly decreased Containers

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1650: Assignee: Wangda Tan [YARN-1197] Add pullDecreasedContainer API to RMNode which can be used by

[jira] [Assigned] (YARN-1649) [YARN-1197] Modify ResourceTrackerService to support passing decreased containers to RMNode

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1649: Assignee: Wangda Tan [YARN-1197] Modify ResourceTrackerService to support passing decreased

[jira] [Assigned] (YARN-1652) [YARN-1197] Add methods in FiCaSchedulerNode to support increase/decrease/reserve/unreserve change container requests/results

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1652: Assignee: Wangda Tan [YARN-1197] Add methods in FiCaSchedulerNode to support

[jira] [Assigned] (YARN-1654) [YARN-1197] Add implementations to CapacityScheduler to support increase/decrease container resource

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1654: Assignee: Wangda Tan [YARN-1197] Add implementations to CapacityScheduler to support

[jira] [Assigned] (YARN-1647) [YARN-1197] Add increased/decreased container to Allocation

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1647: Assignee: Wangda Tan [YARN-1197] Add increased/decreased container to Allocation

[jira] [Assigned] (YARN-1651) [YARN-1197] Add methods in FiCaSchedulerApp to support add/reserve/unreserve/allocate/pull change container requests/results

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1651: Assignee: Wangda Tan [YARN-1197] Add methods in FiCaSchedulerApp to support

[jira] [Assigned] (YARN-1653) [YARN-1197] Add APIs in CSQueue to support decrease container resource and unreserve increase request

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-1653: Assignee: Wangda Tan [YARN-1197] Add APIs in CSQueue to support decrease container resource and

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13882232#comment-13882232 ] Wangda Tan commented on YARN-1197: -- I created a bunch of sub tasks for easier review, NM

[jira] [Updated] (YARN-1643) [YARN-1197] Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1643: - Attachment: YARN-1643.1.patch Added patch#1 to review [YARN-1197] Make ContainersMonitor can support

[jira] [Updated] (YARN-1644) [YARN-1197] Add newly decreased container to NodeStatus in NM side

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1644: - Attachment: yarn-1644.1.patch Added patch#1 for review [YARN-1197] Add newly decreased container to

[jira] [Updated] (YARN-1645) [YARN-1197] Add changeContainersResource interface and implementations to ContainerManagementProtocol

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1645: - Attachment: yarn-1645.1.patch Attached patch#1 for review [YARN-1197] Add changeContainersResource

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13882545#comment-13882545 ] Wangda Tan commented on YARN-1197: -- I attached patches for NM side changes, YARN-1643,

[jira] [Commented] (YARN-745) Move UnmanagedAMLauncher to yarn client package

2014-01-26 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13882551#comment-13882551 ] Wangda Tan commented on YARN-745: - +1 for this, My idea is we can move the major

[jira] [Commented] (YARN-745) Move UnmanagedAMLauncher to yarn client package

2014-01-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13885038#comment-13885038 ] Wangda Tan commented on YARN-745: - Thanks, if so, Hamster can leverage this to do some AM

[jira] [Commented] (YARN-1444) RM crashes when node resource request sent without corresponding rack request

2014-02-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13891499#comment-13891499 ] Wangda Tan commented on YARN-1444: -- Hi [~acmurthy], I think the patch I attached before

[jira] [Commented] (YARN-745) Move UnmanagedAMLauncher to yarn client package

2014-02-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911154#comment-13911154 ] Wangda Tan commented on YARN-745: - Thanks! I haven't started yet, I'll start to do it later.

[jira] [Commented] (YARN-745) Move UnmanagedAMLauncher to yarn client package

2014-02-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13911163#comment-13911163 ] Wangda Tan commented on YARN-745: - I think it's still backwards compatible, in past, user

[jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182257#comment-14182257 ] Wangda Tan commented on YARN-2495: -- [~Naganarasimha], One comment before you uploading

[jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)

2014-10-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182473#comment-14182473 ] Wangda Tan commented on YARN-2495: -- bq. But currently i have NodeLabelProvider as service

[jira] [Commented] (YARN-2495) Allow admin specify labels in each NM (Distributed configuration)

2014-10-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183135#comment-14183135 ] Wangda Tan commented on YARN-2495: -- Hi Naga, Thanks for working on this patch, Comments

[jira] [Commented] (YARN-2647) Add yarn queue CLI to get queue info including labels of such queue

2014-10-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183205#comment-14183205 ] Wangda Tan commented on YARN-2647: -- Hi [~sunilg], Thanks for the patch, some comments, 1)

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2014-10-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183348#comment-14183348 ] Wangda Tan commented on YARN-2729: -- Hi [~Naganarasimha], After looked at the patch, and

[jira] [Commented] (YARN-2505) Support get/add/remove/change labels in RM REST API

2014-10-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183416#comment-14183416 ] Wangda Tan commented on YARN-2505: -- Hi [~cwelch], Thanks for the patch, generally looks

[jira] [Created] (YARN-2740) RM AdminService should prevent admin change labels on nodes when distributed node label configuration enabled

2014-10-24 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-2740: Summary: RM AdminService should prevent admin change labels on nodes when distributed node label configuration enabled Key: YARN-2740 URL: https://issues.apache.org/jira/browse/YARN-2740

[jira] [Commented] (YARN-2740) RM AdminService should prevent admin change labels on nodes when distributed node label configuration enabled

2014-10-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183430#comment-14183430 ] Wangda Tan commented on YARN-2740: -- This issue depends on configuration option defined at

<    2   3   4   5   6   7   8   9   10   11   >