[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-05-12 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14541233#comment-14541233 ] MENG DING commented on YARN-1197: - Thanks guys for the comments. Yes, I believe memory

[jira] [Commented] (YARN-1902) Allocation of too many containers when a second request is done with the same resource capability

2015-05-15 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546209#comment-14546209 ] MENG DING commented on YARN-1902: - I was almost going to log the same issue when I saw this

[jira] [Commented] (YARN-1902) Allocation of too many containers when a second request is done with the same resource capability

2015-05-18 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14548480#comment-14548480 ] MENG DING commented on YARN-1902: - Thanks [~bikassaha] and [~vinodkv] for the education and

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-05-12 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539983#comment-14539983 ] MENG DING commented on YARN-1197: - We have a real use case to better support long running

[jira] [Commented] (YARN-1902) Allocation of too many containers when a second request is done with the same resource capability

2015-05-20 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14552375#comment-14552375 ] MENG DING commented on YARN-1902: - I have been experimenting with the idea of changing

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-05 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14575519#comment-14575519 ] MENG DING commented on YARN-1197: - Just an update, I am currently working on: YARN-1449,

[jira] [Assigned] (YARN-1449) Protocol changes in NM side to support change container resource

2015-06-08 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING reassigned YARN-1449: --- Assignee: MENG DING Protocol changes in NM side to support change container resource

[jira] [Updated] (YARN-1449) Protocol changes in NM side to support change container resource

2015-06-08 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: YARN-1449.1.patch Attaching patch for review. The patch has passed the {{test-patch}} script,

[jira] [Commented] (YARN-1449) Protocol changes in NM side to support change container resource

2015-06-24 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14600426#comment-14600426 ] MENG DING commented on YARN-1449: - The design has been changed for YARN-1197. I will post

[jira] [Assigned] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-06-24 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING reassigned YARN-1643: --- Assignee: MENG DING Make ContainersMonitor can support change monitoring size of an allocated

[jira] [Assigned] (YARN-1509) Make AMRMClient support send increase container request and get increased/decreased containers

2015-06-24 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING reassigned YARN-1509: --- Assignee: MENG DING Make AMRMClient support send increase container request and get

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2015-06-24 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1197: Attachment: YARN-1197_Design.2015.06.24.pdf The design doc has been updated based on the latest discussion

[jira] [Assigned] (YARN-1510) Make NMClient support change container resources

2015-06-24 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING reassigned YARN-1510: --- Assignee: MENG DING Make NMClient support change container resources

[jira] [Commented] (YARN-1449) Protocol changes in NM side to support change container resource

2015-06-26 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603802#comment-14603802 ] MENG DING commented on YARN-1449: - The patch is way too big for review. I will split it

[jira] [Updated] (YARN-1449) Protocol changes in NM side to support change container resource

2015-06-26 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: YARN-1449.2.patch Attach updated patch for review which includes: * All protocol changes

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588254#comment-14588254 ] MENG DING commented on YARN-1197: - Thanks guys for all the comments! I think we all agreed

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586139#comment-14586139 ] MENG DING commented on YARN-1197: - Had a very good discussion with [~leftnoteasy] at the

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588679#comment-14588679 ] MENG DING commented on YARN-1197: - [~leftnoteasy], if I understand it correctly, in the

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588671#comment-14588671 ] MENG DING commented on YARN-1197: - [~sandyr], by processing both resource decrease and

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589001#comment-14589001 ] MENG DING commented on YARN-1197: - Sorry got things messed up. Correction: We definitely

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588963#comment-14588963 ] MENG DING commented on YARN-1197: - [~leftnoteasy], I am certainly OK doing (a). My original

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586999#comment-14586999 ] MENG DING commented on YARN-1197: - [~sandyr], Yes. The key assumption is that by the time

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-05-27 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14561134#comment-14561134 ] MENG DING commented on YARN-1197: - Correct a typo in my previous post, it should be: bq. As

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-05-27 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14561098#comment-14561098 ] MENG DING commented on YARN-1197: - Thanks [~vinodkv] and [~leftnoteasy] for the great

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-05-27 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14561710#comment-14561710 ] MENG DING commented on YARN-1197: - [~leftnoteasy] Makes sense to me. Will update the doc to

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-05-27 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14561722#comment-14561722 ] MENG DING commented on YARN-1197: - [~leftnoteasy] Makes sense to me. Will update the doc to

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-05-28 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14563052#comment-14563052 ] MENG DING commented on YARN-1197: - Just wanted to add that if dominant resource calculator

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Description: YARN-1447 and YARN-1448 are outdated. This ticket deals with AM-RM Protocol changes to support

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Attachment: YARN-3866.1.patch Attach patch for review. The patch appears to be big, but it involves the

[jira] [Created] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
MENG DING created YARN-3866: --- Summary: AM-RM protocol changes to support container resizing Key: YARN-3866 URL: https://issues.apache.org/jira/browse/YARN-3866 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Hadoop Flags: (was: Reviewed) AM-RM protocol changes to support container resizing

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Assignee: MENG DING (was: Wangda Tan) AM-RM protocol changes to support container resizing

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Component/s: (was: resourcemanager) AM-RM protocol changes to support container resizing

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Affects Version/s: (was: 2.2.0) AM-RM protocol changes to support container resizing

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Fix Version/s: (was: 2.3.0) AM-RM protocol changes to support container resizing

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605995#comment-14605995 ] MENG DING commented on YARN-1197: - One option to consider is to let NM confirm back with RM

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605932#comment-14605932 ] MENG DING commented on YARN-1197: - [~grey], NM will persist the resource decrease in level

[jira] [Updated] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-06 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1643: Attachment: YARN-1643.2.patch Attach patch for {{ContainersMonitorImpl}} for review. Currently the

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: YARN-1449.1.patch Attach patch for AM-NM protocol changes AM-NM protocol changes to support

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1644.2.patch RM-NM protocol changes and NodeStatusUpdater implementation to support

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2015-07-02 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3866: Attachment: YARN-3866.2.patch Attached new patch based on the review comments. 1) Moved most of the PB

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-05-22 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556868#comment-14556868 ] MENG DING commented on YARN-1197: - So to summarize the current dilemma: Situation: - A

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-05-22 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556803#comment-14556803 ] MENG DING commented on YARN-1197: - Well, I think I spoke too soon :-) The example I gave

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-05-22 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14556383#comment-14556383 ] MENG DING commented on YARN-1197: - [~leftnoteasy] I totally agree that Yarn should not mess

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2015-05-26 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1197: Attachment: YARN-1197_Design.pdf We have come up with a new proposal to address the above problem, which we

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: YARN-1449.2.patch Attach new patch which fixed coding style issues, and use 4 indents for

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1644.3.patch Fixed coding style issues, and added test case to {{TestYarnServerApiClasses}}

[jira] [Updated] (YARN-1645) ContainerManager implementation to support container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Attachment: YARN-1645.2.patch Fixed coding style issues. ContainerManager implementation to support

[jira] [Updated] (YARN-3867) ContainerImpl changes to support container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3867: Attachment: YARN-3867.2.patch Fixed coding style. ContainerImpl changes to support container resizing

[jira] [Updated] (YARN-3868) ContainerManager recovery for container resizing

2015-07-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3868: Attachment: YARN-3868.2.patch Fixed coding style issues. ContainerManager recovery for container resizing

[jira] [Commented] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-08-17 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14699939#comment-14699939 ] MENG DING commented on YARN-1644: - I had an offline discussion with [~jianhe] a while ago,

[jira] [Commented] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-08-18 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14701590#comment-14701590 ] MENG DING commented on YARN-1644: - Thanks a lot [~leftnoteasy] and [~jianhe] for your

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-08-19 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1644-YARN-1197.6.patch Attaching latest patch that addresses the following: * Keep the

[jira] [Updated] (YARN-1197) Support changing resources of an allocated container

2015-08-21 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1197: Attachment: YARN-1197_Design.2015.08.21.pdf The NodeManager side of the implementation has been completed.

[jira] [Commented] (YARN-3769) Preemption occurring unnecessarily because preemption doesn't consider user limit

2015-08-24 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14709856#comment-14709856 ] MENG DING commented on YARN-3769: - [~leftnoteasy], for better tracking purposes, would it

[jira] [Commented] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-08-20 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14704926#comment-14704926 ] MENG DING commented on YARN-1644: - The findbugs warning is not related. The link given

[jira] [Updated] (YARN-3868) ContainerManager recovery for container resizing

2015-08-20 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3868: Attachment: YARN-3868-YARN-1197.5.patch Attach the latest patch to add a case for testing the recovery of

[jira] [Updated] (YARN-1645) Add increaseContainersResource interface and implementations to ContainerManager

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Summary: Add increaseContainersResource interface and implementations to ContainerManager (was: [YARN-1197]

[jira] [Reopened] (YARN-1645) [YARN-1197] Add changeContainersResource interface and implementations to ContainerManagementProtocol

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING reopened YARN-1645: - Assignee: MENG DING Reopen this issue as a subtask of YARN-1197. This issue tracks the ContainerManager

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606459#comment-14606459 ] MENG DING commented on YARN-1197: - Released containers which are in RUNNING state are put

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Summary: AM-NM protocol changes to support container resizing (was: Protocol changes in NM side to support

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: (was: YARN-1449.2.patch) AM-NM protocol changes to support container resizing

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Attachment: (was: YARN-1449.1.patch) AM-NM protocol changes to support container resizing

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Component/s: (was: nodemanager) api AM-NM protocol changes to support container

[jira] [Updated] (YARN-1449) AM-NM protocol changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1449: Description: AM-NM protocol changes to support container resizing 1) IncreaseContainersResourceRequest and

[jira] [Updated] (YARN-1645) Add increaseContainersResource interface and implementations to ContainerManager

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Description: Implementation of ContainerManager for container resize, including: 1) Container resize logic

[jira] [Reopened] (YARN-1644) [YARN-1197] Add newly decreased container to NodeStatus in NM side

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING reopened YARN-1644: - Assignee: MENG DING Reopen this issue to track RM-NM protocol and NodeStatusUpdater implementation

[jira] [Created] (YARN-3867) ContainerImpl changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
MENG DING created YARN-3867: --- Summary: ContainerImpl changes to support container resizing Key: YARN-3867 URL: https://issues.apache.org/jira/browse/YARN-3867 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3867) ContainerImpl changes to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3867: Attachment: YARN-3867.1.patch Attach patch for containerImpl changes ContainerImpl changes to support

[jira] [Updated] (YARN-1645) ContainerManager implementation to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Attachment: YARN-1645.1.patch Attach patch of ContainerManager changes ContainerManager implementation to

[jira] [Updated] (YARN-3868) ContainerManager recovery for container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3868: Attachment: YARN-3868.1.patch Attach patch for ContainerManager recovery logic ContainerManager recovery

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Summary: RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing (was:

[jira] [Updated] (YARN-1645) ContainerManager implementation to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Description: Implementation of ContainerManager for container resize, including: 1) ContainerManager resize

[jira] [Updated] (YARN-1645) ContainerManager implementation to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1645: Summary: ContainerManager implementation to support container resizing (was: Add increaseContainersResource

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1644.1.patch Attach patch for RM-NM protocol changes and NodeStatusUpdater Implementation.

[jira] [Created] (YARN-3868) ContainerManager recovery for container resizing

2015-06-29 Thread MENG DING (JIRA)
MENG DING created YARN-3868: --- Summary: ContainerManager recovery for container resizing Key: YARN-3868 URL: https://issues.apache.org/jira/browse/YARN-3868 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606243#comment-14606243 ] MENG DING commented on YARN-1197: - [~bikassaha], I will update the design doc with detailed

[jira] [Commented] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646403#comment-14646403 ] MENG DING commented on YARN-1643: - Thanks [~jianhe] for the review: bq. Here, memory *

[jira] [Updated] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-28 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1643: Attachment: YARN-1643-YARN-1197.6.patch Update the patch to fix build issue as YARN-1197 branch has been

[jira] [Commented] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-29 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14646709#comment-14646709 ] MENG DING commented on YARN-1643: - bq. IIUC, the main benefit is that we don't need to

[jira] [Commented] (YARN-3026) Move application-specific container allocation logic from LeafQueue to FiCaSchedulerApp

2015-07-31 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14649321#comment-14649321 ] MENG DING commented on YARN-3026: - bq. In CS (before this patch), excessReservation won't

[jira] [Updated] (YARN-3867) ContainerImpl changes to support container resizing

2015-07-28 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3867: Attachment: YARN-3867-YARN-1197.5.patch Attaching patch that updates container resource synchronously. In

[jira] [Updated] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-28 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1643: Attachment: YARN-1643-YARN-1197.4.patch We have decided to update resource synchronously in YARN-3867 for

[jira] [Commented] (YARN-3867) ContainerImpl changes to support container resizing

2015-07-28 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14644921#comment-14644921 ] MENG DING commented on YARN-3867: - Again, failed test is not related to this issue.

[jira] [Updated] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-28 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1643: Attachment: (was: YARN-3867-YARN-1197.5.patch) Make ContainersMonitor can support change monitoring

[jira] [Updated] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-28 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1643: Attachment: YARN-1643-YARN-1197.5.patch Make ContainersMonitor can support change monitoring size of an

[jira] [Updated] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-28 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1643: Attachment: YARN-3867-YARN-1197.5.patch Upload the patch that supports *synchronous* resource update in

[jira] [Commented] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-30 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14647926#comment-14647926 ] MENG DING commented on YARN-1643: - The failed test does not seem to be related. Make

[jira] [Updated] (YARN-1643) Make ContainersMonitor can support change monitoring size of an allocated container in NM side

2015-07-30 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1643: Attachment: YARN-1643-YARN-1197.7.patch Attaching latest patch which addressed the following: * Make

[jira] [Updated] (YARN-3868) ContainerManager recovery for container resizing

2015-07-30 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3868: Attachment: YARN-3868-YARN-1197.4.patch Attach latest patch since dependent patches are changed.

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-07-22 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: (was: YARN-1645-YARN-1197.5.patch) RM-NM protocol changes and NodeStatusUpdater

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-07-22 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1644-YARN-1197.5.patch RM-NM protocol changes and NodeStatusUpdater implementation to

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-07-22 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1645-YARN-1197.5.patch Attach latest patch and trigger jenkins. This patch does the

[jira] [Commented] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-07-27 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643099#comment-14643099 ] MENG DING commented on YARN-1644: - bq. NM re-registration can still happen between the

[jira] [Commented] (YARN-3867) ContainerImpl changes to support container resizing

2015-07-22 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637384#comment-14637384 ] MENG DING commented on YARN-3867: - Dependent tickets have been committed. Start jekins

[jira] [Commented] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-07-22 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637418#comment-14637418 ] MENG DING commented on YARN-1644: - * The checkstyle reports are false alarms: {code}

[jira] [Commented] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-07-26 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641930#comment-14641930 ] MENG DING commented on YARN-1644: - I think the race condition is still there. Even though

[jira] [Commented] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-07-24 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641017#comment-14641017 ] MENG DING commented on YARN-1644: - Thanks [~jianhe] for the review comments, and thanks for

[jira] [Commented] (YARN-3867) ContainerImpl changes to support container resizing

2015-07-24 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14641087#comment-14641087 ] MENG DING commented on YARN-3867: - Failed unit tests are unrelated. The both passed in my

[jira] [Updated] (YARN-3867) ContainerImpl changes to support container resizing

2015-07-24 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3867: Attachment: YARN-3867-YARN-1197.4.patch Thanks [~jianhe] for the review. Attached new patch that addressed

  1   2   3   >