[jira] [Comment Edited] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472021#comment-15472021 ] Arun Suresh edited comment on YARN-5620 at 9/7/16 10:43 PM: [~leftnoteasy], I

[jira] [Updated] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-08-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5221: -- Attachment: YARN-5221-branch-2.8-v1.patch Committed this to branch-2. Uploading a patch to test this

[jira] [Updated] (YARN-5552) Add Builder methods for common yarn API records

2016-08-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5552: -- Assignee: Tao Jie > Add Builder methods for common yarn API records >

[jira] [Commented] (YARN-5552) Add Builder methods for common yarn API records

2016-08-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447810#comment-15447810 ] Arun Suresh commented on YARN-5552: --- Sure [~Tao Jie].. Assigning this to you. Thanks !! > Add Builder

[jira] [Updated] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-08-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4876: -- Attachment: YARN-4876.004.patch reattaching patch... > [Phase 1] Decoupled Init / Destroy of Containers

[jira] [Updated] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

2016-08-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4876: -- Attachment: YARN-4876.004.patch Thanks for the thoughtful review [~vvasudev]. Apologize for the delay in

[jira] [Commented] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15450395#comment-15450395 ] Arun Suresh commented on YARN-5221: --- Thanks for the reviews [~leftnoteasy] and [~subru]. Committed this

[jira] [Updated] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5221: -- Attachment: YARN-5221-branch-2-v1.patch Attaching patch to kick off jenkins on branch-2 > Expose

[jira] [Updated] (YARN-5221) Expose UpdateResourceRequest API to allow AM to request for change in container properties

2016-08-30 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5221: -- Attachment: YARN-5221.013.patch [~leftnoteasy], bq. Same thing, in YARN, evolving is treated as "stable"

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.006.patch Uploading patch addressing most of [~vvasudev] and [~jianhe]

[jira] [Created] (YARN-5633) Update Container Version in NMStateStore only if Resources have changed

2016-09-09 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5633: - Summary: Update Container Version in NMStateStore only if Resources have changed Key: YARN-5633 URL: https://issues.apache.org/jira/browse/YARN-5633 Project: Hadoop YARN

[jira] [Commented] (YARN-5633) Update Container Version in NMStateStore only if Resources have changed

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477508#comment-15477508 ] Arun Suresh commented on YARN-5633: --- Aah... did not notice you had posted a patch for this already..

[jira] [Commented] (YARN-5633) Update Container Version in NMStateStore only if Resources have changed

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477539#comment-15477539 ] Arun Suresh commented on YARN-5633: --- I think we would need to update the schema version too... In that

[jira] [Commented] (YARN-5633) Update Container Version in NMStateStore only if Resources have changed

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477549#comment-15477549 ] Arun Suresh commented on YARN-5633: --- We are still storing the version in the

[jira] [Commented] (YARN-5630) NM fails to start after downgrade from 2.8 to 2.7

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477572#comment-15477572 ] Arun Suresh commented on YARN-5630: --- Like you mentioned in YARN-5633, maybe we should update the schema

[jira] [Commented] (YARN-5633) Update Container Version in NMStateStore only if Resources have changed

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477557#comment-15477557 ] Arun Suresh commented on YARN-5633: --- Marking this as duplicate of YARN-5630. YARN-5630 also handles the

[jira] [Updated] (YARN-5633) Update Container Version in NMStateStore only if Resources have changed

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5633: -- Attachment: YARN-5633-branch-2.8-v1.patch Attaching trivial patch.. > Update Container Version in

[jira] [Resolved] (YARN-5633) Update Container Version in NMStateStore only if Resources have changed

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-5633. --- Resolution: Duplicate > Update Container Version in NMStateStore only if Resources have changed >

[jira] [Commented] (YARN-5632) UPDATE_EXECUTION_TYPE causes UpdateContainerRequestPBImpl to throw

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477576#comment-15477576 ] Arun Suresh commented on YARN-5632: --- +1. Thanks for tracking this down. > UPDATE_EXECUTION_TYPE causes

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15483158#comment-15483158 ] Arun Suresh commented on YARN-5620: --- Thanks [~jianhe].. Will update patch shortly with your suggestions.

[jira] [Comment Edited] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15483362#comment-15483362 ] Arun Suresh edited comment on YARN-5620 at 9/12/16 7:35 AM: Updating patch. *

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.009.patch Updating patch. * Addressing [~jianhe]'s latest comments * some javadoc,

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.010.patch Fixing failed tests (The _TestDefaultContainerExecutor_ error seems to

[jira] [Commented] (YARN-5630) NM fails to start after downgrade from 2.8 to 2.7

2016-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15484432#comment-15484432 ] Arun Suresh commented on YARN-5630: --- In that case... +1 for the latest patch.. bq. it adds another

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.014.patch Reverting this: bq. Also.. I pulled in a change from YARN-5637 here.

[jira] [Created] (YARN-5651) Changes to NMStateStore to persist reinitialization and rollback state

2016-09-14 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5651: - Summary: Changes to NMStateStore to persist reinitialization and rollback state Key: YARN-5651 URL: https://issues.apache.org/jira/browse/YARN-5651 Project: Hadoop YARN

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490181#comment-15490181 ] Arun Suresh commented on YARN-5620: --- The previous Jenkins

[jira] [Updated] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5637: -- Attachment: YARN-5637.003.patch Updating patch.. thanks again for the review [~jianhe].. bq. Here, we

[jira] [Commented] (YARN-5079) [Umbrella] Native YARN framework layer for services and beyond

2016-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15491388#comment-15491388 ] Arun Suresh commented on YARN-5079: --- Thanks for the reply [~gsaha] and [~jianhe]. In which case, would be

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-08 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.007.patch Fixing checkstyles, javadocs and javac > Core changes in NodeManager to

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477938#comment-15477938 ] Arun Suresh commented on YARN-5620: --- [~jianhe], thanks for thoughtful comments. bq. Also, if it’s

[jira] [Commented] (YARN-5630) NM fails to start after downgrade from 2.8 to 2.7

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477666#comment-15477666 ] Arun Suresh commented on YARN-5630: --- Good point... One option is to # keep an in memory reference count

[jira] [Comment Edited] (YARN-5630) NM fails to start after downgrade from 2.8 to 2.7

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477666#comment-15477666 ] Arun Suresh edited comment on YARN-5630 at 9/9/16 5:32 PM: --- Good point... One

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477961#comment-15477961 ] Arun Suresh commented on YARN-5620: --- Missed this: bq. why do we set the reInitContext to be null if once

[jira] [Commented] (YARN-5630) NM fails to start after downgrade from 2.8 to 2.7

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477843#comment-15477843 ] Arun Suresh commented on YARN-5630: --- bq. Is there a compelling reason to bother updating the schema

[jira] [Comment Edited] (YARN-5630) NM fails to start after downgrade from 2.8 to 2.7

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477666#comment-15477666 ] Arun Suresh edited comment on YARN-5630 at 9/9/16 5:33 PM: --- Good point... One

[jira] [Comment Edited] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15477938#comment-15477938 ] Arun Suresh edited comment on YARN-5620 at 9/9/16 6:50 PM: --- [~jianhe], thanks for

[jira] [Commented] (YARN-5547) NMLeveldbStateStore should be more tolerant of unknown keys

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478512#comment-15478512 ] Arun Suresh commented on YARN-5547: --- I just had an offline discussion with [~chris.douglas]. He was also

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-10 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.008.patch Uploading patch addressing [~jianhe]'s suggestions. * Refactored to use

[jira] [Updated] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5637: -- Attachment: YARN-5637.002.patch Updating patch based on [~jianhe]'s suggesting and rebasing with latest

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.015.patch Deleted, renamed and re-uploaded the attachment > Core changes in

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.014.patch Uploading patch with minor refactoring: *

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: (was: YARN-5620.014.patch) > Core changes in NodeManager to support re-initialization of

[jira] [Comment Edited] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488712#comment-15488712 ] Arun Suresh edited comment on YARN-5637 at 9/14/16 12:45 AM: - Updating patch

[jira] [Comment Edited] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15488712#comment-15488712 ] Arun Suresh edited comment on YARN-5637 at 9/14/16 12:47 AM: - Updating patch

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489547#comment-15489547 ] Arun Suresh commented on YARN-5620: --- [~jianhe], I intentionally wanted to keep the _merge_ function as a

[jira] [Comment Edited] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489547#comment-15489547 ] Arun Suresh edited comment on YARN-5620 at 9/14/16 6:13 AM: [~jianhe], I

[jira] [Updated] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5637: -- Attachment: YARN-5637.001.patch Uploading initial patch based on the framework laid out in YARN-5620. I

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-13 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.013.patch [~jianhe], thanks for checking.. Please find updated patch (v013)...

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.016.patch Thanks for the review [~vvasudev].. Uploading final patch with the

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493431#comment-15493431 ] Arun Suresh commented on YARN-5620: --- Committing this shortly based on [~vvasudev]'s and [~jianhe]'s +1.

[jira] [Updated] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5637: -- Attachment: YARN-5637.004.patch Rebasing patch with latest YARN-5620 > Changes in NodeManager to

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493609#comment-15493609 ] Arun Suresh commented on YARN-5620: --- Committed this to trunk and branch-2 > Core changes in NodeManager

[jira] [Comment Edited] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493609#comment-15493609 ] Arun Suresh edited comment on YARN-5620 at 9/15/16 3:13 PM: Committed this to

[jira] [Updated] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5637: -- Attachment: YARN-5637.005.patch Fixing checkstyle, javadocs and tests > Changes in NodeManager to

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Fix Version/s: 3.0.0-alpha2 2.9.0 > Core changes in NodeManager to support

[jira] [Commented] (YARN-5630) NM fails to start after downgrade from 2.8 to 2.7

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478660#comment-15478660 ] Arun Suresh commented on YARN-5630: --- [~subru], I like your suggestion of getting of marking keys as safe

[jira] [Commented] (YARN-5630) NM fails to start after downgrade from 2.8 to 2.7

2016-09-09 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478765#comment-15478765 ] Arun Suresh commented on YARN-5630: --- Agreed. Another option to maybe consider is have an external script

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.011.patch Thanks [~jianhe].. Uploading patch (v011) with the changes. I left the

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Attachment: YARN-5620.012.patch Done.. Thanks [~jianhe].. > Core changes in NodeManager to support for

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support for re-initialization of Containers

2016-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Summary: Core changes in NodeManager to support for re-initialization of Containers (was: Core changes

[jira] [Updated] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-12 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5620: -- Summary: Core changes in NodeManager to support re-initialization of Containers with new launchContext

[jira] [Created] (YARN-5637) Changes in NodeManager to support Container upgrade and rollback/commit

2016-09-12 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-5637: - Summary: Changes in NodeManager to support Container upgrade and rollback/commit Key: YARN-5637 URL: https://issues.apache.org/jira/browse/YARN-5637 Project: Hadoop YARN

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518181#comment-15518181 ] Arun Suresh commented on YARN-5609: --- So, the container.setIsReInitializing(false) statements were

[jira] [Comment Edited] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518181#comment-15518181 ] Arun Suresh edited comment on YARN-5609 at 9/24/16 2:34 AM: So, the

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517555#comment-15517555 ] Arun Suresh commented on YARN-3139: --- Thanks for addressing the comments [~leftnoteasy] w.r.t to the

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15518409#comment-15518409 ] Arun Suresh commented on YARN-5609: --- Hmm.. so how about I put back the old {{setIsReinitializing(false)}}

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523538#comment-15523538 ] Arun Suresh commented on YARN-5620: --- I agree.. but what if the resourcesets for v2 and v3 are only

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523284#comment-15523284 ] Arun Suresh commented on YARN-5609: --- Thanks for the reviews and the commit [~jianhe] > Expose upgrade

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support re-initialization of Containers with new launchContext

2016-09-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15523620#comment-15523620 ] Arun Suresh commented on YARN-5620: --- Aah.. got it, since {{LocalizedResource#ref}} is a Queue and not a

[jira] [Updated] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-26 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5609: -- Attachment: YARN-5609.010.patch Uploading patch (v010), which is basically (v008) but slight

[jira] [Commented] (YARN-5486) Update OpportunisticContainerAllocatorAMService::allocate method to handle OPPORTUNISTIC container requests

2016-09-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15533837#comment-15533837 ] Arun Suresh commented on YARN-5486: --- Thanks for the updating the patch [~kkaranasos]. I have linked the

[jira] [Commented] (YARN-5707) Add manager class for resource profiles

2016-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15546274#comment-15546274 ] Arun Suresh commented on YARN-5707: --- Thanks for the patch [~vvasudev]. It looks mostly good.. Couple of

[jira] [Updated] (YARN-4597) Add SCHEDULE to NM container lifecycle

2016-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4597: -- Attachment: YARN-4597.001.patch Attaching initial patch. * Introduced a {{ContainerScheduler}} : The

[jira] [Commented] (YARN-5541) Handling of opportunistic containers in the NM

2016-10-04 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15545639#comment-15545639 ] Arun Suresh commented on YARN-5541: --- Just added an initial patch for YARN-4597 which should simplify some

[jira] [Commented] (YARN-5707) Add manager class for resource profiles

2016-10-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549865#comment-15549865 ] Arun Suresh commented on YARN-5707: --- Thanks for the updated patch. +1 > Add manager class for resource

[jira] [Commented] (YARN-2995) Enhance UI to show cluster resource utilization of various container types

2016-10-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15549895#comment-15549895 ] Arun Suresh commented on YARN-2995: --- Thanks for the patch [~kkaranasos] Couple of comments: * Can we add

[jira] [Updated] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5609: -- Attachment: YARN-5609.007.patch Updating Patch based on your suggestions.. bq. But for restart, as the

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510384#comment-15510384 ] Arun Suresh commented on YARN-5609: --- bq. User anyway has to provide the full set of resources via the

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510471#comment-15510471 ] Arun Suresh commented on YARN-5609: --- Ah ok (you mean v006).. sure.. I had found a minor bug in that

[jira] [Updated] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5609: -- Attachment: YARN-5609.008.patch Uploading new patch, which is basically v006 patch with a minor bug fix

[jira] [Commented] (YARN-5657) TestDefaultContainerExecutor fails

2016-09-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497168#comment-15497168 ] Arun Suresh commented on YARN-5657: --- hmmm... not sure how to fix this checkstyle... >

[jira] [Comment Edited] (YARN-5657) TestDefaultContainerExecutor fails

2016-09-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497168#comment-15497168 ] Arun Suresh edited comment on YARN-5657 at 9/16/16 8:33 PM: hmmm... not sure

[jira] [Commented] (YARN-5656) ReservationACLsTestBase fails on trunk

2016-09-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497433#comment-15497433 ] Arun Suresh commented on YARN-5656: --- Think you can remove the check from the testcase as well.. +1

[jira] [Comment Edited] (YARN-5637) Changes in NodeManager to support Container rollback and commit

2016-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501051#comment-15501051 ] Arun Suresh edited comment on YARN-5637 at 9/18/16 2:22 PM: Thanks for the

[jira] [Commented] (YARN-5637) Changes in NodeManager to support Container rollback and commit

2016-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15501051#comment-15501051 ] Arun Suresh commented on YARN-5637: --- Thanks for the review [~vvasudev]. We don't really delete the new

[jira] [Updated] (YARN-5637) Changes in NodeManager to support Container rollback and commit

2016-09-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5637: -- Summary: Changes in NodeManager to support Container rollback and commit (was: Changes in NodeManager

[jira] [Updated] (YARN-5637) Changes in NodeManager to support Container rollback and commit

2016-09-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5637: -- Attachment: YARN-5637.006.patch Simplifying patch based on some offline discussions with [~jianhe]

[jira] [Commented] (YARN-5540) scheduler spends too much time looking at empty priorities

2016-09-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15497855#comment-15497855 ] Arun Suresh commented on YARN-5540: --- +1 pending branch-2.8 jenkins. Thanks [~jlowe].. > scheduler spends

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502265#comment-15502265 ] Arun Suresh commented on YARN-5609: --- Yup... thats the way I plan to implement it... > Expose upgrade and

[jira] [Updated] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5609: -- Attachment: YARN-5609.002.patch Uploading patch based on [~jianhe]'s suggestions. Thanks of the review

[jira] [Comment Edited] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505812#comment-15505812 ] Arun Suresh edited comment on YARN-5609 at 9/20/16 6:58 AM: Uploading updated

[jira] [Updated] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-20 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5609: -- Attachment: YARN-5609.003.patch Uploading updated patch. Thanks [~jianhe].. * Added a new testcase for

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502727#comment-15502727 ] Arun Suresh commented on YARN-5609: --- Yup.. that definitely makes sense.. happy to help with the reviews

[jira] [Updated] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5609: -- Attachment: YARN-5609.001.patch Uploading initial patch: * This includes all the protocol, PBImpl

[jira] [Comment Edited] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-19 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502735#comment-15502735 ] Arun Suresh edited comment on YARN-5609 at 9/19/16 8:45 AM: Uploading initial

[jira] [Updated] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5609: -- Attachment: YARN-5609.009.patch Uploading patch bq. I think wherever setIsReInitializing(false) is

[jira] [Commented] (YARN-5609) Expose upgrade and restart API in ContainerManagementProtocol

2016-09-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15516704#comment-15516704 ] Arun Suresh commented on YARN-5609: --- The test case failures are not related to the patch.. > Expose

[jira] [Commented] (YARN-3139) Improve locks in AbstractYarnScheduler/CapacityScheduler/FairScheduler

2016-09-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15517073#comment-15517073 ] Arun Suresh commented on YARN-3139: --- Thanks for the patch [~templedf].. AbstractYarnScheduler: #

[jira] [Commented] (YARN-4859) [Bug] Unable to submit a job to a reservation when using FairScheduler

2016-09-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511351#comment-15511351 ] Arun Suresh commented on YARN-4859: --- Assigning this to Sean > [Bug] Unable to submit a job to a

<    4   5   6   7   8   9   10   11   12   13   >