[jira] [Created] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7610: - Summary: Extend Distributed Shell to support launching job with opportunistic containers Key: YARN-7610 URL: https://issues.apache.org/jira/browse/YARN-7610 Project:

[jira] [Commented] (YARN-7586) Application Placement should be done before ACL checks in ResourceManager

2017-12-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278238#comment-16278238 ] Sunil G commented on YARN-7586: --- Test case failures are not related. Committing shortly if there are no

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: (was: YARN-7610.001.patch) > Extend Distributed Shell to support launching job with

[jira] [Updated] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-12-05 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7520: --- Attachment: YARN-7520.4.patch Discussed offline with [~wangda] and [~sunilg]. Attached patch

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: YARN-7610.001.patch > Extend Distributed Shell to support launching job with opportunistic

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: YARN-7610.001.patch > Extend Distributed Shell to support launching job with opportunistic

[jira] [Commented] (YARN-6355) [Umbrella] Preprocessor framework for AM and Client interactions with the RM

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278262#comment-16278262 ] Weiwei Yang commented on YARN-6355: --- Hi [~asuresh] Thanks for the explanation, if this is the design,

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278341#comment-16278341 ] genericqa commented on YARN-7610: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278362#comment-16278362 ] genericqa commented on YARN-7473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278343#comment-16278343 ] genericqa commented on YARN-7520: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-05 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7473: --- Attachment: YARN-7473.12.patch Thanks [~wangda] Attached patch with review comments addressed.

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278415#comment-16278415 ] Weiwei Yang commented on YARN-7610: --- Hi [~kkaranasos] Could you please help to review? Checkstyle issues

[jira] [Commented] (YARN-7092) Render application specific log under application tab in new YARN UI

2017-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278625#comment-16278625 ] Hudson commented on YARN-7092: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13325 (See

[jira] [Updated] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-12-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7556: --- Attachment: YARN-7556.006.patch Whoops. Used the wrong branch. Here's a trunk patch. > Fair

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-12-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279185#comment-16279185 ] Daniel Templeton commented on YARN-7119: Looks good to me, except one tiny issue, which might not

[jira] [Created] (YARN-7612) Add Placement Processor and planner framework

2017-12-05 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7612: - Summary: Add Placement Processor and planner framework Key: YARN-7612 URL: https://issues.apache.org/jira/browse/YARN-7612 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279216#comment-16279216 ] Hudson commented on YARN-7381: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13330 (See

[jira] [Commented] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-12-05 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279277#comment-16279277 ] Robert Kanter commented on YARN-7577: - The changes overall seem fine to me, but we should subclass

[jira] [Created] (YARN-7613) Implement Planning algorithms for rich placement

2017-12-05 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7613: - Summary: Implement Planning algorithms for rich placement Key: YARN-7613 URL: https://issues.apache.org/jira/browse/YARN-7613 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-7223) Document GPU isolation feature

2017-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7223: - Attachment: YARN-7223.wip.001.patch Attached patch (WIP). > Document GPU isolation feature >

[jira] [Updated] (YARN-7223) Document GPU isolation feature

2017-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7223: - Attachment: YARN-7223.wip.001.pdf Attached PDF for easier review (wip-001) patch. > Document GPU

[jira] [Commented] (YARN-7443) Add native FPGA module support to do isolation with cgroups

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279094#comment-16279094 ] genericqa commented on YARN-7443: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7242) Support specify values of different resource types in DistributedShell for easier testing

2017-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279280#comment-16279280 ] Wangda Tan commented on YARN-7242: -- Hi [~GergelyNovak], do you have the bandwidth to update the patch?

[jira] [Updated] (YARN-7612) Add Placement Processor and planner framework

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7612: -- Description: This introduces a Placement Processor and a Planning algorithm framework to handle

[jira] [Updated] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-12-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7556: --- Attachment: YARN-7556.006.patch Reposting patch 6 because I think it might have been

[jira] [Updated] (YARN-7612) Add Placement Processor and planner framework

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7612: -- Attachment: YARN-7612.wip.patch Attaching a proof of concept patch. It applies cleanly on top of the

[jira] [Updated] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-12-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7556: --- Attachment: (was: YARN-7556.006.patch) > Fair scheduler configuration should allow

[jira] [Updated] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in yarn-default.xml

2017-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7381: - Summary: Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled by default in

[jira] [Commented] (YARN-7443) Add native FPGA module support to do isolation with cgroups

2017-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279194#comment-16279194 ] Wangda Tan commented on YARN-7443: -- Thanks [~tangzhankun], latest patch looks good, will commit by end of

[jira] [Commented] (YARN-7420) YARN UI changes to depict auto created queues

2017-12-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278877#comment-16278877 ] Sunil G commented on YARN-7420: --- As mentioned offline, could you please share screen shots with 0 capacity.

[jira] [Commented] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-12-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278876#comment-16278876 ] Sunil G commented on YARN-7520: --- [~suma.shivaprasad], seems some jenkins problem. Could you please check it.

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278915#comment-16278915 ] genericqa commented on YARN-7556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279006#comment-16279006 ] Robert Kanter commented on YARN-6483: - YARN-7162 is the one that actually removes the XML parsing code.

[jira] [Updated] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-12-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7556: --- Attachment: YARN-7556.005.patch I reworked the patch to not use -1 as a flag, so there's no

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278938#comment-16278938 ] Hudson commented on YARN-7438: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13328 (See

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278945#comment-16278945 ] Wangda Tan commented on YARN-7522: -- Thanks [~kkaranasos] for your comments, addressed most of your

[jira] [Updated] (YARN-7522) Add application tags manager implementation

2017-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7522: - Attachment: YARN-7522.YARN-6592.004.patch Attached ver.4 patch. [~kkaranasos]/[~asuresh], mind to check

[jira] [Commented] (YARN-7540) Convert yarn app cli to call yarn api services

2017-12-05 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278862#comment-16278862 ] Billie Rinaldi commented on YARN-7540: -- I haven't tested the patch manually yet. Hopefully I will have

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278971#comment-16278971 ] Arun Suresh commented on YARN-7610: --- Thanks for taking a stab at this [~cheersyang].. Much appreciated!!

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-12-05 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278930#comment-16278930 ] Manikandan R commented on YARN-7119: Hope you had a good time :) Can you please confirm latest patch

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16278955#comment-16278955 ] genericqa commented on YARN-7473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279046#comment-16279046 ] Robert Kanter commented on YARN-6483: - The other option if we don't want to completely revert this from

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279047#comment-16279047 ] genericqa commented on YARN-7522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279386#comment-16279386 ] genericqa commented on YARN-7522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5871) Add support for reservation-based routing.

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279403#comment-16279403 ] genericqa commented on YARN-5871: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279451#comment-16279451 ] genericqa commented on YARN-7556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7616) App status does not return state STABLE for a running and stable service

2017-12-05 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reassigned YARN-7616: --- Assignee: Gour Saha > App status does not return state STABLE for a running and stable service >

[jira] [Created] (YARN-7616) App status does not return state STABLE for a running and stable service

2017-12-05 Thread Gour Saha (JIRA)
Gour Saha created YARN-7616: --- Summary: App status does not return state STABLE for a running and stable service Key: YARN-7616 URL: https://issues.apache.org/jira/browse/YARN-7616 Project: Hadoop YARN

[jira] [Commented] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279319#comment-16279319 ] genericqa commented on YARN-7520: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7540) Convert yarn app cli to call yarn api services

2017-12-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279389#comment-16279389 ] Eric Yang commented on YARN-7540: - [~billie.rinaldi] # I will reduce config object. # I will reuse

[jira] [Updated] (YARN-5871) Add support for reservation-based routing.

2017-12-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5871: - Parent Issue: YARN-7402 (was: YARN-5597) > Add support for reservation-based routing. >

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-12-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279476#comment-16279476 ] Daniel Templeton commented on YARN-7556: Test failures are all unrelated. > Fair scheduler

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279477#comment-16279477 ] Arun Suresh commented on YARN-7522: --- [~leftnoteasy], The errors are due to this line: {code} 281

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279480#comment-16279480 ] Arun Suresh commented on YARN-6483: --- bq. .. is to simply remove (or update to not rely on XML) just the

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279502#comment-16279502 ] genericqa commented on YARN-7556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7612) Add Placement Processor and planner framework

2017-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279304#comment-16279304 ] Wangda Tan commented on YARN-7612: -- Thanks [~asuresh]. Will take a look today or tomorrow. +[~sunilg] as

[jira] [Created] (YARN-7614) Support Reservation APIs in Federation Router

2017-12-05 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7614: -- Summary: Support Reservation APIs in Federation Router Key: YARN-7614 URL: https://issues.apache.org/jira/browse/YARN-7614 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-7615) Federation StateStore: support storage/retrieval of reservations

2017-12-05 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7615: -- Summary: Federation StateStore: support storage/retrieval of reservations Key: YARN-7615 URL: https://issues.apache.org/jira/browse/YARN-7615 Project: Hadoop YARN

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279500#comment-16279500 ] genericqa commented on YARN-6704: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7565: Attachment: YARN-7565.002.patch Patch 2 - Addressed [~jianhe]'s comments - Instead of checking

[jira] [Updated] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6704: --- Attachment: YARN-6704.v8.patch > Add Federation Interceptor restart when work preserving NM is enabled

[jira] [Comment Edited] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279381#comment-16279381 ] Chandni Singh edited comment on YARN-7565 at 12/6/17 12:26 AM: --- Patch 2 -

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279354#comment-16279354 ] Subru Krishnan commented on YARN-6704: -- Thanks [~botong] for updating the patch and for the

[jira] [Commented] (YARN-7274) Ability to disable elasticity at leaf queue level

2017-12-05 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279363#comment-16279363 ] Zian Chen commented on YARN-7274: - Hi [~leftnoteasy], looks like the failed cases were not introduced by

[jira] [Comment Edited] (YARN-7540) Convert yarn app cli to call yarn api services

2017-12-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279389#comment-16279389 ] Eric Yang edited comment on YARN-7540 at 12/5/17 11:43 PM: --- [~billie.rinaldi]

[jira] [Commented] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279485#comment-16279485 ] genericqa commented on YARN-7565: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279497#comment-16279497 ] Robert Kanter commented on YARN-6483: - Sounds good. > Add nodes transitioning to DECOMMISSIONING state

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279525#comment-16279525 ] genericqa commented on YARN-6483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279564#comment-16279564 ] Weiwei Yang commented on YARN-7607: --- Hi [~ajisakaa], could you help to review this patch? Thanks >

[jira] [Commented] (YARN-7611) Node manager web UI should display container type in containers page

2017-12-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279661#comment-16279661 ] Hudson commented on YARN-7611: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1 (See

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-12-05 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279684#comment-16279684 ] Manikandan R commented on YARN-7119: Thanks. Attached new patch. > yarn rmadmin -updateNodeResource

[jira] [Updated] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-12-05 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7119: --- Attachment: YARN-7119.009.patch > yarn rmadmin -updateNodeResource should be updated for resource

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279724#comment-16279724 ] Arun Suresh commented on YARN-7610: --- Thanks for the update [~cheersyang].. Since you are updating the

[jira] [Comment Edited] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279724#comment-16279724 ] Arun Suresh edited comment on YARN-7610 at 12/6/17 6:38 AM: Thanks for the

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279710#comment-16279710 ] Weiwei Yang commented on YARN-7610: --- I found {{OpportunisticContainers.md}} was using hardcoded version

[jira] [Comment Edited] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279745#comment-16279745 ] Arun Suresh edited comment on YARN-7617 at 12/6/17 6:49 AM: Thanks for raising

[jira] [Commented] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279745#comment-16279745 ] Arun Suresh commented on YARN-7617: --- I guess you mean "promote". Lets name the flag

[jira] [Updated] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7617: -- Summary: Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed

[jira] [Updated] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7617: -- Description: Per discussion in YARN-7610, it would be good to add such a flag, e.g

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279514#comment-16279514 ] genericqa commented on YARN-6483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6483: -- Attachment: (was: YARN-6483-branch-3.0.addendum.patch) > Add nodes transitioning to DECOMMISSIONING

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6483: -- Attachment: YARN-6483.branch-3.0.addendum.patch > Add nodes transitioning to DECOMMISSIONING state to

[jira] [Updated] (YARN-7611) Node manager web UI should display container type in containers page

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7611: -- Attachment: YARN-7611.002.patch Thanks [~asuresh] for the review, somehow the jenkins job was not

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: YARN-7610.002.patch > Extend Distributed Shell to support launching job with opportunistic

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6483: -- Attachment: YARN-6483-branch-3.0.addendum.patch Attaching addendum patch for branch-3.0 > Add nodes

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279602#comment-16279602 ] Arun Suresh commented on YARN-7610: --- Makes sense - we can track that in another JIRA > Extend

[jira] [Assigned] (YARN-4249) Many options in "yarn application" command is not documented

2017-12-05 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nijel reassigned YARN-4249: --- Assignee: (was: nijel) > Many options in "yarn application" command is not documented >

[jira] [Updated] (YARN-7522) Add application tags manager implementation

2017-12-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7522: - Attachment: YARN-7522.YARN-6592.005.patch Thanks reviews from [~asuresh]. Attached ver.5 patch, fixed the

[jira] [Commented] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279758#comment-16279758 ] Weiwei Yang commented on YARN-7617: --- Thanks for fixing the words [~asuresh]. > Add a flag in distributed

[jira] [Reopened] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reopened YARN-6483: --- Re-opened to fix branch-3.0 > Add nodes transitioning to DECOMMISSIONING state to the list of updated

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6483: -- Target Version/s: 3.1.0, 3.0.1 (was: 3.1.0) > Add nodes transitioning to DECOMMISSIONING state to the

[jira] [Commented] (YARN-7611) Node manager web UI should display container type in containers page

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279619#comment-16279619 ] genericqa commented on YARN-7611: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7611) Node manager web UI should display container type in containers page

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279636#comment-16279636 ] Weiwei Yang commented on YARN-7611: --- Result seems good, the UT failure was not related as this is pure

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: added_doc.png outline_compare.png v2 patch contains following updates #

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279585#comment-16279585 ] Weiwei Yang commented on YARN-7610: --- Hi [~asuresh] bq. Can you also update the doc as well ? Sure, I

[jira] [Created] (YARN-7617) Add a flag in distributed shell to automatically prompt opportunistic containers to guaranteed once they are started

2017-12-05 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7617: - Summary: Add a flag in distributed shell to automatically prompt opportunistic containers to guaranteed once they are started Key: YARN-7617 URL:

[jira] [Updated] (YARN-7617) Add a flag in distributed shell to automatically PROMOTE opportunistic containers to guaranteed once they are started

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7617: -- Description: Per discussion in YARN-7610, it would be good to add such a flag, e.g

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279792#comment-16279792 ] genericqa commented on YARN-7610: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279771#comment-16279771 ] Weiwei Yang commented on YARN-7610: --- Hi [~asuresh] bq. Since you are updating the documentation, can you

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: YARN-7610.003.patch v3 patch attached which includes the minor doc changes to the

  1   2   >