[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-12-06 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281426#comment-16281426 ] Manikandan R commented on YARN-7119: Taken care. There was one more new test case with

[jira] [Updated] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-12-06 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7119: --- Attachment: YARN-7119.010.patch > yarn rmadmin -updateNodeResource should be updated for resource types

[jira] [Commented] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281389#comment-16281389 ] genericqa commented on YARN-5418: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-12-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5418: Attachment: YARN-5418.4.branch-2.patch > When partial log aggregation is enabled, display the list of aggrega

[jira] [Commented] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281109#comment-16281109 ] genericqa commented on YARN-5418: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-12-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16281104#comment-16281104 ] Xuan Gong commented on YARN-5418: - create a new patch for this. [~leftnoteasy] Please revie

[jira] [Updated] (YARN-5418) When partial log aggregation is enabled, display the list of aggregated files on the container log page

2017-12-06 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5418: Attachment: YARN-5418.branch-2.4.patch YARN-5418.trunk.4.patch > When partial log aggregation

[jira] [Commented] (YARN-6078) Containers stuck in Localizing state

2017-12-06 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280984#comment-16280984 ] Billie Rinaldi commented on YARN-6078: -- [~bibinchundatt] [~djp] It should be noted tha

[jira] [Assigned] (YARN-7595) Container launching code suppresses close exceptions after writes

2017-12-06 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned YARN-7595: - Assignee: Jim Brennan > Container launching code suppresses close exceptions after writes > --

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280907#comment-16280907 ] genericqa commented on YARN-7064: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2017-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280902#comment-16280902 ] Wangda Tan commented on YARN-7494: -- Thanks [~sunilg] for working on this. Looked at the

[jira] [Commented] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280889#comment-16280889 ] genericqa commented on YARN-7577: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7242) Support specify values of different resource types in DistributedShell for easier testing

2017-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280870#comment-16280870 ] Wangda Tan commented on YARN-7242: -- [~GergelyNovak], YARN-5881 will be merged to trunk t

[jira] [Commented] (YARN-7242) Support specify values of different resource types in DistributedShell for easier testing

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280849#comment-16280849 ] genericqa commented on YARN-7242: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-06 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-6483: Fix Version/s: 3.0.1 > Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes

[jira] [Commented] (YARN-7616) App status does not return state STABLE for a running and stable service

2017-12-06 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280814#comment-16280814 ] Gour Saha commented on YARN-7616: - Currently the code uses FinalApplicationStatus to set th

[jira] [Commented] (YARN-7540) Convert yarn app cli to call yarn api services

2017-12-06 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280786#comment-16280786 ] Billie Rinaldi commented on YARN-7540: -- Regarding enableFastLaunch, I think we need to

[jira] [Resolved] (YARN-7416) Use "docker volume inspect" to make sure that volumes for GPU drivers/libs are properly mounted.

2017-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-7416. -- Resolution: Duplicate Duplicated by YARN-7487. > Use "docker volume inspect" to make sure that volumes f

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2017-12-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280739#comment-16280739 ] Daniel Templeton commented on YARN-7556: Test failures are still unrelated. [~rkan

[jira] [Updated] (YARN-7242) Support specify values of different resource types in DistributedShell for easier testing

2017-12-06 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-7242: Attachment: YARN-7242.002.patch > Support specify values of different resource types in DistributedSh

[jira] [Commented] (YARN-7242) Support specify values of different resource types in DistributedShell for easier testing

2017-12-06 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280734#comment-16280734 ] Gergely Novák commented on YARN-7242: - [~leftnoteasy] I'd love to work on this issue. T

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-06 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280729#comment-16280729 ] Arun Suresh commented on YARN-6483: --- Hmm... something seems to be off with Jenkins. [~rka

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned to the AM

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280722#comment-16280722 ] genericqa commented on YARN-6483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7561) Why hasContainerForNode() return false directly when there is no request of ANY locality without considering NODE_LOCAL and RACK_LOCAL?

2017-12-06 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280712#comment-16280712 ] Robert Kanter commented on YARN-7561: - It wouldn't break wire compatibility because it'

[jira] [Commented] (YARN-7274) Ability to disable elasticity at leaf queue level

2017-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280684#comment-16280684 ] Wangda Tan commented on YARN-7274: -- Patch looks good, will commit tomorrow if no opposite

[jira] [Updated] (YARN-7363) ContainerLocalizer doesn't have a valid log4j config when using LinuxContainerExecutor

2017-12-06 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-7363: - Fix Version/s: (was: 3.0.0) 3.0.1 > ContainerLocalizer doesn't have a valid log4j co

[jira] [Commented] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-12-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280657#comment-16280657 ] Miklos Szegedi commented on YARN-7577: -- Thank you for the review [~rkanter]. I updated

[jira] [Updated] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-12-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7577: - Attachment: YARN-7577.003.patch > Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart >

[jira] [Updated] (YARN-7064) Use cgroup to get container resource utilization

2017-12-06 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7064: - Attachment: YARN-7064.008.patch > Use cgroup to get container resource utilization > --

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-06 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280585#comment-16280585 ] Wangda Tan commented on YARN-7473: -- Thanks [~suma.shivaprasad] for updating the patch, sev

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-12-06 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280559#comment-16280559 ] Daniel Templeton commented on YARN-7119: LGTM. Last thing, it would be nice to cle

[jira] [Updated] (YARN-7619) Max AM Resource value in CS UI is different for every user

2017-12-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7619: - Attachment: Max AM Resources is Different for Each User.png > Max AM Resource value in CS UI is different f

[jira] [Created] (YARN-7619) Max AM Resource value in CS UI is different for every user

2017-12-06 Thread Eric Payne (JIRA)
Eric Payne created YARN-7619: Summary: Max AM Resource value in CS UI is different for every user Key: YARN-7619 URL: https://issues.apache.org/jira/browse/YARN-7619 Project: Hadoop YARN Issue Ty

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2017-12-06 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7494: -- Attachment: YARN-7494.v0.patch v0 patch. cc/[~leftnoteasy] Few assumptions. * LocalityAppPlacementAllocator was

[jira] [Created] (YARN-7618) YARN REST APi - can't launch yarn job on Kerberised Cluster

2017-12-06 Thread Alexandre Linte (JIRA)
Alexandre Linte created YARN-7618: - Summary: YARN REST APi - can't launch yarn job on Kerberised Cluster Key: YARN-7618 URL: https://issues.apache.org/jira/browse/YARN-7618 Project: Hadoop YARN

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-12-06 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280170#comment-16280170 ] Manikandan R commented on YARN-7119: Junit failure is not related to this patch. > yar

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280090#comment-16280090 ] genericqa commented on YARN-7473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Comment Edited] (YARN-7420) YARN UI changes to depict auto created queues

2017-12-06 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280082#comment-16280082 ] Suma Shivaprasad edited comment on YARN-7420 at 12/6/17 11:58 AM: ---

[jira] [Updated] (YARN-7420) YARN UI changes to depict auto created queues

2017-12-06 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7420: --- Attachment: ScreenShot_Zero_capacity_queues_running_app.png Thanks [~sunilg] Attaching screen s

[jira] [Commented] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16280008#comment-16280008 ] genericqa commented on YARN-7520: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2415) Expose MiniYARNCluster for use outside of YARN

2017-12-06 Thread Andras Piros (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279986#comment-16279986 ] Andras Piros commented on YARN-2415: [~haibochen] when can I expect a patch for this? T

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-06 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279961#comment-16279961 ] Hudson commented on YARN-7610: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1333

[jira] [Updated] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-06 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7473: --- Attachment: YARN-7473.14.patch Attached patch with missing license headers fixed > Implement F

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279938#comment-16279938 ] Weiwei Yang commented on YARN-7610: --- There are still 4 line(s) that end in whitespace in

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279931#comment-16279931 ] genericqa commented on YARN-7610: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-12-06 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7520: --- Attachment: YARN-7520.5.patch Fixed findbugs issue > Queue Ordering policy changes for orderin

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279865#comment-16279865 ] genericqa commented on YARN-7473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279845#comment-16279845 ] genericqa commented on YARN-7610: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: YARN-7610.005.patch > Extend Distributed Shell to support launching job with opportunistic >

[jira] [Commented] (YARN-7561) Why hasContainerForNode() return false directly when there is no request of ANY locality without considering NODE_LOCAL and RACK_LOCAL?

2017-12-06 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279832#comment-16279832 ] Yufei Gu commented on YARN-7561: Thanks for the explanation, [~rkanter]. I'm wondering how

[jira] [Commented] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279821#comment-16279821 ] genericqa commented on YARN-7610: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-7610) Extend Distributed Shell to support launching job with opportunistic containers

2017-12-06 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7610: -- Attachment: YARN-7610.004.patch > Extend Distributed Shell to support launching job with opportunistic >

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-12-06 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16279804#comment-16279804 ] genericqa commented on YARN-7522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||