[jira] [Comment Edited] (YARN-8511) When AM releases a container, RM removes allocation tags before it is released by NM

2018-07-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539595#comment-16539595 ] Weiwei Yang edited comment on YARN-8511 at 7/11/18 5:56 AM: Fix UT failure in

[jira] [Updated] (YARN-8511) When AM releases a container, RM removes allocation tags before it is released by NM

2018-07-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8511: -- Attachment: YARN-8511.002.patch > When AM releases a container, RM removes allocation tags before it is

[jira] [Commented] (YARN-8511) When AM releases a container, RM removes allocation tags before it is released by NM

2018-07-10 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539595#comment-16539595 ] Weiwei Yang commented on YARN-8511: --- Fix UT failure in v2 patch... > When AM releases a container, RM

[jira] [Commented] (YARN-8383) TimelineServer 1.5 start fails with NoClassDefFoundError

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539582#comment-16539582 ] Rohith Sharma K S commented on YARN-8383: - +1 lgtm.. Tested in single node cluster. committing

[jira] [Commented] (YARN-8473) Containers being launched as app tears down can leave containers in NEW state

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539581#comment-16539581 ] Rohith Sharma K S commented on YARN-8473: - +1 compiled on branch-2.8 and succeeded. The QA reports

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch, > had

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch, >

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch,

[jira] [Commented] (YARN-8473) Containers being launched as app tears down can leave containers in NEW state

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539570#comment-16539570 ] genericqa commented on YARN-8473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8434) Nodemanager not registering to active RM in federation

2018-07-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539558#comment-16539558 ] Bibin A Chundatt commented on YARN-8434: Thanks [~subru] for clarification. Will try removing the

[jira] [Comment Edited] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-07-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539550#comment-16539550 ] Bibin A Chundatt edited comment on YARN-8505 at 7/11/18 4:36 AM: - [~Tao

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-07-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539550#comment-16539550 ] Bibin A Chundatt commented on YARN-8505: [~Tao Yang] Thank you for clarification

[jira] [Commented] (YARN-8473) Containers being launched as app tears down can leave containers in NEW state

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539531#comment-16539531 ] genericqa commented on YARN-8473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch, > hadoop-2

[jira] [Resolved] (YARN-8516) branch-2.8 compilation faliure for hadoop-yarn-server-nodemanager module

2018-07-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-8516. -- Resolution: Duplicate Thanks [~rohithsharma]. I am handling this as an addendum patch for

[jira] [Updated] (YARN-8473) Containers being launched as app tears down can leave containers in NEW state

2018-07-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8473: - Attachment: YARN-8473-branch-2.8.addendum.001.patch > Containers being launched as app tears down

[jira] [Reopened] (YARN-8473) Containers being launched as app tears down can leave containers in NEW state

2018-07-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reopened YARN-8473: -- reopening Jira to fix branch-2.8 compile pblm with respect to log. It seems  sl4j migration is not

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-07-10 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539495#comment-16539495 ] Tao Yang commented on YARN-8505: {quote} Above properties are for total application in queue, not running

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539494#comment-16539494 ] genericqa commented on YARN-7129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8516) branch-2.8 compilation faliure for hadoop-yarn-server-nodemanager module

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8516: Summary: branch-2.8 compilation faliure for hadoop-yarn-server-nodemanager module (was:

[jira] [Created] (YARN-8516) Compilation error for branch-2.8

2018-07-10 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-8516: --- Summary: Compilation error for branch-2.8 Key: YARN-8516 URL: https://issues.apache.org/jira/browse/YARN-8516 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch, >

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch, > had

[jira] [Commented] (YARN-8434) Nodemanager not registering to active RM in federation

2018-07-10 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539415#comment-16539415 ] Subru Krishnan commented on YARN-8434: -- Thanks [~bibinchundatt] for the clarification, I understand

[jira] [Comment Edited] (YARN-8361) Change App Name Placement Rule to use App Name instead of App Id for configuration

2018-07-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539411#comment-16539411 ] Suma Shivaprasad edited comment on YARN-8361 at 7/11/18 12:38 AM: -- [~Zian

[jira] [Commented] (YARN-8361) Change App Name Placement Rule to use App Name instead of App Id for configuration

2018-07-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539411#comment-16539411 ] Suma Shivaprasad commented on YARN-8361: [~Zian Chen] Patch 002 LGTM. +1 > Change App Name

[jira] [Commented] (YARN-8360) Yarn service conflict between restart policy and NM configuration

2018-07-10 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539405#comment-16539405 ] Gour Saha commented on YARN-8360: - Thanks [~suma.shivaprasad], patch 1 looks good to me. +1. > Yarn

[jira] [Updated] (YARN-7129) Application Catalog for YARN applications

2018-07-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7129: Attachment: YARN-7129.004.patch > Application Catalog for YARN applications >

[jira] [Commented] (YARN-8360) Yarn service conflict between restart policy and NM configuration

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539355#comment-16539355 ] genericqa commented on YARN-8360: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch, > had

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch,

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch, > had

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539309#comment-16539309 ] genericqa commented on YARN-7129: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8515) container-executor can crash with SIGPIPE after nodemanager restart

2018-07-10 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8515: -- Labels: Docker (was: ) > container-executor can crash with SIGPIPE after nodemanager restart >

[jira] [Commented] (YARN-8515) container-executor can crash with SIGPIPE after nodemanager restart

2018-07-10 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539290#comment-16539290 ] Jim Brennan commented on YARN-8515: --- I have been able to repro this reliably on a test cluster. Repro

[jira] [Updated] (YARN-8360) Yarn service conflict between restart policy and NM configuration

2018-07-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8360: --- Attachment: YARN-8360.1.patch > Yarn service conflict between restart policy and NM

[jira] [Commented] (YARN-8515) container-executor can crash with SIGPIPE after nodemanager restart

2018-07-10 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539286#comment-16539286 ] Jim Brennan commented on YARN-8515: --- Here is an example case that we saw: Docker ps info for this

[jira] [Commented] (YARN-8421) when moving app, activeUsers is increased, even though app does not have outstanding request

2018-07-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539269#comment-16539269 ] Eric Payne commented on YARN-8421: -- [~kyungwan nam], Thank you for providing the fix for this problem.

[jira] [Created] (YARN-8515) container-executor can crash with SIGPIPE after nodemanager restart

2018-07-10 Thread Jim Brennan (JIRA)
Jim Brennan created YARN-8515: - Summary: container-executor can crash with SIGPIPE after nodemanager restart Key: YARN-8515 URL: https://issues.apache.org/jira/browse/YARN-8515 Project: Hadoop YARN

[jira] [Updated] (YARN-8514) YARN RegistryDNS throws NPE when Kerberos tgt expires

2018-07-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8514: Affects Version/s: 2.9.2 2.9.0 3.0.0

[jira] [Commented] (YARN-8514) YARN RegistryDNS throws NPE when Kerberos tgt expires

2018-07-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539164#comment-16539164 ] Eric Yang commented on YARN-8514: - This NPE is introduced by YARN-4983.  UgiMetrics will not be

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539156#comment-16539156 ] genericqa commented on YARN-4606: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8514) YARN RegistryDNS throws NPE when Kerberos tgt expires

2018-07-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8514: Description: After Kerberos ticket expires, RegistryDNS throws NPE error: {code:java} 2018-07-06

[jira] [Updated] (YARN-7129) Application Catalog for YARN applications

2018-07-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7129: Attachment: YARN-7129.003.patch > Application Catalog for YARN applications >

[jira] [Created] (YARN-8514) YARN RegistryDNS throws NPE when Kerberos tgt expires

2018-07-10 Thread Eric Yang (JIRA)
Eric Yang created YARN-8514: --- Summary: YARN RegistryDNS throws NPE when Kerberos tgt expires Key: YARN-8514 URL: https://issues.apache.org/jira/browse/YARN-8514 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8502) Use path strings consistently for webservice endpoints in RMWebServices

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539097#comment-16539097 ] Szilard Nemeth commented on YARN-8502: -- Thanks [~giovanni.fumarola] for the quick responses and for

[jira] [Commented] (YARN-8502) Use path strings consistently for webservice endpoints in RMWebServices

2018-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539092#comment-16539092 ] Hudson commented on YARN-8502: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14551 (See

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539060#comment-16539060 ] genericqa commented on YARN-8468: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539027#comment-16539027 ] Wangda Tan commented on YARN-8512: -- Patch LGTM as well, thanks [~rohithsharma] for the fix. > ATSv2

[jira] [Updated] (YARN-8502) Use path strings consistently for webservice endpoints in RMWebServices

2018-07-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8502: --- Fix Version/s: 3.2.0 > Use path strings consistently for webservice endpoints

[jira] [Commented] (YARN-8502) Use path strings consistently for webservice endpoints in RMWebServices

2018-07-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539009#comment-16539009 ] Giovanni Matteo Fumarola commented on YARN-8502: Thanks [~snemeth] for working on this.

[jira] [Created] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-07-10 Thread Che Yufei (JIRA)
Che Yufei created YARN-8513: --- Summary: CapacityScheduler infinite loop when queue is near fully utilized Key: YARN-8513 URL: https://issues.apache.org/jira/browse/YARN-8513 Project: Hadoop YARN

[jira] [Commented] (YARN-8502) Use path strings consistently for webservice endpoints in RMWebServices

2018-07-10 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538998#comment-16538998 ] Giovanni Matteo Fumarola commented on YARN-8502: Ok. I will open a Jira to fix those. +1

[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538996#comment-16538996 ] Rohith Sharma K S commented on YARN-8512: - It looks like QA is trying to execute native binaries

[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538967#comment-16538967 ] genericqa commented on YARN-8512: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-07-10 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-4606: --- Attachment: YARN-4606.006.patch > CapacityScheduler: applications could get starved because

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-07-10 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538949#comment-16538949 ] Manikandan R commented on YARN-4606: Fixed whitespace related issues. > CapacityScheduler:

[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538849#comment-16538849 ] Sunil Govindan commented on YARN-8512: -- Thanks [~rohithsharma]. Patch seems fine to me. > ATSv2

[jira] [Comment Edited] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-10 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538831#comment-16538831 ] Antal Bálint Steinbach edited comment on YARN-8468 at 7/10/18 3:54 PM:

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-10 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538831#comment-16538831 ] Antal Bálint Steinbach commented on YARN-8468: -- Hi [~snemeth] Thanks for the feedback. I

[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538830#comment-16538830 ] Rohith Sharma K S commented on YARN-8512: - Updated the patch with test case added. > ATSv2

[jira] [Updated] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8512: Attachment: YARN-8512.03.patch > ATSv2 entities are not published to HBase from second

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-10 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.003.patch > Limit container sizes per queue in

[jira] [Commented] (YARN-8473) Containers being launched as app tears down can leave containers in NEW state

2018-07-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538779#comment-16538779 ] Hudson commented on YARN-8473: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14549 (See

[jira] [Commented] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538770#comment-16538770 ] Szilard Nemeth commented on YARN-8501: -- Hi [~Zian Chen]! As my intellij marks this method with a

[jira] [Commented] (YARN-8383) TimelineServer 1.5 start fails with NoClassDefFoundError

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538763#comment-16538763 ] Rohith Sharma K S commented on YARN-8383: - Sure. I am doing verification and will commit it later

[jira] [Commented] (YARN-8502) Use path strings consistently for webservice endpoints in RMWebServices

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538764#comment-16538764 ] Szilard Nemeth commented on YARN-8502: -- Hey [~giovanni.fumarola]! I would vote for a separate jira as

[jira] [Commented] (YARN-8383) TimelineServer 1.5 start fails with NoClassDefFoundError

2018-07-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538755#comment-16538755 ] Jason Lowe commented on YARN-8383: -- bq. change in HDFS is an incompatible change from branch-2.8 to

[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538750#comment-16538750 ] genericqa commented on YARN-8512: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop-2.7.2.gpu-port-20180710.patch > Gpu locality support for Better AI schedul

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop-2.7.2.gpu-port-20180710.patch) > Gpu locality support for Better

[jira] [Commented] (YARN-8383) TimelineServer 1.5 start fails with NoClassDefFoundError

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538734#comment-16538734 ] Rohith Sharma K S commented on YARN-8383: - Ahh.. I misunderstood your earlier comment. Thanks for

[jira] [Commented] (YARN-8473) Containers being launched as app tears down can leave containers in NEW state

2018-07-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538701#comment-16538701 ] Sunil Govindan commented on YARN-8473: -- Thanks [~jlowe]. I ll help to commit this. > Containers

[jira] [Commented] (YARN-8383) TimelineServer 1.5 start fails with NoClassDefFoundError

2018-07-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538699#comment-16538699 ] Jason Lowe commented on YARN-8383: -- bq. I think adding dependencies share/hadoop/yarn/lib is right way to

[jira] [Comment Edited] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538572#comment-16538572 ] Rohith Sharma K S edited comment on YARN-8512 at 7/10/18 1:49 PM: --

[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538599#comment-16538599 ] Rohith Sharma K S commented on YARN-8512: - Attached 02 patch that sets  flow context in existing

[jira] [Updated] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8512: Attachment: YARN-8512.02.patch > ATSv2 entities are not published to HBase from second

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch,

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch, hadoop-2.7.

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538579#comment-16538579 ] genericqa commented on YARN-8480: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538572#comment-16538572 ] Rohith Sharma K S commented on YARN-8512: - 01.patch seems to be issue if we update ApplicationImpl

[jira] [Updated] (YARN-8512) ATSv2 entities are not published to HBase from second attempt onwards

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8512: Summary: ATSv2 entities are not published to HBase from second attempt onwards (was: ATSv2

[jira] [Commented] (YARN-8512) ATSv2 entities are not published to HBase

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538556#comment-16538556 ] Rohith Sharma K S commented on YARN-8512: - Attached the patch with following modifications to

[jira] [Updated] (YARN-8512) ATSv2 entities are not published to HBase

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8512: Affects Version/s: 3.0.3 3.2.0 2.10.0

[jira] [Updated] (YARN-8512) ATSv2 entities are not published to HBase

2018-07-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8512: Attachment: YARN-8512.01.patch > ATSv2 entities are not published to HBase >

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
Affects Versions: 2.7.2 >Reporter: Chen Qingcha >Priority: Major > Fix For: 2.7.2 > > Attachments: GPU locality support for Job scheduling.pdf, > hadoop-2.7.2.gpu-port-20180710.patch, > hadoop-2.7.2.gpu-port-20180710_old.patch, hadoop-2.7.

[jira] [Commented] (YARN-8511) When AM releases a container, RM removes allocation tags before it is released by NM

2018-07-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538478#comment-16538478 ] genericqa commented on YARN-8511: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8505) AMLimit and userAMLimit check should be skipped for unmanaged AM

2018-07-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538425#comment-16538425 ] Bibin A Chundatt commented on YARN-8505: {quote} maxApplications and maxApplicationsPerUser. 

[jira] [Created] (YARN-8512) ATSv2 entities are not published to HBase

2018-07-10 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-8512: --- Summary: ATSv2 entities are not published to HBase Key: YARN-8512 URL: https://issues.apache.org/jira/browse/YARN-8512 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop-2.7.2.gpu-port-20180710.patch) > Gpu locality support for Better

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop-2.7.2.gpu-port-20180710.patch > Gpu locality support for Better AI schedul

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538344#comment-16538344 ] Szilard Nemeth commented on YARN-8480: -- Uploaded second patch that fixes the trailing whitespace

[jira] [Updated] (YARN-8480) Add boolean option for resources

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8480: - Attachment: YARN-8480.002.patch > Add boolean option for resources >

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538323#comment-16538323 ] Szilard Nemeth commented on YARN-8468: -- Hi [~bsteinbach]! Thanks for the patch. This is high quality

[jira] [Comment Edited] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538323#comment-16538323 ] Szilard Nemeth edited comment on YARN-8468 at 7/10/18 9:41 AM: --- Hi

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop-2.7.2.gpu-port-20180710.patch) > Gpu locality support for Better

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop-2.7.2.gpu-port-20180710.patch > Gpu locality support for Better AI schedul

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop-2.7.2.gpu-port-20180710.patch > Gpu locality support for Better AI schedul

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: (was: hadoop-2.7.2.gpu-port-20180710.patch) > Gpu locality support for Better

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-07-10 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop-2.7.2.gpu-port-20180710.patch > Gpu locality support for Better AI schedul

  1   2   >