[jira] [Updated] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-12-07 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-6959: -- Fix Version/s: (was: 2.7.1) 2.7.5 > RM may allocate wrong AM

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282778#comment-16282778 ] Wangda Tan commented on YARN-7473: -- Had a second thought on this. Since we set queue's guaranteed

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282621#comment-16282621 ] Botong Huang commented on YARN-6704: Thanks [~subru] for the comments! A few checks added in

[jira] [Commented] (YARN-7555) Support multiple resource types in YARN native services

2017-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282624#comment-16282624 ] Jian He commented on YARN-7555: --- could you also add API documentation in the YarnServiceAPI.md ? and

[jira] [Created] (YARN-7622) Allow fair-scheduler configuration on HDFS

2017-12-07 Thread Greg Phillips (JIRA)
Greg Phillips created YARN-7622: --- Summary: Allow fair-scheduler configuration on HDFS Key: YARN-7622 URL: https://issues.apache.org/jira/browse/YARN-7622 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7420) YARN UI changes to depict auto created queues

2017-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282751#comment-16282751 ] Wangda Tan commented on YARN-7420: -- Thanks [~suma.shivaprasad], will commit tomorrow if no objections. +

[jira] [Commented] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282747#comment-16282747 ] Wangda Tan commented on YARN-7520: -- Thanks [~suma.shivaprasad], will commit tomorrow if no objections. +

[jira] [Updated] (YARN-7468) Provide means for container network policy control

2017-12-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7468: Issue Type: Task (was: Improvement) > Provide means for container network policy control >

[jira] [Commented] (YARN-7555) Support multiple resource types in YARN native services

2017-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282603#comment-16282603 ] Jian He commented on YARN-7555: --- - In component: serviceResource -> compResource - The name field is

[jira] [Updated] (YARN-7555) Support multiple resource types in YARN native services

2017-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7555: - Attachment: YARN-7555.004.patch Thanks [~jianhe] for commenting, attached ver.4 patch addressed all

[jira] [Commented] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282639#comment-16282639 ] genericqa commented on YARN-7565: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7468) Provide means for container network policy control

2017-12-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282899#comment-16282899 ] Xuan Gong commented on YARN-7468: - I am working on a design doc. Will upload it tomorrow. > Provide means

[jira] [Updated] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-07 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6704: --- Attachment: YARN-6704.v9.patch > Add Federation Interceptor restart when work preserving NM is enabled

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282235#comment-16282235 ] genericqa commented on YARN-7473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7623) Fix the CapacityScheduler Queue configuration documentation

2017-12-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7623: Attachment: YARN-7623.001.patch Hi [~asuresh], thanks for bringing this up, not sure why it's not

[jira] [Commented] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282233#comment-16282233 ] genericqa commented on YARN-7591: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7619) Max AM Resource value in CS UI is different for every user

2017-12-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282707#comment-16282707 ] Eric Payne commented on YARN-7619: -- All of the other solutions I could think of seem undesirable. One

[jira] [Commented] (YARN-7622) Allow fair-scheduler configuration on HDFS

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282578#comment-16282578 ] genericqa commented on YARN-7622: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282718#comment-16282718 ] genericqa commented on YARN-6704: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7623) Fix the CapacityScheduler Queue configuration documentation

2017-12-07 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-7623: --- Assignee: Jonathan Hung > Fix the CapacityScheduler Queue configuration documentation >

[jira] [Updated] (YARN-7482) Max applications calculation per queue has to be retrospected with absolute resource support

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7482: -- Fix Version/s: (was: YARN-5881) 3.1.0 > Max applications calculation per queue has to be

[jira] [Updated] (YARN-7483) CapacityScheduler test cases cleanup post YARN-5881

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7483: -- Fix Version/s: 3.1.0 > CapacityScheduler test cases cleanup post YARN-5881 >

[jira] [Updated] (YARN-7575) NPE in scheduler UI when max-capacity is not configured

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7575: -- Fix Version/s: (was: YARN-5881) 3.1.0 > NPE in scheduler UI when max-capacity is not

[jira] [Updated] (YARN-7564) Cleanup to fix checkstyle issues of YARN-5881 branch

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7564: -- Fix Version/s: (was: YARN-5881) 3.1.0 > Cleanup to fix checkstyle issues of YARN-5881

[jira] [Commented] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283019#comment-16283019 ] Weiwei Yang commented on YARN-7624: --- Hi [~templedf], yes I believe so. Let me update the affected

[jira] [Updated] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7624: -- Affects Version/s: 3.0.0-alpha3 > RM gives YARNFeatureNotEnabledException even when resource profile

[jira] [Commented] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283018#comment-16283018 ] Sunil G commented on YARN-7624: --- [~cheersyang] Which application are u running? From client side,

[jira] [Updated] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7624: -- Affects Version/s: (was: 3.0.0-alpha3) 3.1.0 > RM gives

[jira] [Comment Edited] (YARN-7522) Add application tags manager implementation

2017-12-07 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282948#comment-16282948 ] Konstantinos Karanasos edited comment on YARN-7522 at 12/8/17 2:51 AM:

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282952#comment-16282952 ] Wangda Tan commented on YARN-7522: -- Thanks reviews from [~kkaranasos], test cases are unrelated. > Add

[jira] [Commented] (YARN-7608) RM UI prompted DataTable warning while clicking on percent of queue column

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282942#comment-16282942 ] Weiwei Yang commented on YARN-7608: --- I just tried, it has the same issue when I click {{Reserved CPU

[jira] [Commented] (YARN-402) Dispatcher warn message is too late

2017-12-07 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283150#comment-16283150 ] stefanlee commented on YARN-402: thanks [~djp] our cluster will be very busy between 3.00 a.m. and 7.00 a.m.

[jira] [Commented] (YARN-7623) Fix the CapacityScheduler Queue configuration documentation

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282936#comment-16282936 ] genericqa commented on YARN-7623: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7608) RM UI prompted DataTable warning while clicking on percent of queue column

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282938#comment-16282938 ] Weiwei Yang commented on YARN-7608: --- Thanks for the patch [~GergelyNovak]. One question, in

[jira] [Commented] (YARN-6471) Support to add min/max resource configuration for a queue

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282979#comment-16282979 ] Hudson commented on YARN-6471: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282982#comment-16282982 ] Hudson commented on YARN-7411: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7562) queuePlacementPolicy should not match parent queue

2017-12-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283118#comment-16283118 ] Wilfred Spiegelenburg commented on YARN-7562: - Can you fix the missing line between the tests

[jira] [Updated] (YARN-7608) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7608: -- Target Version/s: 3.0.0, 3.1.0, 2.9.1 > Incorrect sTarget column causing DataTable warning on RM

[jira] [Commented] (YARN-7533) Documentation for absolute resource support in Capacity Scheduler

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282990#comment-16282990 ] Hudson commented on YARN-7533: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7332) Compute effectiveCapacity per each resource vector

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282981#comment-16282981 ] Hudson commented on YARN-7332: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7544) Use queue-path.capacity/maximum-capacity to specify CapacityScheduler absolute min/max resources

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282987#comment-16282987 ] Hudson commented on YARN-7544: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7575) NPE in scheduler UI when max-capacity is not configured

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282989#comment-16282989 ] Hudson commented on YARN-7575: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282980#comment-16282980 ] Hudson commented on YARN-7254: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7483) CapacityScheduler test cases cleanup post YARN-5881

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282984#comment-16282984 ] Hudson commented on YARN-7483: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282985#comment-16282985 ] Hudson commented on YARN-5881: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7538) Fix performance regression introduced by Capacity Scheduler absolute min/max resource refactoring

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282986#comment-16282986 ] Hudson commented on YARN-7538: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7482) Max applications calculation per queue has to be retrospected with absolute resource support

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282983#comment-16282983 ] Hudson commented on YARN-7482: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7564) Cleanup to fix checkstyle issues of YARN-5881 branch

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282988#comment-16282988 ] Hudson commented on YARN-7564: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13345 (See

[jira] [Commented] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2017-12-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283013#comment-16283013 ] Daniel Templeton commented on YARN-7624: This is against trunk/3.1, yes? > RM gives

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283095#comment-16283095 ] Weiwei Yang commented on YARN-7607: --- Sure [~ajisakaa], I just cherry picked the patch to branch-2 too.

[jira] [Updated] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7607: -- Fix Version/s: 2.10.0 > Remove the trailing duplicated timestamp in container diagnostics message >

[jira] [Commented] (YARN-7555) Support multiple resource types in YARN native services

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282853#comment-16282853 ] genericqa commented on YARN-7555: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5881) Enable configuration of queue capacity in terms of absolute resources

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283004#comment-16283004 ] Sunil G commented on YARN-5881: --- Thanks everyone, branch is merged to trunk. > Enable configuration of queue

[jira] [Commented] (YARN-7535) We should display origin value of demand in fair scheduler page

2017-12-07 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283125#comment-16283125 ] Wilfred Spiegelenburg commented on YARN-7535: - [~daemon] if you don't mind I would like to

[jira] [Updated] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7411: -- Fix Version/s: (was: YARN-5881) 3.1.0 > Inter-Queue preemption's

[jira] [Updated] (YARN-7533) Documentation for absolute resource support in Capacity Scheduler

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7533: -- Fix Version/s: (was: YARN-5881) 3.1.0 > Documentation for absolute resource support in

[jira] [Updated] (YARN-7544) Use queue-path.capacity/maximum-capacity to specify CapacityScheduler absolute min/max resources

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7544: -- Fix Version/s: (was: YARN-5881) 3.1.0 > Use queue-path.capacity/maximum-capacity to

[jira] [Updated] (YARN-7538) Fix performance regression introduced by Capacity Scheduler absolute min/max resource refactoring

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7538: -- Fix Version/s: (was: YARN-5881) 3.1.0 > Fix performance regression introduced by Capacity

[jira] [Updated] (YARN-7332) Compute effectiveCapacity per each resource vector

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7332: -- Fix Version/s: (was: YARN-5881) 3.1.0 > Compute effectiveCapacity per each resource

[jira] [Updated] (YARN-7254) UI and metrics changes related to absolute resource configuration

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7254: -- Fix Version/s: (was: YARN-5881) 3.1.0 > UI and metrics changes related to absolute

[jira] [Updated] (YARN-6471) Support to add min/max resource configuration for a queue

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6471: -- Fix Version/s: (was: YARN-5881) 3.1.0 > Support to add min/max resource configuration for

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-12-07 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282948#comment-16282948 ] Konstantinos Karanasos commented on YARN-7522: -- By a quick look, patch looks good. There seem

[jira] [Created] (YARN-7624) RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled

2017-12-07 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7624: - Summary: RM gives YARNFeatureNotEnabledException even when resource profile feature is not enabled Key: YARN-7624 URL: https://issues.apache.org/jira/browse/YARN-7624

[jira] [Updated] (YARN-7608) Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7608: -- Summary: Incorrect sTarget column causing DataTable warning on RM application and scheduler web page

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

2017-12-07 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16283073#comment-16283073 ] Akira Ajisaka commented on YARN-7607: - Thanks! Would you commit this in branch-2 as well? > Remove the

[jira] [Commented] (YARN-7595) Container launching code suppresses close exceptions after writes

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282511#comment-16282511 ] genericqa commented on YARN-7595: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-12-07 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7565: Attachment: YARN-7565.003.patch Patch 3: - Fixed checkstyle error Test

[jira] [Commented] (YARN-7595) Container launching code suppresses close exceptions after writes

2017-12-07 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282541#comment-16282541 ] Jim Brennan commented on YARN-7595: --- The JUnit test that failed (testValidEnvVariableSubstitution) fails

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282515#comment-16282515 ] Wangda Tan commented on YARN-7473: -- Thanks [~suma.shivaprasad], for updating the patch. I suggest to

[jira] [Created] (YARN-7620) Allow partition filters on Queues page

2017-12-07 Thread Vasudevan Skm (JIRA)
Vasudevan Skm created YARN-7620: --- Summary: Allow partition filters on Queues page Key: YARN-7620 URL: https://issues.apache.org/jira/browse/YARN-7620 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Comment Edited] (YARN-7616) App status does not return state STABLE for a running and stable service

2017-12-07 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16280814#comment-16280814 ] Gour Saha edited comment on YARN-7616 at 12/7/17 9:07 AM: -- Currently the code uses

[jira] [Updated] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

2017-12-07 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7607: Target Version/s: 3.1.0, 2.9.1, 3.0.1 (was: 3.1.0) > Remove the trailing duplicated timestamp in

[jira] [Comment Edited] (YARN-7612) Add Placement Processor and planner framework

2017-12-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281504#comment-16281504 ] Arun Suresh edited comment on YARN-7612 at 12/7/17 8:44 AM: Updating with a v2

[jira] [Updated] (YARN-7612) Add Placement Processor and planner framework

2017-12-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7612: -- Attachment: YARN-7612-v2.wip.patch Updating with a v2 version of the patch. * Rebased on latest version

[jira] [Commented] (YARN-7620) Allow partition filters on Queues page

2017-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281532#comment-16281532 ] ASF GitHub Bot commented on YARN-7620: -- Github user skmvasu commented on the issue:

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

2017-12-07 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281475#comment-16281475 ] Akira Ajisaka commented on YARN-7607: - This issue occurred because YARN-6306 added timestamp for

[jira] [Updated] (YARN-7612) Add Placement Processor and planner framework

2017-12-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7612: -- Attachment: YARN-7612-YARN-6592.combined.patch > Add Placement Processor and planner framework >

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281515#comment-16281515 ] Weiwei Yang commented on YARN-7607: --- Thanks [~ajisakaa] for the review, I will commit this to branch-2.9,

[jira] [Assigned] (YARN-7608) RM UI prompted DataTable warning while clicking on percent of queue column

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák reassigned YARN-7608: --- Assignee: Gergely Novák > RM UI prompted DataTable warning while clicking on percent of queue

[jira] [Commented] (YARN-7608) RM UI prompted DataTable warning while clicking on percent of queue column

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281939#comment-16281939 ] Gergely Novák commented on YARN-7608: - This is caused by YARN-6752 which added two more columns to the

[jira] [Updated] (YARN-7608) RM UI prompted DataTable warning while clicking on percent of queue column

2017-12-07 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-7608: Attachment: YARN-7608.001.patch > RM UI prompted DataTable warning while clicking on percent of

[jira] [Updated] (YARN-7616) App status does not return state STABLE for a running and stable service

2017-12-07 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7616: Attachment: YARN-7616.001.patch > App status does not return state STABLE for a running and stable service >

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

2017-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281701#comment-16281701 ] Hudson commented on YARN-7607: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13339 (See

[jira] [Comment Edited] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281515#comment-16281515 ] Weiwei Yang edited comment on YARN-7607 at 12/7/17 9:46 AM: Thanks [~ajisakaa]

[jira] [Commented] (YARN-7607) Remove the trailing duplicated timestamp in container diagnostics message

2017-12-07 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281574#comment-16281574 ] Weiwei Yang commented on YARN-7607: --- I've committed the patch to branch-2.9, branch-3.0, branch-3.0.0 and

[jira] [Commented] (YARN-7616) App status does not return state STABLE for a running and stable service

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281756#comment-16281756 ] genericqa commented on YARN-7616: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-12-07 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281546#comment-16281546 ] genericqa commented on YARN-7119: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2017-12-07 Thread Tao Yang (JIRA)
Tao Yang created YARN-7621: -- Summary: Support submitting apps with queue path for CapacityScheduler Key: YARN-7621 URL: https://issues.apache.org/jira/browse/YARN-7621 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-12-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7591: --- Attachment: YARN-7591.002.patch Thanks [~leftnoteasy] for your suggestion. Attaching v2 patch with comments

[jira] [Comment Edited] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-07 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281824#comment-16281824 ] Suma Shivaprasad edited comment on YARN-7473 at 12/7/17 1:11 PM: - Thanks

[jira] [Updated] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-12-07 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7473: --- Attachment: YARN-7473.15.patch Thanks [~wangda] Attached patch with review comments addressed.

[jira] [Updated] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2017-12-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7621: --- Attachment: YARN-7621.001.patch Attaching init patch for review. > Support submitting apps with queue path

[jira] [Assigned] (YARN-7621) Support submitting apps with queue path for CapacityScheduler

2017-12-07 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang reassigned YARN-7621: -- Assignee: Tao Yang > Support submitting apps with queue path for CapacityScheduler >

[jira] [Updated] (YARN-7420) YARN UI changes to depict auto created queues

2017-12-07 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7420: --- Attachment: ScreenShot_AutoCreated_Queues_Legend_color.png Attaching screenshot of the legend

[jira] [Updated] (YARN-7327) CapacityScheduler: Allocate containers asynchronously by default

2017-12-07 Thread Craig Ingram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Ingram updated YARN-7327: --- Attachment: async-scheduling-results.md schedule-async.png

[jira] [Commented] (YARN-7327) CapacityScheduler: Allocate containers asynchronously by default

2017-12-07 Thread Craig Ingram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16281840#comment-16281840 ] Craig Ingram commented on YARN-7327: I finally got around to trying out asynchronous container

[jira] [Commented] (YARN-7616) App status does not return state STABLE for a running and stable service

2017-12-07 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282050#comment-16282050 ] Billie Rinaldi commented on YARN-7616: -- Thanks for the patch, [~gsaha]! A few comments: * Regarding

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282137#comment-16282137 ] Sunil G commented on YARN-7119: --- Thanks [~dan...@cloudera.com]. Sure, will commit it later today. > yarn

[jira] [Commented] (YARN-7616) App status does not return state STABLE for a running and stable service

2017-12-07 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282192#comment-16282192 ] Gour Saha commented on YARN-7616: - [~billie.rinaldi], thanks for taking a look at the patch. I am

[jira] [Commented] (YARN-6906) Cluster Node API and Cluster Nodes API should report resource types information

2017-12-07 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16282207#comment-16282207 ] Manikandan R commented on YARN-6906: Lets say, A node has been assigned with various resource types

  1   2   >