[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335482#comment-16335482 ] Haibo Chen commented on YARN-5473: -- I kicked off another Jenkins run. The findbug warning as well as the

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335493#comment-16335493 ] Sunil G commented on YARN-7779: --- pending jenkins > Display allocation tags in RM web UI and expose via REST

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335491#comment-16335491 ] Weiwei Yang commented on YARN-7779: --- Hi [~sunilg], sure thing. I just rebased the patch as v6, pending on

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335507#comment-16335507 ] Weiwei Yang commented on YARN-7783: --- [~asuresh] yeah, that addressed my concern, thanks for getting it

[jira] [Commented] (YARN-7626) allow regular expression matching in container-executor.cfg for devices and volumes

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335505#comment-16335505 ] genericqa commented on YARN-7626: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335483#comment-16335483 ] Sunil G edited comment on YARN-7779 at 1/23/18 8:15 AM: [~cheersyang] one quick

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335483#comment-16335483 ] Sunil G commented on YARN-7779: --- [~cheersyang] one quick help. This patch needs a rebase and oneĀ  commit

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335501#comment-16335501 ] Arun Suresh commented on YARN-7783: --- Uploaded patch after rebasing. [~cheersyang], so after YARN-7788,

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7779: -- Attachment: YARN-7779-YARN-6592.005.patch > Display allocation tags in RM web UI and expose via REST API

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335476#comment-16335476 ] genericqa commented on YARN-5473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7788) Factor out management of temp tags from AllocationTagsManager

2018-01-23 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-7788: - Description: Instead of using the AllocationTagsManagerĀ to store the temp tags

[jira] [Updated] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7783: -- Attachment: YARN-7783-YARN-6592.004.patch > Add validation step to ensure constraints are not violated

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335564#comment-16335564 ] genericqa commented on YARN-7791: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7793) Lots of parsing error reported on nodemanager after activating yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled

2018-01-23 Thread Nicolas Fraison (JIRA)
Nicolas Fraison created YARN-7793: - Summary: Lots of parsing error reported on nodemanager after activating yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled Key: YARN-7793 URL:

[jira] [Updated] (YARN-7793) Lots of parsing error reported on nodemanager after activating yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled

2018-01-23 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated YARN-7793: -- Attachment: YARN-7793.001.patch > Lots of parsing error reported on nodemanager after activating

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335562#comment-16335562 ] Sunil G commented on YARN-7791: --- Attaching patch to solve this. I tested this and works fine as expected when

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335563#comment-16335563 ] Sunil G commented on YARN-7791: --- cc/ [~cheersyang] [~leftnoteasy] [~asuresh] > Support submit intra-app

[jira] [Commented] (YARN-7789) Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335565#comment-16335565 ] Sunil G commented on YARN-7789: --- When DefaultResourceCalculator is configured, only Memory will work. I think

[jira] [Updated] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7791: -- Attachment: YARN-7791-YARN-6592.001.patch > Support submit intra-app placement constraint in Distributed Shell

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335622#comment-16335622 ] genericqa commented on YARN-7783: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7772) yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled is not taken if process-tree class is not set

2018-01-23 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated YARN-7772: -- Environment: cloudera release cdh-5.11.0 openjdk version "1.8.0_91" linux centos7 servers

[jira] [Updated] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7791: -- Attachment: YARN-7791.001.patch > Support submit intra-app placement constraint in Distributed Shell to >

[jira] [Created] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
Sunil G created YARN-7792: - Summary: Merge work for YARN-6592 Key: YARN-7792 URL: https://issues.apache.org/jira/browse/YARN-7792 Project: Hadoop YARN Issue Type: Sub-task Reporter:

[jira] [Updated] (YARN-7793) Lots of parsing error reported on nodemanager after activating yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled

2018-01-23 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated YARN-7793: -- Description: After activating

[jira] [Updated] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7792: -- Attachment: YARN-6592.001.patch > Merge work for YARN-6592 > > > Key:

[jira] [Assigned] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7792: - Assignee: (was: Sunil G) > Merge work for YARN-6592 > > >

[jira] [Commented] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335589#comment-16335589 ] Sunil G commented on YARN-7792: --- rebased and attach v1 patch for jenkins (whole branch code) > Merge work

[jira] [Commented] (YARN-7755) Clean up deprecation messages for allocation increments in FS config

2018-01-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335607#comment-16335607 ] Wilfred Spiegelenburg commented on YARN-7755: - thank you for the commit [~yufeigu] > Clean up

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335617#comment-16335617 ] genericqa commented on YARN-7791: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7772) yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled is not taken if process-tree class is not set

2018-01-23 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335522#comment-16335522 ] Nicolas Fraison commented on YARN-7772: --- [~vinodkv] and [~rajesh.balamohan] could you please review.

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335567#comment-16335567 ] Sunil G commented on YARN-7791: --- Patch was not named correctly for branch, reattaching same > Support submit

[jira] [Updated] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7791: -- Attachment: (was: YARN-7791.001.patch) > Support submit intra-app placement constraint in Distributed Shell

[jira] [Commented] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335569#comment-16335569 ] Sunil G commented on YARN-7792: --- I will attach an aggregated patch to run against trunk after branch rebase.

[jira] [Assigned] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7792: - Assignee: Sunil G > Merge work for YARN-6592 > > > Key:

[jira] [Updated] (YARN-7793) Lots of parsing error reported on nodemanager after activating yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled

2018-01-23 Thread Nicolas Fraison (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicolas Fraison updated YARN-7793: -- Attachment: YARN-7793.patch > Lots of parsing error reported on nodemanager after activating >

[jira] [Comment Edited] (YARN-7786) NullPointerException while launching ApplicationMaster

2018-01-23 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335640#comment-16335640 ] lujie edited comment on YARN-7786 at 1/23/18 11:04 AM: --- I have restudy this bug,

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335645#comment-16335645 ] genericqa commented on YARN-7779: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7786) NullPointerException while launching ApplicationMaster

2018-01-23 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7786: Priority: Minor (was: Major) > NullPointerException while launching ApplicationMaster >

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335653#comment-16335653 ] Weiwei Yang commented on YARN-7791: --- Hi [~sunilg] As an end user, do I have to specify {{intra_app}} or

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335671#comment-16335671 ] Wangda Tan commented on YARN-7791: -- I'd prefer to add this option to unblock tests. And we need to support

[jira] [Commented] (YARN-7786) NullPointerException while launching ApplicationMaster

2018-01-23 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335640#comment-16335640 ] lujie commented on YARN-7786: - I have restudy this bug, sorry about that previous analysis was wrong. I use

[jira] [Commented] (YARN-7793) Lots of parsing error reported on nodemanager after activating yarn.nodemanager.container-monitor.procfs-tree.smaps-based-rss.enabled

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335657#comment-16335657 ] genericqa commented on YARN-7793: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335664#comment-16335664 ] Sunil G commented on YARN-7791: --- The way I see this is a bit different. We will be supporting inter_app very

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose same through REST API

2018-01-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7779: -- Summary: Display allocation tags in RM web UI and expose same through REST API (was: Display allocation tags in

[jira] [Updated] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7790: - Attachment: YARN-7790.001.patch > Improve Capacity Scheduler Async Scheduling to better handle node

[jira] [Commented] (YARN-7782) Enable user re-mapping for Docker containers in yarn-default.xml

2018-01-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336653#comment-16336653 ] Eric Yang commented on YARN-7782: - Thank you [~jianhe]! > Enable user re-mapping for Docker containers in

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336650#comment-16336650 ] Eric Yang commented on YARN-7605: - +1 Patch 20 looks good to me. > Implement doAs for Api Service REST API

[jira] [Commented] (YARN-7777) Fix user name format in YARN Registry DNS name

2018-01-23 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336672#comment-16336672 ] Billie Rinaldi commented on YARN-: -- That should be encodedName =

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336695#comment-16336695 ] Arun Suresh commented on YARN-7783: --- Yes, [~kkaranasos] also suggested validating implied constraints, at

[jira] [Commented] (YARN-7732) Support Pluggable AM Simulator

2018-01-23 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336773#comment-16336773 ] Young Chen commented on YARN-7732: -- Submitted [^YARN-7732-YARN-7798.01.patch] which has the reservation

[jira] [Updated] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7790: - Description: This is not a new issue but async scheduling makes it worse: In sync scheduling, if an AM

[jira] [Updated] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7790: - Attachment: YARN-7790.002.patch > Improve Capacity Scheduler Async Scheduling to better handle node

[jira] [Commented] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336772#comment-16336772 ] Wangda Tan commented on YARN-7790: -- Attached ver.2 patch, [~sunilg] could you help with patch review? >

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336787#comment-16336787 ] Weiwei Yang commented on YARN-7757: --- Hi [~Naganarasimha] I thought about this after the discussion we

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336857#comment-16336857 ] Arun Suresh commented on YARN-7791: --- Can you check if this works for the Processor as well ? > Support

[jira] [Commented] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336866#comment-16336866 ] genericqa commented on YARN-7790: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336868#comment-16336868 ] Arun Suresh commented on YARN-7791: --- I agree with [~cheersyang] - until we support inter-app, we should

[jira] [Updated] (YARN-7801) AmFilterInitializer should addFilter after fill all parameters

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7801: - Attachment: YARN-7801.001.patch > AmFilterInitializer should addFilter after fill all parameters >

[jira] [Created] (YARN-7801) AmFilterInitializer should addFilter after fill all parameters

2018-01-23 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7801: Summary: AmFilterInitializer should addFilter after fill all parameters Key: YARN-7801 URL: https://issues.apache.org/jira/browse/YARN-7801 Project: Hadoop YARN

[jira] [Updated] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-23 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6648: --- Attachment: YARN-6648-YARN-7402.v6.patch > [GPG] Add SubClusterCleaner in Global Policy Generator >

[jira] [Commented] (YARN-7801) AmFilterInitializer should addFilter after fill all parameters

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336966#comment-16336966 ] genericqa commented on YARN-7801: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-2185) Use pipes when localizing archives

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337005#comment-16337005 ] Miklos Szegedi edited comment on YARN-2185 at 1/24/18 6:30 AM: --- I opened

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337007#comment-16337007 ] Miklos Szegedi commented on YARN-5473: -- +1. I will commit this shortly. The unit test is YARN-7020 as

[jira] [Commented] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337021#comment-16337021 ] genericqa commented on YARN-7792: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337037#comment-16337037 ] Haibo Chen commented on YARN-5473: -- Thanks [~miklos.szeg...@cloudera.com] for the reviews! > Expose

[jira] [Commented] (YARN-7801) AmFilterInitializer should addFilter after fill all parameters

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336904#comment-16336904 ] Wangda Tan commented on YARN-7801: -- Attached fix, [~jianhe] could you help to review the patch? >

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336942#comment-16336942 ] Miklos Szegedi commented on YARN-7796: -- +1 LGTM. The docker issue is unrelated. > Container-executor

[jira] [Created] (YARN-7803) TestZKFailoverController occasionally fails in trunk

2018-01-23 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7803: Summary: TestZKFailoverController occasionally fails in trunk Key: YARN-7803 URL: https://issues.apache.org/jira/browse/YARN-7803 Project: Hadoop YARN Issue

[jira] [Created] (YARN-7802) Application regex search did not work properly with app name

2018-01-23 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7802: Summary: Application regex search did not work properly with app name Key: YARN-7802 URL: https://issues.apache.org/jira/browse/YARN-7802 Project: Hadoop YARN

[jira] [Commented] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337020#comment-16337020 ] genericqa commented on YARN-7792: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7792) Merge work for YARN-6592

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337031#comment-16337031 ] genericqa commented on YARN-7792: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336892#comment-16336892 ] genericqa commented on YARN-6648: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336958#comment-16336958 ] Hudson commented on YARN-7796: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13544 (See

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336988#comment-16336988 ] genericqa commented on YARN-5473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7796) Container-executor fails with segfault on certain OS configurations

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7796: - Fix Version/s: 3.0.1 > Container-executor fails with segfault on certain OS configurations >

[jira] [Updated] (YARN-7803) TestZKFailoverController occasionally fails in trunk

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7803: - Description: I see this sometimes in Apache jenkins runs sometimes but pretty consistently with

[jira] [Created] (YARN-7804) Refresh action on Grid view page should not be redirected to graph view

2018-01-23 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7804: Summary: Refresh action on Grid view page should not be redirected to graph view Key: YARN-7804 URL: https://issues.apache.org/jira/browse/YARN-7804 Project: Hadoop YARN

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337005#comment-16337005 ] Miklos Szegedi commented on YARN-2185: -- I opened YARN-7803 for the unit test error. > Use pipes when

[jira] [Created] (YARN-7805) Yarn should update container as failed on docker container failure

2018-01-23 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7805: Summary: Yarn should update container as failed on docker container failure Key: YARN-7805 URL: https://issues.apache.org/jira/browse/YARN-7805 Project: Hadoop YARN

[jira] [Commented] (YARN-6648) [GPG] Add SubClusterCleaner in Global Policy Generator

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336694#comment-16336694 ] genericqa commented on YARN-6648: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7732) Support Pluggable AM Simulator

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336774#comment-16336774 ] genericqa commented on YARN-7732: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336820#comment-16336820 ] Arun Suresh commented on YARN-7783: --- [~cheersyang], w.r.t your idea of binding node constraints - I like

[jira] [Comment Edited] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336857#comment-16336857 ] Arun Suresh edited comment on YARN-7791 at 1/24/18 4:03 AM: Can you check if

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-23 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336643#comment-16336643 ] Miklos Szegedi commented on YARN-5473: -- +1 pending Jenkins. > Expose per-application over-allocation

[jira] [Updated] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7790: - Description: This is not a new issue but async scheduling makes it worse: In sync scheduling, if an AM

[jira] [Updated] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7790: - Reporter: Sumana Sathish (was: Wangda Tan) > Improve Capacity Scheduler Async Scheduling to better handle

[jira] [Updated] (YARN-7798) Refactor SLS Reservation Creation

2018-01-23 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Young Chen updated YARN-7798: - Attachment: YARN-7798.01.patch > Refactor SLS Reservation Creation > - > >

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-23 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336755#comment-16336755 ] Billie Rinaldi commented on YARN-7605: -- Thanks for all the hard work writing and reviewing this patch,

[jira] [Updated] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7790: - Description: This is not a new issue but async scheduling makes it worse: In sync scheduling, if an AM

[jira] [Updated] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7790: - Description: This is not a new issue but async scheduling makes it worse: In sync scheduling, if an AM

[jira] [Updated] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7790: - Description: This is not a new issue but async scheduling makes it worse: In sync scheduling, if an AM

[jira] [Commented] (YARN-7540) Convert yarn app cli to call yarn api services

2018-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336769#comment-16336769 ] Hudson commented on YARN-7540: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13541 (See

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336770#comment-16336770 ] Hudson commented on YARN-7605: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13541 (See

[jira] [Commented] (YARN-7798) Refactor SLS Reservation Creation

2018-01-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336805#comment-16336805 ] genericqa commented on YARN-7798: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336832#comment-16336832 ] Weiwei Yang commented on YARN-7783: --- Hi [~asuresh] It makes sense to me, +1 to get the short term

[jira] [Assigned] (YARN-7800) Bind node constraint once a container is proposed to be placed on this node

2018-01-23 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-7800: - Assignee: Weiwei Yang > Bind node constraint once a container is proposed to be placed on this

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336634#comment-16336634 ] Wangda Tan commented on YARN-7791: -- +1, will commit by today if no objections. > Support submit intra-app

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-23 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336729#comment-16336729 ] Billie Rinaldi commented on YARN-7605: -- +1 for patch 20. I will commit this now. > Implement doAs for

[jira] [Updated] (YARN-7732) Support Pluggable AM Simulator

2018-01-23 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Young Chen updated YARN-7732: - Attachment: YARN-7732-YARN-7798.01.patch > Support Pluggable AM Simulator > --

[jira] [Commented] (YARN-7797) Docker host network can not obtain IP address for RegistryDNS

2018-01-23 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16336764#comment-16336764 ] Billie Rinaldi commented on YARN-7797: -- Thanks for the patch, [~eyang]. I have two comments. Does

  1   2   >