[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

2018-11-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.003.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8622) Native build fails on macos due to getgrouplist not found

2018-11-05 Thread LIJUN KANG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674802#comment-16674802 ] LIJUN KANG commented on YARN-8622: -- Because the function 'getgrouplist' in unistd.h is old on your mac,

[jira] [Commented] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-11-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674800#comment-16674800 ] Zhankun Tang commented on YARN-8927: [~eyang] , Thanks. I see what I'm missing. {code:java} if trust

[jira] [Comment Edited] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-11-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674800#comment-16674800 ] Zhankun Tang edited comment on YARN-8927 at 11/5/18 8:39 AM: - [~eyang] ,

[jira] [Comment Edited] (YARN-8622) Native build fails on macos due to getgrouplist not found

2018-11-05 Thread LIJUN KANG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674802#comment-16674802 ] LIJUN KANG edited comment on YARN-8622 at 11/5/18 8:28 AM: --- Because the function

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

2018-11-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674825#comment-16674825 ] Tao Yang commented on YARN-8925: Attached V3 patch with modifications as follow: (1) Adding RM side test

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplicate keys

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674909#comment-16674909 ] Weiwei Yang commented on YARN-6257: --- [~sunilg], [~Tao Yang], release notes updated. Let me know if you

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplicate keys

2018-11-05 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674916#comment-16674916 ] Tao Yang commented on YARN-6257: Thanks [~cheersyang] for your quick update! It looks good to me. >

[jira] [Comment Edited] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-11-05 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674898#comment-16674898 ] Bibin A Chundatt edited comment on YARN-8933 at 11/5/18 10:23 AM: -- Thank

[jira] [Comment Edited] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-11-05 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674898#comment-16674898 ] Bibin A Chundatt edited comment on YARN-8933 at 11/5/18 10:33 AM: -- Thank

[jira] [Created] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Wanqiang Ji (JIRA)
Wanqiang Ji created YARN-8969: - Summary: Change the return type to generic type of AbstractYarnScheduler#getNodeTracker Key: YARN-8969 URL: https://issues.apache.org/jira/browse/YARN-8969 Project: Hadoop

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674893#comment-16674893 ] Sunil Govindan commented on YARN-8191: -- [~grepas] [~haibochen] This is an incompatible change. Hence

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674894#comment-16674894 ] Sunil Govindan commented on YARN-6257: -- [~Tao Yang] [~cheersyang] This is an incompatible change.

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-11-05 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674898#comment-16674898 ] Bibin A Chundatt commented on YARN-8933: Thank you [~botong] for patch. Overall approach looks

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-6257: -- Release Note: The response format of resource manager's REST API endpoint "ws/v1/cluster/scheduler" is

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplicate key

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-6257: -- Summary: CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains

[jira] [Updated] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplicate keys

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-6257: -- Summary: CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains duplicate keys

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674972#comment-16674972 ] Sunil Govindan commented on YARN-6257: -- Thanks [~cheersyang]. Appreciate the same. >

[jira] [Updated] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-11-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8851: --- Attachment: YARN-8851-trunk.001.patch > [Umbrella] A new pluggable device plugin framework to ease

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675015#comment-16675015 ] Hadoop QA commented on YARN-8851: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-8969: -- Attachment: YARN-8969.001.patch > Change the return type to generic type of

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675277#comment-16675277 ] Weiwei Yang commented on YARN-8969: --- Straightforward fix, thanks [~jiwq]. +1. I will commit this if no

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675264#comment-16675264 ] Hadoop QA commented on YARN-8969: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675266#comment-16675266 ] Wanqiang Ji commented on YARN-8969: --- [~kasha] [~cheersyang] Can you help review this? thx~ > Change the

[jira] [Comment Edited] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675277#comment-16675277 ] Weiwei Yang edited comment on YARN-8969 at 11/5/18 2:55 PM: Straightforward

[jira] [Assigned] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang reassigned YARN-8969: - Assignee: Wanqiang Ji > Change the return type to generic type of

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675287#comment-16675287 ] Wanqiang Ji commented on YARN-8969: --- Thanks [~cheersyang] review this. > Change the return type to

[jira] [Updated] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8858: -- Attachment: YARN-8858-branch-2.8.002.patch > CapacityScheduler should respect maximum node resource

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675306#comment-16675306 ] Weiwei Yang commented on YARN-8858: --- Thanks [~ajisakaa] for the reminder, this one got slipped from my

[jira] [Comment Edited] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675306#comment-16675306 ] Weiwei Yang edited comment on YARN-8858 at 11/5/18 3:45 PM: Thanks [~ajisakaa]

[jira] [Commented] (YARN-8971) Improvement to TestContainerAllocation#testContainerRejectionWhenAskBeyondDynamicMax

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675394#comment-16675394 ] Weiwei Yang commented on YARN-8971: --- cc [~leftnoteasy], pls take a look. > Improvement to >

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675438#comment-16675438 ] Hadoop QA commented on YARN-8858: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Reopened] (YARN-8554) Add more E2E tests for placement constraints

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reopened YARN-8554: -- Reopening to mark as duplicate for YARN-8015. > Add more E2E tests for placement constraints >

[jira] [Resolved] (YARN-8554) Add more E2E tests for placement constraints

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-8554. -- Resolution: Duplicate Fix Version/s: (was: 3.2.0) > Add more E2E tests for placement

[jira] [Commented] (YARN-8289) Modify distributedshell to support Node Attributes

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675506#comment-16675506 ] Sunil Govindan commented on YARN-8289: -- Removed Fixed version as this Jira is duplicated to YARN-7863

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675532#comment-16675532 ] Wangda Tan commented on YARN-8902: -- Thanks [~cheersyang] , a couple of high-level questions and miscs: 

[jira] [Commented] (YARN-6989) Ensure timeline service v2 codebase gets UGI from HttpServletRequest in a consistent way

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675535#comment-16675535 ] Sunil Govindan commented on YARN-6989: -- Corrected fixed version as 3.2.1 as this patch was not landed

[jira] [Updated] (YARN-3409) Support Node Attribute functionality

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-3409: - Release Note: With this feature task, Node Attributes is supported in YARN which will help user's

[jira] [Updated] (YARN-6989) Ensure timeline service v2 codebase gets UGI from HttpServletRequest in a consistent way

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-6989: - Fix Version/s: (was: 3.2.0) 3.2.1 > Ensure timeline service v2 codebase

[jira] [Commented] (YARN-7631) ResourceRequest with different Capacity (Resource) overrides each other in RM and thus lost

2018-11-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675566#comment-16675566 ] Botong Huang commented on YARN-7631: Please consider directly using _ResourceRequestSetKey_ to replace

[jira] [Assigned] (YARN-8970) Improve the debug message in CS#allocateContainerOnSingleNode

2018-11-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang reassigned YARN-8970: -- Assignee: Zhankun Tang > Improve the debug message in CS#allocateContainerOnSingleNode >

[jira] [Updated] (YARN-7990) Node attribute prefix definition and validation

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7990: - Fix Version/s: (was: 3.2.0) > Node attribute prefix definition and validation >

[jira] [Updated] (YARN-7812) Improvements to Rich Placement Constraints in YARN

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7812: - Fix Version/s: (was: 3.2.0) > Improvements to Rich Placement Constraints in YARN >

[jira] [Commented] (YARN-7990) Node attribute prefix definition and validation

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675508#comment-16675508 ] Sunil Govindan commented on YARN-7990: -- As this task is not done, removing Fixed version > Node

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675525#comment-16675525 ] Sunil Govindan commented on YARN-7213: -- Removing fixed versions as this work spanned across multiple

[jira] [Commented] (YARN-7512) Support service upgrade via YARN Service API and CLI

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675521#comment-16675521 ] Sunil Govindan commented on YARN-7512: -- Hi [~csingh] [~eyang] cud u pls give a short write up as

[jira] [Updated] (YARN-8971) Improvement to TestContainerAllocation#testContainerRejectionWhenAskBeyondDynamicMax

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8971: -- Description: This UT seems not work properly. {code:java} // Ask 4GB succeeded. am1.allocate("*", 4 *

[jira] [Created] (YARN-8971) Improvement to TestContainerAllocation#testContainerRejectionWhenAskBeyondDynamicMax

2018-11-05 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8971: - Summary: Improvement to TestContainerAllocation#testContainerRejectionWhenAskBeyondDynamicMax Key: YARN-8971 URL: https://issues.apache.org/jira/browse/YARN-8971 Project:

[jira] [Updated] (YARN-8289) Modify distributedshell to support Node Attributes

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8289: - Fix Version/s: (was: 3.2.0) > Modify distributedshell to support Node Attributes >

[jira] [Resolved] (YARN-7990) Node attribute prefix definition and validation

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-7990. -- Resolution: Won't Fix Target Version/s: (was: YARN-3409) > Node attribute prefix

[jira] [Commented] (YARN-8851) [Umbrella] A new pluggable device plugin framework to ease vendor plugin development

2018-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675606#comment-16675606 ] Wangda Tan commented on YARN-8851: -- Thanks [~tangzhankun] ,  1) Regarding to the

[jira] [Commented] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675542#comment-16675542 ] Sunil Govindan commented on YARN-6091: -- Removing Fixed versions as YARN-7654  is containing this

[jira] [Updated] (YARN-6091) the AppMaster register failed when use Docker on LinuxContainer

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-6091: - Fix Version/s: (was: 3.1.1) (was: 3.2.0) > the AppMaster register

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675572#comment-16675572 ] Wangda Tan commented on YARN-8858: -- Triggered Jenkins build to find flaky tests.  > CapacityScheduler

[jira] [Created] (YARN-8970) Improve the debug message in CS#allocateContainerOnSingleNode

2018-11-05 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8970: - Summary: Improve the debug message in CS#allocateContainerOnSingleNode Key: YARN-8970 URL: https://issues.apache.org/jira/browse/YARN-8970 Project: Hadoop YARN

[jira] [Updated] (YARN-8970) Improve the debug message in CS#allocateContainerOnSingleNode

2018-11-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8970: -- Description: When a node is unable to allocate container due to insufficient resource, following DEBUG

[jira] [Commented] (YARN-8618) Yarn Service: When all the components of a service have restart policy NEVER then initiation of service upgrade should fail

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675502#comment-16675502 ] Sunil Govindan commented on YARN-8618: -- Updated fixed version to 3.2.1 as this patch is not present

[jira] [Updated] (YARN-8618) Yarn Service: When all the components of a service have restart policy NEVER then initiation of service upgrade should fail

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8618: - Fix Version/s: (was: 3.2.0) 3.2.1 > Yarn Service: When all the components

[jira] [Reopened] (YARN-7990) Node attribute prefix definition and validation

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reopened YARN-7990: -- Done is not correct status. Reopening to correctly close the jira > Node attribute prefix

[jira] [Reopened] (YARN-7031) Support distributed node attributes

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan reopened YARN-7031: -- Reopening to close this Jira correctly > Support distributed node attributes >

[jira] [Resolved] (YARN-7031) Support distributed node attributes

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan resolved YARN-7031. -- Resolution: Not A Problem > Support distributed node attributes >

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675609#comment-16675609 ] Botong Huang commented on YARN-8898: bq. Better option could be pushing along with

[jira] [Updated] (YARN-8799) [Submarine] Correct the default directory path in HDFS for "checkout_path"

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8799: - Fix Version/s: (was: 3.2.0) > [Submarine] Correct the default directory path in HDFS for

[jira] [Updated] (YARN-8834) Provide Java client for fetching Yarn specific entities from TimelineReader

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8834: - Fix Version/s: (was: 3.2.0) 3.2.1 > Provide Java client for fetching Yarn

[jira] [Commented] (YARN-8834) Provide Java client for fetching Yarn specific entities from TimelineReader

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675489#comment-16675489 ] Sunil Govindan commented on YARN-8834: -- Corrected Fixed version as 3.2.1 as its not landed in

[jira] [Commented] (YARN-8910) Misleading log statement in NM when max retries is -1

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675481#comment-16675481 ] Sunil Govindan commented on YARN-8910: -- This minor patch landed in branch-3.2. Updating Fixed version

[jira] [Commented] (YARN-8938) Add service upgrade cancel and express examples to the service upgrade doc

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675478#comment-16675478 ] Sunil Govindan commented on YARN-8938: -- Cherry picking this doc patch to 3.2.0 branch as it was

[jira] [Updated] (YARN-8910) Misleading log statement in NM when max retries is -1

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8910: - Fix Version/s: (was: 3.2.0) 3.2.1 > Misleading log statement in NM when

[jira] [Commented] (YARN-8826) Fix lingering timeline collector after serviceStop in TimelineCollectorManager

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675493#comment-16675493 ] Sunil Govindan commented on YARN-8826: -- Updated fixed version to 3.2.1 as its not landed in

[jira] [Updated] (YARN-8826) Fix lingering timeline collector after serviceStop in TimelineCollectorManager

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8826: - Fix Version/s: (was: 3.2.0) 3.2.1 > Fix lingering timeline collector after

[jira] [Commented] (YARN-7812) Improvements to Rich Placement Constraints in YARN

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675523#comment-16675523 ] Sunil Govindan commented on YARN-7812: -- Hi [~cheersyang] cud u pls give a short write up as Release

[jira] [Commented] (YARN-8933) [AMRMProxy] Fix potential empty AvailableResource and NumClusterNode in allocation response

2018-11-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675623#comment-16675623 ] Botong Huang commented on YARN-8933: Ah good catch, and thx for reviewing! > [AMRMProxy] Fix

[jira] [Commented] (YARN-8877) Extend service spec to allow setting resource attributes

2018-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675496#comment-16675496 ] Wangda Tan commented on YARN-8877: -- Thanks [~cheersyang],  In general patch looks good, could u update

[jira] [Commented] (YARN-8687) YARN service example is out-dated

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675498#comment-16675498 ] Sunil Govindan commented on YARN-8687: -- Back ported to branch-3.2.0 > YARN service example is

[jira] [Updated] (YARN-7512) Support service upgrade via YARN Service API and CLI

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7512: - Fix Version/s: (was: 3.2.0) > Support service upgrade via YARN Service API and CLI >

[jira] [Commented] (YARN-7812) Improvements to Rich Placement Constraints in YARN

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675509#comment-16675509 ] Sunil Govindan commented on YARN-7812: -- No fixed version given the tasks spanned across releases. >

[jira] [Commented] (YARN-7512) Support service upgrade via YARN Service API and CLI

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675510#comment-16675510 ] Sunil Govindan commented on YARN-7512: -- No fix-version given the tasks spanned across releases >

[jira] [Updated] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7213: - Fix Version/s: (was: 3.2.0) > [Umbrella] Test and validate HBase-2.0.x with Atsv2 >

[jira] [Updated] (YARN-7031) Support distributed node attributes

2018-11-05 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7031: - Fix Version/s: (was: 3.2.0) > Support distributed node attributes >

[jira] [Updated] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8972: --- Attachment: YARN-8972.v2.patch > [Router] Add support to prevent DoS attack

[jira] [Updated] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8972: --- Attachment: (was: YARN-8972.v2.patch) > [Router] Add support to prevent

[jira] [Updated] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8972: --- Attachment: YARN-8972.v2.patch > [Router] Add support to prevent DoS attack

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2018-11-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675664#comment-16675664 ] Wangda Tan commented on YARN-8867: -- Thanks [~csingh] for working on this, from high-level I think the

[jira] [Created] (YARN-8973) [Router] Add missing methods in RMWebProtocol

2018-11-05 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-8973: -- Summary: [Router] Add missing methods in RMWebProtocol Key: YARN-8973 URL: https://issues.apache.org/jira/browse/YARN-8973 Project: Hadoop YARN

[jira] [Commented] (YARN-8973) [Router] Add missing methods in RMWebProtocol

2018-11-05 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675819#comment-16675819 ] Íñigo Goiri commented on YARN-8973: --- Thanks [~giovanni.fumarola] for [^YARN-8973.v1.patch]. * Where do

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675862#comment-16675862 ] Giovanni Matteo Fumarola commented on YARN-8972: Thanks [~elgoiri] for the comments. * I

[jira] [Updated] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8972: --- Attachment: YARN-8972.v1.patch > [Router] Add support to prevent DoS attack

[jira] [Updated] (YARN-8867) Retrieve the status of resource localization

2018-11-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8867: Attachment: (was: YARN-8867.003.patch) > Retrieve the status of resource localization >

[jira] [Updated] (YARN-8867) Retrieve the status of resource localization

2018-11-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8867: Attachment: YARN-8867.003.patch > Retrieve the status of resource localization >

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675774#comment-16675774 ] Hadoop QA commented on YARN-8972: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8838) Add security check for container user is same as websocket user

2018-11-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8838: Attachment: YARN-8838.004.patch > Add security check for container user is same as websocket user >

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675768#comment-16675768 ] Eric Yang commented on YARN-8672: - [~csingh] Patch 005 changes the filename of the token file, but the

[jira] [Updated] (YARN-8973) [Router] Add missing methods in RMWebProtocol

2018-11-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8973: --- Attachment: YARN-8973.v1.patch > [Router] Add missing methods in

[jira] [Commented] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-05 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675817#comment-16675817 ] Íñigo Goiri commented on YARN-8972: --- Thanks [~giovanni.fumarola] for [^YARN-8972.v1.patch]. A few

[jira] [Created] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-05 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-8972: -- Summary: [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size Key: YARN-8972 URL: https://issues.apache.org/jira/browse/YARN-8972

[jira] [Commented] (YARN-8858) CapacityScheduler should respect maximum node resource when per-queue maximum-allocation is being used.

2018-11-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675713#comment-16675713 ] Hadoop QA commented on YARN-8858: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2018-11-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675810#comment-16675810 ] Chandni Singh commented on YARN-8867: - Undid the changes to import statements in patch 3. > Retrieve

[jira] [Commented] (YARN-8969) Change the return type to generic type of AbstractYarnScheduler#getNodeTracker

2018-11-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675661#comment-16675661 ] Eric Payne commented on YARN-8969: -- Is it wise to change the API of a public method in an abstract class?

[jira] [Updated] (YARN-8972) [Router] Add support to prevent DoS attack over ApplicationSubmissionContext size

2018-11-05 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8972: --- Description: This jira tracks the effort to add a new interceptor in the

[jira] [Commented] (YARN-8672) TestContainerManager#testLocalingResourceWhileContainerRunning occasionally times out

2018-11-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16675754#comment-16675754 ] Chandni Singh commented on YARN-8672: - [~jlowe] could you please review patch 5? >

  1   2   >