[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334181#comment-16334181 ] Weiwei Yang commented on YARN-7783: --- Hi [~asuresh] I am wondering why you decided to instantiate one

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334105#comment-16334105 ] genericqa commented on YARN-7779: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7784) Cluster metrics is inaccurate when placement constraint is enabled

2018-01-22 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7784: - Summary: Cluster metrics is inaccurate when placement constraint is enabled Key: YARN-7784 URL: https://issues.apache.org/jira/browse/YARN-7784 Project: Hadoop YARN

[jira] [Updated] (YARN-7176) Similar to YARN-2387:Resource Manager crashes with NPE due to lack of synchronization

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7176: Description: submit a job, when the job is starting Appmaster Containers(eg. startContainers) , then send kill

[jira] [Comment Edited] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334145#comment-16334145 ] Weiwei Yang edited comment on YARN-7779 at 1/22/18 10:57 AM: - Uploaded v3

[jira] [Updated] (YARN-7176) Similar to YARN-2387:Resource Manager crashes with NPE due to lack of synchronization

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7176: Attachment: YARN_7176_2.patch > Similar to YARN-2387:Resource Manager crashes with NPE due to lack of >

[jira] [Commented] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2018-01-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334116#comment-16334116 ] Szilard Nemeth commented on YARN-4022: -- Hey @danieltempleton, @yufei! Could you please help me a bit

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7779: -- Attachment: YARN-7779-YARN-6592.003.patch > Display allocation tags in RM web UI and expose via REST API

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334145#comment-16334145 ] Weiwei Yang commented on YARN-7779: --- Uploaded v3 patch, # Moved test case from \{{TestRMWebServices}} to

[jira] [Updated] (YARN-7563) Invalid event: FINISH_APPLICATION at NEW may make some application level resource be not cleaned

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7563: Attachment: YARN_7563.patch > Invalid event: FINISH_APPLICATION at NEW may make some application level > resource

[jira] [Commented] (YARN-5473) Expose per-application over-allocation info in the Resource Manager

2018-01-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334176#comment-16334176 ] Szilard Nemeth commented on YARN-5473: -- Hey [~haibochen]! Thanks for the update. Everything looks

[jira] [Comment Edited] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2018-01-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334116#comment-16334116 ] Szilard Nemeth edited comment on YARN-4022 at 1/22/18 11:27 AM: Hey

[jira] [Updated] (YARN-7563) Invalid event: FINISH_APPLICATION at NEW make some application level resource be not cleaned

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7563: Summary: Invalid event: FINISH_APPLICATION at NEW make some application level resource be not cleaned (was: Invalid

[jira] [Comment Edited] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2018-01-22 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334116#comment-16334116 ] Szilard Nemeth edited comment on YARN-4022 at 1/22/18 11:27 AM: Hey

[jira] [Commented] (YARN-7563) Invalid event: FINISH_APPLICATION at NEW make some application level resource be not cleaned

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334202#comment-16334202 ] genericqa commented on YARN-7563: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7176) Similar to YARN-2387:Resource Manager crashes with NPE due to lack of synchronization

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334220#comment-16334220 ] lujie commented on YARN-7176: - I reattach the patch just like patch in -YARN-2387,-  and try to fix the

[jira] [Commented] (YARN-7755) Clean up deprecation messages for allocation increments in FS config

2018-01-22 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334697#comment-16334697 ] Yufei Gu commented on YARN-7755: Committed to trunk. Thanks for the patch, [~wilfreds]. > Clean up

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334822#comment-16334822 ] Arun Suresh commented on YARN-7783: --- Split the refoctoring into YARN-7788 for easier review. The actual

[jira] [Created] (YARN-7787) Application status cmd fails if principal does not have hostname part

2018-01-22 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7787: Summary: Application status cmd fails if principal does not have hostname part Key: YARN-7787 URL: https://issues.apache.org/jira/browse/YARN-7787 Project: Hadoop YARN

[jira] [Created] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7788: - Summary: Refactor AllocationTagsManager to move management of temp tags to a separate class Key: YARN-7788 URL: https://issues.apache.org/jira/browse/YARN-7788 Project:

[jira] [Updated] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7783: -- Attachment: YARN-7783-YARN-6592.003.patch > Add validation step to ensure constraints are not violated

[jira] [Assigned] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-7788: - Assignee: Arun Suresh > Refactor AllocationTagsManager to move management of temp tags to a

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334826#comment-16334826 ] genericqa commented on YARN-7783: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7789) Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator

2018-01-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7789: - Description: We may need to revisit this behavior: Currently, RM doesn't fail if 3rd resource type is

[jira] [Updated] (YARN-7789) Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator

2018-01-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7789: - Environment: (was: We may need to revisit this behavior: Currently, RM doesn't fail if 3rd resource

[jira] [Closed] (YARN-6942) Add examples for placement constraints usage in applications

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh closed YARN-6942. - > Add examples for placement constraints usage in applications >

[jira] [Updated] (YARN-7788) Factor out management of temp tags from AllocationTagsManager

2018-01-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-7788: - Summary: Factor out management of temp tags from AllocationTagsManager (was:

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335381#comment-16335381 ] Weiwei Yang commented on YARN-7783: --- Thanks [~asuresh], as this is not going to fix inter-app issues, I

[jira] [Commented] (YARN-6942) Add examples for placement constraints usage in applications

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335405#comment-16335405 ] Arun Suresh commented on YARN-6942: --- Closing this as YARN-7745 adds support for placement constraints in

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335434#comment-16335434 ] Weiwei Yang commented on YARN-7791: --- + [~leftnoteasy], [~sunilg] > Support submit intra-app placement

[jira] [Assigned] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-7791: - Assignee: Sunil G > Support submit intra-app placement constraint in Distributed Shell to >

[jira] [Commented] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335466#comment-16335466 ] Konstantinos Karanasos commented on YARN-7788: -- Committing this shortly to the branch. Thanks

[jira] [Updated] (YARN-7788) Factor out management of temp tags from AllocationTagsManager

2018-01-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-7788: - Fix Version/s: YARN-6592 > Factor out management of temp tags from

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335394#comment-16335394 ] genericqa commented on YARN-7605: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7789) Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator

2018-01-22 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7789: Summary: Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator Key: YARN-7789 URL: https://issues.apache.org/jira/browse/YARN-7789 Project:

[jira] [Commented] (YARN-7789) Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator

2018-01-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335395#comment-16335395 ] Wangda Tan commented on YARN-7789: -- cc: [~sunilg], [~templedf], [~yufeigu] . Thoughts here? > Should fail

[jira] [Resolved] (YARN-6942) Add examples for placement constraints usage in applications

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-6942. --- Resolution: Resolved > Add examples for placement constraints usage in applications >

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335404#comment-16335404 ] Weiwei Yang commented on YARN-7779: --- Hi [~sunilg] If you are busy, I can help to commit this. Thank you.

[jira] [Commented] (YARN-7784) Cluster metrics is inaccurate when placement constraint is enabled

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335430#comment-16335430 ] Weiwei Yang commented on YARN-7784: --- Note, this issue only exists in processor patch, when

[jira] [Created] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-22 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7791: - Summary: Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator Key: YARN-7791 URL: https://issues.apache.org/jira/browse/YARN-7791

[jira] [Updated] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7791: -- Description: Set {{yarn.resourcemanager.placement-constraints.enabled}} to {{false}} Submit a job with

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-22 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335409#comment-16335409 ] Rohith Sharma K S commented on YARN-3895: - {quote}I could see cases where the ACLs are not that

[jira] [Created] (YARN-7790) Improve Capacity Scheduler Async Scheduling to better handle node failures

2018-01-22 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7790: Summary: Improve Capacity Scheduler Async Scheduling to better handle node failures Key: YARN-7790 URL: https://issues.apache.org/jira/browse/YARN-7790 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335434#comment-16335434 ] Weiwei Yang edited comment on YARN-7791 at 1/23/18 7:30 AM: + [~leftnoteasy],

[jira] [Updated] (YARN-7626) allow regular expression matching in container-executor.cfg for devices and volumes

2018-01-22 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7626: Attachment: YARN-7626.002.patch > allow regular expression matching in container-executor.cfg for devices

[jira] [Commented] (YARN-7791) Support submit intra-app placement constraint in Distributed Shell to AppPlacementAllocator

2018-01-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335472#comment-16335472 ] Sunil G commented on YARN-7791: --- Yes [~cheersyang]. I am working on a patch. WIll share a patch after doing

[jira] [Updated] (YARN-7785) Invalid event: CONTAINER_RESOURCES_CLEANEDUP at DONE

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7785: Description: send kill command while job is running, some Exception occur in nodemanager: {code:java}  2017-11-25

[jira] [Updated] (YARN-7785) Invalid event: CONTAINER_RESOURCES_CLEANEDUP at DONE

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7785: Description: send kill command while job is running, some Exception occur in nodemanager: {code:java}   was: send

[jira] [Updated] (YARN-7785) Invalid event: CONTAINER_RESOURCES_CLEANEDUP at DONE

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7785: Description: send kill command while job is running, some Exception occur in nodemanager: {code:java}  2017-11-25

[jira] [Updated] (YARN-7785) Invalid event: CONTAINER_RESOURCES_CLEANEDUP at DONE

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7785: Environment: (was: {code:java} 2017-11-25 18:51:30,234 WARN

[jira] [Updated] (YARN-7785) Invalid event: CONTAINER_RESOURCES_CLEANEDUP at DONE

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7785: Component/s: nodemanager > Invalid event: CONTAINER_RESOURCES_CLEANEDUP at DONE >

[jira] [Updated] (YARN-7786) NullPointerException while launching ApplicationMaster

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7786: Description: Before launching the ApplicationMaster, send kill command to the job, then some Null pointer appears:

[jira] [Commented] (YARN-7786) NullPointerException while launching ApplicationMaster

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334370#comment-16334370 ] lujie commented on YARN-7786: - There maybe two reasons for Nullpointer: # datarace: setAMContainerSpec and 

[jira] [Updated] (YARN-7786) NullPointerException while launching ApplicationMaster

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7786: Attachment: resourcemanager.log > NullPointerException while launching ApplicationMaster >

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-22 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334386#comment-16334386 ] Rohith Sharma K S commented on YARN-3895: - Hi [~jlowe], does this approach looks reasonable? >

[jira] [Updated] (YARN-7786) NullPointerException while launching ApplicationMaster

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-7786: Attachment: YARN-7786.patch > NullPointerException while launching ApplicationMaster >

[jira] [Commented] (YARN-7176) Similar to YARN-2387:Resource Manager crashes with NPE due to lack of synchronization

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334279#comment-16334279 ] genericqa commented on YARN-7176: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-3181) FairScheduler: Fix up outdated findbugs issues

2018-01-22 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned YARN-3181: -- Assignee: (was: Brahma Reddy Battula) > FairScheduler: Fix up outdated

[jira] [Created] (YARN-7786) NullPointerException while launching ApplicationMaster

2018-01-22 Thread lujie (JIRA)
lujie created YARN-7786: --- Summary: NullPointerException while launching ApplicationMaster Key: YARN-7786 URL: https://issues.apache.org/jira/browse/YARN-7786 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7176) Similar to YARN-2387:Resource Manager crashes with NPE due to lack of synchronization

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334366#comment-16334366 ] genericqa commented on YARN-7176: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7755) Clean up deprecation messages for allocation increments in FS config

2018-01-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334734#comment-16334734 ] Hudson commented on YARN-7755: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13534 (See

[jira] [Commented] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334811#comment-16334811 ] Arun Suresh commented on YARN-7788: --- Uplodaing patch with the refactoring > Refactor

[jira] [Updated] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7788: -- Attachment: YARN-7788-YARN-6592.001.patch > Refactor AllocationTagsManager to move management of temp

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334836#comment-16334836 ] Arun Suresh commented on YARN-7783: --- The failure was due to its dependence on YARN-7788 (it needs to go

[jira] [Commented] (YARN-7064) Use cgroup to get container resource utilization

2018-01-22 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335189#comment-16335189 ] Haibo Chen commented on YARN-7064: -- I see. Let's leave it for now then, we can always fix it later when

[jira] [Commented] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335188#comment-16335188 ] Konstantinos Karanasos commented on YARN-7788: -- Thanks for the patch, [~asuresh]. +1 for

[jira] [Updated] (YARN-7732) Support Pluggable AM Simulator

2018-01-22 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Young Chen updated YARN-7732: - Attachment: YARN-7732.03.patch > Support Pluggable AM Simulator > -- > >

[jira] [Commented] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335210#comment-16335210 ] Wangda Tan commented on YARN-7788: -- Thanks [~asuresh] , +1 to move Temp container functionalities out of

[jira] [Updated] (YARN-6858) Attribute Manager to store and provide the attributes in RM

2018-01-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6858: Attachment: YARN-6858-YARN-3409.001.patch > Attribute Manager to store and provide the

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335215#comment-16335215 ] Eric Yang commented on YARN-7516: - [~billie.rinaldi] Thank you for the review.  I have added check for set

[jira] [Commented] (YARN-7516) Security check for untrusted docker image

2018-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335231#comment-16335231 ] Eric Yang commented on YARN-7516: - [~billie.rinaldi] There is a possibility for untrusted docker image to

[jira] [Commented] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335232#comment-16335232 ] Konstantinos Karanasos commented on YARN-7788: -- Sounds good, will commit the patch tonight. >

[jira] [Commented] (YARN-6858) Attribute Manager to store and provide the attributes in RM

2018-01-22 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335233#comment-16335233 ] Naganarasimha G R commented on YARN-6858: - Thanks [~weiweiyagn666], for your views. {quote}I am

[jira] [Commented] (YARN-7732) Support Pluggable AM Simulator

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335162#comment-16335162 ] genericqa commented on YARN-7732: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-2185) Use pipes when localizing archives

2018-01-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-2185: - Attachment: YARN-2185.009.patch > Use pipes when localizing archives >

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-22 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335173#comment-16335173 ] Miklos Szegedi commented on YARN-2185: -- Thank you for the review [~jlowe]! bq. If the subprocess ends

[jira] [Commented] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335200#comment-16335200 ] Wangda Tan commented on YARN-7788: -- [~kkaranasos] , please give me a while to review the patch, will post

[jira] [Updated] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7788: -- Attachment: YARN-7788-YARN-6592.003.patch > Refactor AllocationTagsManager to move management of temp

[jira] [Commented] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335207#comment-16335207 ] Arun Suresh commented on YARN-7788: --- Updating patch with [~kkaranasos]'s suggestion > Refactor

[jira] [Updated] (YARN-7516) Security check for untrusted docker image

2018-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.012.patch > Security check for untrusted docker image >

[jira] [Updated] (YARN-7777) Fix user name format in YARN Registry DNS name

2018-01-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-: -- Attachment: YARN-.03.patch > Fix user name format in YARN Registry DNS name >

[jira] [Commented] (YARN-7777) Fix user name format in YARN Registry DNS name

2018-01-22 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335226#comment-16335226 ] Jian He commented on YARN-: --- Thanks for the review, fixed the comments > Fix user name format in YARN

[jira] [Commented] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335227#comment-16335227 ] genericqa commented on YARN-7788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7788: -- Attachment: YARN-7788-YARN-6592.002.patch > Refactor AllocationTagsManager to move management of temp

[jira] [Commented] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335071#comment-16335071 ] Arun Suresh commented on YARN-7788: --- Removed the failed testcase - it was supposed to be in the YARN-7783

[jira] [Updated] (YARN-7732) Support Pluggable AM Simulator

2018-01-22 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Young Chen updated YARN-7732: - Attachment: YARN-7732.02.patch > Support Pluggable AM Simulator > -- > >

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-22 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335102#comment-16335102 ] Vrushali C commented on YARN-3895: -- Thanks for your response [~jlowe]. {quote}Having a tidy ID to

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334872#comment-16334872 ] Jason Lowe commented on YARN-2185: -- Thanks for updating the patch! Should a

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-01-22 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334907#comment-16334907 ] Jason Lowe commented on YARN-3895: -- {quote} So, we store these kind of doAs query related entities in a

[jira] [Commented] (YARN-7788) Refactor AllocationTagsManager to move management of temp tags to a separate class

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335000#comment-16335000 ] genericqa commented on YARN-7788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7729) Add support for setting the PID namespace mode

2018-01-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16334992#comment-16334992 ] Hudson commented on YARN-7729: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13535 (See

[jira] [Updated] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7779: -- Attachment: YARN-7779-YARN-6592.004.patch > Display allocation tags in RM web UI and expose via REST API

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-22 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335249#comment-16335249 ] Weiwei Yang commented on YARN-7779: --- Fixed the java doc, hopefully this time it fixed the checkstyle

[jira] [Updated] (YARN-7605) Implement doAs for Api Service REST API

2018-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7605: Attachment: YARN-7605.019.patch > Implement doAs for Api Service REST API >

[jira] [Commented] (YARN-7605) Implement doAs for Api Service REST API

2018-01-22 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335278#comment-16335278 ] Eric Yang commented on YARN-7605: - Fixed checkstyle issues, and findbug report issue, the rest of patch is

[jira] [Commented] (YARN-7782) Enable user re-mapping for Docker containers in yarn-default.xml

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335305#comment-16335305 ] genericqa commented on YARN-7782: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose via REST API

2018-01-22 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335320#comment-16335320 ] Sunil G commented on YARN-7779: --- +1 I ll commit shortly. > Display allocation tags in RM web UI and expose

[jira] [Commented] (YARN-7785) Invalid event: CONTAINER_RESOURCES_CLEANEDUP at DONE

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335322#comment-16335322 ] lujie commented on YARN-7785: - I have reattached the patch to fix checkstyles warnings, the unit test is same

[jira] [Commented] (YARN-7176) Similar to YARN-2387:Resource Manager crashes with NPE due to lack of synchronization

2018-01-22 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335325#comment-16335325 ] lujie commented on YARN-7176: - I want to give this patch a unit test, because i want to check whether other

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-22 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335245#comment-16335245 ] genericqa commented on YARN-2185: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >