[jira] [Comment Edited] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238736#comment-16238736 ] Chandni Singh edited comment on YARN-7371 at 11/4/17 3:33 AM: -- Addressed the

[jira] [Updated] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7371: Attachment: YARN-7371-yarn-native-services.007.patch > NPE in ServiceMaster after RM is restarted

[jira] [Updated] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7371: Attachment: (was: YARN-7371-yarn-native-services.007.patch) > NPE in ServiceMaster after RM is

[jira] [Updated] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7371: Attachment: YARN-7371-yarn-native-services.007.patch Addressed the checkstyle errors. > NPE in

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238734#comment-16238734 ] Chandni Singh commented on YARN-7371: - [~subru] I think there maybe some fixes in trunk which may not

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238687#comment-16238687 ] Hadoop QA commented on YARN-7430: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238668#comment-16238668 ] Hadoop QA commented on YARN-7102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7394) Merge code paths for Reservation/Plan queues and Auto Created queues

2017-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238667#comment-16238667 ] Subru Krishnan commented on YARN-7394: -- Thanks [~suma.shivaprasad] for your contribution and

[jira] [Commented] (YARN-7423) Improve service client loggings

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238665#comment-16238665 ] Hadoop QA commented on YARN-7423: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238663#comment-16238663 ] Subru Krishnan commented on YARN-7371: -- Thanks [~csingh] for addressing my feedback. I skimmed through

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238654#comment-16238654 ] Subru Krishnan commented on YARN-6128: -- Thanks [~botong] for your clarification. I have a few follow

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238651#comment-16238651 ] Hadoop QA commented on YARN-7371: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238623#comment-16238623 ] Haibo Chen commented on YARN-7337: -- Patch updated to address the unit test failures and checkstyle issues.

[jira] [Updated] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7337: - Attachment: YARN-7337-YARN-1011.01.patch > Expose per-node over-allocation info in Node Report >

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-11-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238617#comment-16238617 ] Eric Yang commented on YARN-7197: - Hi [~jlowe], thank you for the review. {quote} I'm not sure I

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6128: - Target Version/s: 3.1.0, 2.9.1 (was: 2.9.0) > Add support for AMRMProxy HA >

[jira] [Updated] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6704: - Target Version/s: 3.1.0, 2.9.1 (was: 2.9.0) > Add Federation Interceptor restart when work

[jira] [Assigned] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7430: --- Assignee: Eric Yang (was: Varun Vasudev) > User and Group mapping are incorrect in docker container

[jira] [Updated] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7430: Attachment: YARN-7430.001.patch - Set default user and group remapping to true, and this will prevent normal

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-11-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238528#comment-16238528 ] Jason Lowe commented on YARN-7197: -- Thanks for updating the patch! bq. Container-Executor has no prior

[jira] [Updated] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7423: -- Attachment: YARN-7423.yarn-native-services.03.patch > Improve service client loggings >

[jira] [Updated] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7423: -- Attachment: (was: YARN-7423.yarn-native-services.03.patch) > Improve service client loggings >

[jira] [Updated] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7423: -- Attachment: YARN-7423.yarn-native-services.03.patch > Improve service client loggings >

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238508#comment-16238508 ] Jian He commented on YARN-7371: --- lgtm, will commit after jenkins reports > NPE in ServiceMaster after RM is

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238505#comment-16238505 ] Wangda Tan commented on YARN-7437: -- Thanks [~kkaranasos] for suggestions. For your renaming suggestions:

[jira] [Commented] (YARN-7423) Improve service client loggings

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238496#comment-16238496 ] Hadoop QA commented on YARN-7423: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-03 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238461#comment-16238461 ] Konstantinos Karanasos commented on YARN-7437: -- Thanks for starting this, [~leftnoteasy].

[jira] [Commented] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238459#comment-16238459 ] Jian He commented on YARN-7423: --- Thanks Billie, bq. You could move the log statement to

[jira] [Updated] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7423: -- Attachment: YARN-7423.yarn-native-services.02.patch > Improve service client loggings >

[jira] [Commented] (YARN-7423) Improve service client loggings

2017-11-03 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238429#comment-16238429 ] Billie Rinaldi commented on YARN-7423: -- The patch looks good overall. The logging when persisting a

[jira] [Commented] (YARN-7272) Enable timeline collector fault tolerance

2017-11-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238427#comment-16238427 ] Vrushali C commented on YARN-7272: -- this is the jira for fault tolerance for timeline collector cc

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238428#comment-16238428 ] Eric Yang commented on YARN-7430: - Looks like we built too many knobs for this to occur. If

[jira] [Updated] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7442: - Target Version/s: 3.0.0, 3.1.0 > [YARN-7069] Limit format of resource type name >

[jira] [Comment Edited] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238397#comment-16238397 ] Chandni Singh edited comment on YARN-7371 at 11/3/17 9:24 PM: -- Addressed the

[jira] [Created] (YARN-7442) [YARN-7069] Limit format of resource type name

2017-11-03 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7442: Summary: [YARN-7069] Limit format of resource type name Key: YARN-7442 URL: https://issues.apache.org/jira/browse/YARN-7442 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238412#comment-16238412 ] Gour Saha commented on YARN-6394: - bq. No, that's the default value already. Perfect. +1 for the patch

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-03 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238398#comment-16238398 ] Vrushali C commented on YARN-7346: -- Hi [~te...@apache.org] I see.. we (we = TSv2 developers) recently

[jira] [Updated] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-11-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7371: Attachment: YARN-7371-yarn-native-services.006.patch Addressed the review comments and fixed

[jira] [Updated] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-11-03 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7102: --- Attachment: YARN-7102.v14.patch > NM heartbeat stuck when responseId overflows MAX_INT >

[jira] [Updated] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-11-03 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7102: --- Attachment: (was: YARN-7102.v13.patch) > NM heartbeat stuck when responseId overflows MAX_INT >

[jira] [Updated] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-11-03 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7102: --- Attachment: YARN-7102.v13.patch Since the new RMNode is empty, I thought it should be fine to just

[jira] [Updated] (YARN-7441) Support placement policy in yarn service

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7441: -- Description: YARN-6592 added support for more riched placement policies, yarn service framework can take

[jira] [Created] (YARN-7441) Support placement policy in yarn service

2017-11-03 Thread Jian He (JIRA)
Jian He created YARN-7441: - Summary: Support placement policy in yarn service Key: YARN-7441 URL: https://issues.apache.org/jira/browse/YARN-7441 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-7423) Improve service client loggings

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7423: -- Attachment: YARN-7423.yarn-native-services.01.patch Renamed SliderUtils to to ServiceUtils, And fixed some

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238301#comment-16238301 ] Jian He commented on YARN-6394: --- bq. so for log include pattern (not rolling), are we expecting app owner to

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238279#comment-16238279 ] Hadoop QA commented on YARN-7390: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7440) Optimization to AM recovery when the service record doesn't exist for a container

2017-11-03 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7440: Summary: Optimization to AM recovery when the service record doesn't exist for a container (was:

[jira] [Created] (YARN-7440) When AM recovers, if the service record doesn’t exist for a container sent from RM, it can re-query the container status from NM instead of releasing the container

2017-11-03 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-7440: --- Summary: When AM recovers, if the service record doesn’t exist for a container sent from RM, it can re-query the container status from NM instead of releasing the container Key: YARN-7440

[jira] [Commented] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238222#comment-16238222 ] Hadoop QA commented on YARN-7427: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-03 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238188#comment-16238188 ] Miklos Szegedi commented on YARN-1015: -- Thank you for the patch [~haibochen]. {code} 387

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238180#comment-16238180 ] Hadoop QA commented on YARN-6394: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7369) Improve the resource types docs

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238176#comment-16238176 ] Hadoop QA commented on YARN-7369: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-03 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238152#comment-16238152 ] Haibo Chen commented on YARN-7346: -- Sorry for the delay folks. I'll resume working on this next week. >

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238151#comment-16238151 ] Gour Saha commented on YARN-6394: - [~jianhe] quick question on log aggregation - so for log include pattern

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-11-03 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238148#comment-16238148 ] Jason Lowe commented on YARN-7102: -- Thanks for updating the patch! I'm not so sure these tests are timing

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238133#comment-16238133 ] Billie Rinaldi commented on YARN-6394: -- +1 for patch 07. I think this is ready to commit since it only

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: YARN-6394.yarn-native-services.07.patch > Support specifying YARN related params in the service REST

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238122#comment-16238122 ] Hadoop QA commented on YARN-6909: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: (was: YARN-6394.yarn-native-services.07.patch) > Support specifying YARN related params in the

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: YARN-6394.yarn-native-services.07.patch renamed the props to properties in some places missed >

[jira] [Commented] (YARN-6078) Containers stuck in Localizing state

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238113#comment-16238113 ] Hadoop QA commented on YARN-6078: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-03 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238106#comment-16238106 ] Ted Yu commented on YARN-7346: -- When looking at the contents of mapreduce.tar.gz for hadoop3 beta1: {code}

[jira] [Commented] (YARN-7439) Minor improvements to Reservation System documentation/exceptions

2017-11-03 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238099#comment-16238099 ] Carlo Curino commented on YARN-7439: # The main documentation page for the ReservationSystem

[jira] [Created] (YARN-7439) Minor improvements to Reservation System documentation/exceptions

2017-11-03 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7439: -- Summary: Minor improvements to Reservation System documentation/exceptions Key: YARN-7439 URL: https://issues.apache.org/jira/browse/YARN-7439 Project: Hadoop YARN

[jira] [Commented] (YARN-7383) Node resource not parsed correctly for resource names containing dot

2017-11-03 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238065#comment-16238065 ] Daniel Templeton commented on YARN-7383: The patch looks fine to me. > Node resource not parsed

[jira] [Updated] (YARN-7369) Improve the resource types docs

2017-11-03 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7369: --- Attachment: YARN-7369.003.patch OK, I made that change. I also renamed the file to be more

[jira] [Commented] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-03 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238044#comment-16238044 ] Jonathan Hung commented on YARN-7427: - Thanks [~sunilg], that's true, seems it can also be removed from

[jira] [Updated] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-03 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7427: Attachment: YARN-7427.002.patch > NullPointerException in ResourceInfo when queue has not used label

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238040#comment-16238040 ] Wangda Tan commented on YARN-6596: -- [~asuresh], sure, sounds good. > Introduce Placement Constraint

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238039#comment-16238039 ] Hadoop QA commented on YARN-6128: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-03 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7427: Attachment: (was: YARN-7427.002.patch) > NullPointerException in ResourceInfo when queue has not

[jira] [Updated] (YARN-7427) NullPointerException in ResourceInfo when queue has not used label

2017-11-03 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7427: Attachment: YARN-7427.002.patch > NullPointerException in ResourceInfo when queue has not used label

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238030#comment-16238030 ] Hadoop QA commented on YARN-7221: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238023#comment-16238023 ] Yufei Gu commented on YARN-7390: Thanks for the review, [~haibo.chen]. Uploaded patch v3 for all comments.

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-11-03 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238022#comment-16238022 ] Daniel Templeton commented on YARN-6909: This patch looks much better. A few comments below, but

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-11-03 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16238021#comment-16238021 ] Gour Saha commented on YARN-6394: - [~jianhe] there are few references to props in Configurations.md. Please

[jira] [Updated] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-03 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7390: --- Attachment: YARN-7390.003.patch > All reservation related test cases failed when TestYarnClient runs against

[jira] [Updated] (YARN-6078) Containers stuck in Localizing state

2017-11-03 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6078: - Attachment: YARN-6078.001.patch > Containers stuck in Localizing state >

[jira] [Created] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-03 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7438: Summary: Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm Key: YARN-7438 URL: https://issues.apache.org/jira/browse/YARN-7438

[jira] [Commented] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237896#comment-16237896 ] Wangda Tan commented on YARN-7437: -- [~asuresh]/[~kkaranasos]/[~subru]. How about rename it to

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-11-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237895#comment-16237895 ] Arun Suresh commented on YARN-6596: --- [~leftnoteasy], I did start on it - Can I get back to you sometime

[jira] [Created] (YARN-7437) Give SchedulingPlacementSet to a better name.

2017-11-03 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7437: Summary: Give SchedulingPlacementSet to a better name. Key: YARN-7437 URL: https://issues.apache.org/jira/browse/YARN-7437 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237891#comment-16237891 ] Eric Yang commented on YARN-7430: - [~vvasudev] Sorry, raise this as a blocker. Anyone can become root user

[jira] [Assigned] (YARN-6078) Containers stuck in Localizing state

2017-11-03 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-6078: Assignee: Billie Rinaldi > Containers stuck in Localizing state >

[jira] [Commented] (YARN-6078) Containers stuck in Localizing state

2017-11-03 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237879#comment-16237879 ] Billie Rinaldi commented on YARN-6078: -- I found an additional option, which is to destroy the child

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2017-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237880#comment-16237880 ] Wangda Tan commented on YARN-6596: -- [~asuresh], do you plan to work on this item in short term? If no, may

[jira] [Comment Edited] (YARN-5908) Add affinity/anti-affinity field to ResourceRequest API

2017-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237869#comment-16237869 ] Wangda Tan edited comment on YARN-5908 at 11/3/17 4:39 PM: --- Duplicated to

[jira] [Resolved] (YARN-7426) Interrupt does not work when LocalizerRunner is reading from InputStream

2017-11-03 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi resolved YARN-7426. -- Resolution: Duplicate > Interrupt does not work when LocalizerRunner is reading from InputStream

[jira] [Resolved] (YARN-5908) Add affinity/anti-affinity field to ResourceRequest API

2017-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-5908. -- Resolution: Duplicate Duplicated to YARN-6952 > Add affinity/anti-affinity field to ResourceRequest API

[jira] [Updated] (YARN-7430) User and Group mapping are incorrect in docker container

2017-11-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7430: Priority: Blocker (was: Critical) > User and Group mapping are incorrect in docker container >

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-11-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237839#comment-16237839 ] Hadoop QA commented on YARN-7159: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237829#comment-16237829 ] Wangda Tan commented on YARN-6909: -- Latest patch looks good, thanks [~sunilg], will wait for Jenkins

[jira] [Commented] (YARN-7307) Allow client/AM update supported resource types via YARN APIs

2017-11-03 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237827#comment-16237827 ] Wangda Tan commented on YARN-7307: -- Latest Jenkins report looks good, will push to upstream by today if no

[jira] [Updated] (YARN-7221) Add security check for privileged docker container

2017-11-03 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7221: Attachment: YARN-7221.002.patch Fixed white space issue. > Add security check for privileged docker

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-11-03 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6128: --- Attachment: YARN-6128.v5.patch > Add support for AMRMProxy HA > > >

[jira] [Commented] (YARN-7424) Capacity Scheduler Intra-queue preemption: add property to only preempt up to configured MULP

2017-11-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237768#comment-16237768 ] Eric Payne commented on YARN-7424: -- Thanks for the review, [~sunilg]. bq.

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-11-03 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237740#comment-16237740 ] Manikandan R commented on YARN-7159: 1,3: done. Also renamed getRegNMRequest -> getRegisteredNMRequest

[jira] [Updated] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-11-03 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7159: --- Attachment: YARN-7159.012.patch > Normalize unit of resource objects in RM and avoid to do unit

[jira] [Commented] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-11-03 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237706#comment-16237706 ] Arun Suresh commented on YARN-7343: --- Thanks for the updated patch [~sampada15]!! I really like the

[jira] [Commented] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16237691#comment-16237691 ] Subru Krishnan commented on YARN-7434: -- Thanks [~elgoiri] for the fix and [~curino] for the review. >

  1   2   >