[jira] [Updated] (YARN-7996) Allow user supplied Docker client configurations with YARN native services

2018-03-04 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7996: -- Attachment: YARN-7996.001.patch > Allow user supplied Docker client configurations with YARN native

[jira] [Assigned] (YARN-7996) Allow user supplied Docker client configurations with YARN native services

2018-03-04 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf reassigned YARN-7996: - Assignee: Shane Kumpf > Allow user supplied Docker client configurations with YARN native

[jira] [Commented] (YARN-7996) Allow user supplied Docker client configurations with YARN native services

2018-03-04 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385186#comment-16385186 ] Shane Kumpf commented on YARN-7996: --- I've been looking into this as a follow on to YARN-5428 and will put

[jira] [Created] (YARN-7996) Allow user supplied Docker client configurations with YARN native services

2018-03-04 Thread Shane Kumpf (JIRA)
Shane Kumpf created YARN-7996: - Summary: Allow user supplied Docker client configurations with YARN native services Key: YARN-7996 URL: https://issues.apache.org/jira/browse/YARN-7996 Project: Hadoop

[jira] [Commented] (YARN-7996) Allow user supplied Docker client configurations with YARN native services

2018-03-04 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385339#comment-16385339 ] genericqa commented on YARN-7996: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6673) Add cpu cgroup configurations for opportunistic containers

2018-03-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385440#comment-16385440 ] ASF GitHub Bot commented on YARN-6673: -- Github user szegedim closed the pull request at:

[jira] [Commented] (YARN-6674) Add memory cgroup settings for opportunistic containers

2018-03-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385439#comment-16385439 ] ASF GitHub Bot commented on YARN-6674: -- Github user szegedim closed the pull request at:

[jira] [Commented] (YARN-6302) Fail the node if Linux Container Executor is not configured properly

2018-03-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385442#comment-16385442 ] ASF GitHub Bot commented on YARN-6302: -- Github user szegedim closed the pull request at:

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2018-03-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385445#comment-16385445 ] ASF GitHub Bot commented on YARN-6668: -- Github user szegedim closed the pull request at:

[jira] [Commented] (YARN-7972) Support inter-app placement constraints for allocation tags by application ID

2018-03-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385646#comment-16385646 ] Weiwei Yang commented on YARN-7972: --- UT failure and checkstyle issue are both not related to this patch.

[jira] [Updated] (YARN-7988) Refactor FSNodeLabelStore code for attributes store support

2018-03-04 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7988: --- Attachment: YARN-7988-YARN-3409.003.patch > Refactor FSNodeLabelStore code for attributes

[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0

2018-03-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385608#comment-16385608 ] Haibo Chen commented on YARN-7346: -- The 09 patch seems to miss some changes based on its size. I have

[jira] [Updated] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0

2018-03-04 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7346: - Attachment: YARN-7346.10.patch > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 >

[jira] [Commented] (YARN-4088) RM should be able to process heartbeats from NM concurrently

2018-03-04 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385503#comment-16385503 ] stefanlee commented on YARN-4088: - yep !!! *processing those events in the scheduler thread is serialized* 

[jira] [Updated] (YARN-7736) Fix itemization in YARN federation document

2018-03-04 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-7736: --- Attachment: YARN-7736.001.patch > Fix itemization in YARN federation document >

[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0

2018-03-04 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385662#comment-16385662 ] genericqa commented on YARN-7346: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7995) Remove unnecessary boxings and unboxings from PlacementConstraintParser.java

2018-03-04 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao reassigned YARN-7995: -- Assignee: Sen Zhao > Remove unnecessary boxings and unboxings from PlacementConstraintParser.java >

[jira] [Updated] (YARN-7995) Remove unnecessary boxings and unboxings from PlacementConstraintParser.java

2018-03-04 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao updated YARN-7995: --- Attachment: YARN-7995.001.patch > Remove unnecessary boxings and unboxings from PlacementConstraintParser.java

[jira] [Assigned] (YARN-7736) Fix itemization in YARN federation document

2018-03-04 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sen Zhao reassigned YARN-7736: -- Assignee: Sen Zhao > Fix itemization in YARN federation document >

[jira] [Updated] (YARN-7988) Refactor FSNodeLabelStore code for attributes store support

2018-03-04 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7988: --- Attachment: YARN-7988-YARN-3409.004.patch > Refactor FSNodeLabelStore code for attributes

[jira] [Updated] (YARN-7988) Refactor FSNodeLabelStore code for attributes store support

2018-03-04 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7988: --- Attachment: (was: YARN-7988-YARN-3409.003.patch) > Refactor FSNodeLabelStore code for

[jira] [Commented] (YARN-7511) NPE in ContainerLocalizer when localization failed for running container

2018-03-04 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385481#comment-16385481 ] Tao Yang commented on YARN-7511: Thanks [~jlowe] for reviewing and committing this patch! > NPE in

[jira] [Commented] (YARN-7736) Fix itemization in YARN federation document

2018-03-04 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385543#comment-16385543 ] genericqa commented on YARN-7736: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7972) Support inter-app placement constraints for allocation tags by application ID

2018-03-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7972: -- Attachment: YARN-7972.007.patch > Support inter-app placement constraints for allocation tags by

[jira] [Comment Edited] (YARN-7972) Support inter-app placement constraints for allocation tags by application ID

2018-03-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385548#comment-16385548 ] Weiwei Yang edited comment on YARN-7972 at 3/5/18 3:43 AM: --- Uploaded v7 patch,

[jira] [Commented] (YARN-7972) Support inter-app placement constraints for allocation tags by application ID

2018-03-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385548#comment-16385548 ] Weiwei Yang commented on YARN-7972: --- Uploaded v7 patch, diff with v6 # Added \{{TargetApplications}}

[jira] [Commented] (YARN-7995) Remove unnecessary boxings and unboxings from PlacementConstraintParser.java

2018-03-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385553#comment-16385553 ] Weiwei Yang commented on YARN-7995: --- Thanks [~ajisakaa] for catching up this issue, and thanks [~Sen

[jira] [Commented] (YARN-7995) Remove unnecessary boxings and unboxings from PlacementConstraintParser.java

2018-03-04 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1638#comment-1638 ] Weiwei Yang commented on YARN-7995: --- Committed to trunk, thanks [~Sen Zhao] and [~ajisakaa]. > Remove

[jira] [Commented] (YARN-4090) Make Collections.sort() more efficient by caching resource usage

2018-03-04 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385556#comment-16385556 ] stefanlee commented on YARN-4090: - yes ,i see it , it's a valuable optimization, if the *assignmultiple* 

[jira] [Commented] (YARN-7626) Allow regular expression matching in container-executor.cfg for devices and named docker volumes mount

2018-03-04 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385580#comment-16385580 ] Wangda Tan commented on YARN-7626: -- Thanks [~Zian Chen]. +1, LGTM, [~miklos.szeg...@cloudera.com], do you

[jira] [Commented] (YARN-7995) Remove unnecessary boxings and unboxings from PlacementConstraintParser.java

2018-03-04 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385583#comment-16385583 ] Hudson commented on YARN-7995: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13768 (See

[jira] [Commented] (YARN-7972) Support inter-app placement constraints for allocation tags by application ID

2018-03-04 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385644#comment-16385644 ] genericqa commented on YARN-7972: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5402) Fix NoSuchMethodError in ClusterMetricsInfo

2018-03-04 Thread Colin Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385696#comment-16385696 ] Colin Ma commented on YARN-5402: [~cheersyang], [~lars_francke], I try the hadoop-2.7.5, and this problem

[jira] [Commented] (YARN-5188) FairScheduler performance bug

2018-03-04 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385711#comment-16385711 ] stefanlee commented on YARN-5188: - [~chenfolin] thanks for this jira, you say *I checked the

[jira] [Commented] (YARN-7995) Remove unnecessary boxings and unboxings from PlacementConstraintParser.java

2018-03-04 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385507#comment-16385507 ] genericqa commented on YARN-7995: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7736) Fix itemization in YARN federation document

2018-03-04 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385508#comment-16385508 ] Sen Zhao commented on YARN-7736: Thanks for your reproting this. I just submitted a patch. Please review

[jira] [Updated] (YARN-7952) Find a way to persist the log aggregation status

2018-03-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7952: Attachment: YARN-7952.2.patch > Find a way to persist the log aggregation status >

[jira] [Commented] (YARN-7995) Remove unnecessary boxings and unboxings from PlacementConstraintParser.java

2018-03-04 Thread Sen Zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385470#comment-16385470 ] Sen Zhao commented on YARN-7995: Please review it. Thanks![~ajisakaa] > Remove unnecessary boxings and

[jira] [Commented] (YARN-7952) Find a way to persist the log aggregation status

2018-03-04 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385623#comment-16385623 ] Xuan Gong commented on YARN-7952: - Yes, re-use previous configuration makes sense. But we probably need to