[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352187#comment-16352187 ] Rohith Sharma K S commented on YARN-7346: - Update : As we discussed in last ATSv2 weekly

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-02-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352238#comment-16352238 ] Rohith Sharma K S commented on YARN-7835: - bq. An alternative would be be to only clean up the

[jira] [Commented] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352287#comment-16352287 ] genericqa commented on YARN-5028: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-02-05 Thread Charan Hebri (JIRA)
Charan Hebri created YARN-7894: -- Summary: Improve ATS response for DS_CONTAINER when container launch fails Key: YARN-7894 URL: https://issues.apache.org/jira/browse/YARN-7894 Project: Hadoop YARN

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-05 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352252#comment-16352252 ] wangwj commented on YARN-7859: -- Hi,[~yufeigu].[~ka...@cloudera.com]..Thank you for your reply. Your

[jira] [Commented] (YARN-5201) Apache Ranger Yarn policies are not used

2018-02-05 Thread Sachin Gupta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352338#comment-16352338 ] Sachin Gupta commented on YARN-5201: Is this really an issue? if no, could anyone please help me with a

[jira] [Updated] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2018-02-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6739: - Attachment: YARN-6739-YARN-1011.01.patch > Crash NM at start time if oversubscription is on but

[jira] [Commented] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2018-02-05 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352443#comment-16352443 ] Haibo Chen commented on YARN-6739: -- Thanks [~miklos.szeg...@cloudera.com] for the catch! I updated the

[jira] [Updated] (YARN-7893) Document the FPGA isolation feature

2018-02-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-7893: --- Attachment: YARN-7893-trunk-001.patch > Document the FPGA isolation feature >

[jira] [Commented] (YARN-7890) NPE during container relaunch

2018-02-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352503#comment-16352503 ] Jason Lowe commented on YARN-7890: -- The NPE occurs because ContainerRelaunch never initializes the

[jira] [Commented] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352550#comment-16352550 ] genericqa commented on YARN-6739: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7893) Document the FPGA isolation feature

2018-02-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-7893: --- Attachment: FPGA-doc-YARN-7893.pdf > Document the FPGA isolation feature >

[jira] [Commented] (YARN-7893) Document the FPGA isolation feature

2018-02-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352548#comment-16352548 ] Zhankun Tang commented on YARN-7893: [~wangda] , [~zyluo] The draft doc is attached. Please review. >

[jira] [Commented] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2018-02-05 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352556#comment-16352556 ] Zhankun Tang commented on YARN-6507: [~tangzhankun] , A minor issue found in IntelOpenclFPGA when YARN

[jira] [Assigned] (YARN-7890) NPE during container relaunch

2018-02-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned YARN-7890: Assignee: Jason Lowe Affects Version/s: 2.9.0 3.0.0-alpha1

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-02-05 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352614#comment-16352614 ] Shane Kumpf commented on YARN-7815: --- Cancelling the patch until YARN-7890 is in as I overlooked

[jira] [Updated] (YARN-7815) Revisit the

2018-02-05 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7815: -- Summary: Revisit the (was: Mount the filecache as read-only in Docker containers) > Revisit the >

[jira] [Updated] (YARN-7890) NPE during container relaunch

2018-02-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7890: - Attachment: YARN-7890.001.patch > NPE during container relaunch > - > >

[jira] [Updated] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-02-05 Thread Charan Hebri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charan Hebri updated YARN-7894: --- Component/s: (was: ATSv2) timelineserver > Improve ATS response for DS_CONTAINER

[jira] [Updated] (YARN-7815) Make the YARN mounts added to Docker containers more restrictive

2018-02-05 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-7815: -- Summary: Make the YARN mounts added to Docker containers more restrictive (was: Revisit the ) > Make

[jira] [Commented] (YARN-7850) New UI does not show status for Log Aggregation

2018-02-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352150#comment-16352150 ] Sunil G commented on YARN-7850: --- Cool. Looks fine to me. I ll commit this later today. > New UI does not

[jira] [Created] (YARN-7893) Document the FPGA isolation feature

2018-02-05 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-7893: -- Summary: Document the FPGA isolation feature Key: YARN-7893 URL: https://issues.apache.org/jira/browse/YARN-7893 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-5028) RMStateStore should trim down app state for completed applications

2018-02-05 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-5028: -- Attachment: YARN-5028.002.patch > RMStateStore should trim down app state for completed applications >

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-02-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353077#comment-16353077 ] Jason Lowe commented on YARN-7849: -- Thanks for the explanation, Botong! I see now how it should be OK to

[jira] [Commented] (YARN-7890) NPE during container relaunch

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353085#comment-16353085 ] genericqa commented on YARN-7890: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353084#comment-16353084 ] Miklos Szegedi commented on YARN-7859: -- [~wangwj], thank you for the debugging, patch and the

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353102#comment-16353102 ] Eric Yang commented on YARN-7516: - - Added more test cases in patch 17. > Security check for trusted

[jira] [Commented] (YARN-3895) Support ACLs in ATSv2

2018-02-05 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353115#comment-16353115 ] Vrushali C commented on YARN-3895: --   Here is the design after several rounds of discussions in the

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353125#comment-16353125 ] Eric Yang commented on YARN-7516: - Summary of the security check is reflected in the following table: || 

[jira] [Commented] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353179#comment-16353179 ] genericqa commented on YARN-7889: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-02-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353127#comment-16353127 ] Hudson commented on YARN-7849: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13614 (See

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-02-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353129#comment-16353129 ] Botong Huang commented on YARN-7849: Sounds good, thanks [~jlowe]! >

[jira] [Commented] (YARN-5015) Unify restart policies across AM and container restarts

2018-02-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353142#comment-16353142 ] Chandni Singh commented on YARN-5015: - Hi [~hex108]  Are you still working on this? We have a use case

[jira] [Commented] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353154#comment-16353154 ] Jian He commented on YARN-7889: --- Patch, lgtm, One side issue noticed is that, till now, the client library

[jira] [Updated] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7889: Attachment: YARN-7889.003.patch > Missing kerberos token when check for RM REST API availability >

[jira] [Updated] (YARN-7516) Security check for trusted docker image

2018-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7516: Attachment: YARN-7516.017.patch > Security check for trusted docker image >

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353137#comment-16353137 ] genericqa commented on YARN-7516: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5015) Unify restart policies across AM and container restarts

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353149#comment-16353149 ] genericqa commented on YARN-5015: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7657) Queue Mapping could provide options to provide 'user' specific auto-created queues under a specified group parent queue

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353147#comment-16353147 ] genericqa commented on YARN-7657: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7789) Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator

2018-02-05 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7789: Attachment: YARN-7789.001.patch > Should fail RM if 3rd resource type is configured but RM uses >

[jira] [Updated] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7889: Attachment: YARN-7889.003.patch > Missing kerberos token when check for RM REST API availability >

[jira] [Updated] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7889: Attachment: (was: YARN-7889.003.patch) > Missing kerberos token when check for RM REST API availability

[jira] [Updated] (YARN-7895) Backport YARN-3564 to branch-2.7 to fix TestContainerAllocation

2018-02-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated YARN-7895: - Attachment: YARN-7895-branch-2.7.diff > Backport YARN-3564 to branch-2.7 to fix TestContainerAllocation >

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352824#comment-16352824 ] Miklos Szegedi commented on YARN-7857: -- [~Jim_Brennan], I agree let's postpone removing the guard. The

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352778#comment-16352778 ] Hudson commented on YARN-7876: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13613 (See

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-02-05 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352816#comment-16352816 ] Jim Brennan commented on YARN-7857: --- [~miklos.szeg...@cloudera.com] I have prepared another patch that

[jira] [Updated] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-02-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7849: --- Attachment: YARN-7849.v2.patch > TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails

[jira] [Created] (YARN-7895) Backport YARN-3564 to branch-2.7 to fix TestContainerAllocation

2018-02-05 Thread Chen Liang (JIRA)
Chen Liang created YARN-7895: Summary: Backport YARN-3564 to branch-2.7 to fix TestContainerAllocation Key: YARN-7895 URL: https://issues.apache.org/jira/browse/YARN-7895 Project: Hadoop YARN

[jira] [Commented] (YARN-7895) Backport YARN-3564 to branch-2.7 to fix TestContainerAllocation

2018-02-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352720#comment-16352720 ] Chen Liang commented on YARN-7895: -- Posting a patch (not able to assign the JIRA though). [~jianhe] could

[jira] [Updated] (YARN-7895) Backport YARN-3564 to branch-2.7 to fix TestContainerAllocation

2018-02-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated YARN-7895: - Attachment: YARN-7895-branch-2.7.patch > Backport YARN-3564 to branch-2.7 to fix TestContainerAllocation >

[jira] [Updated] (YARN-7895) Backport YARN-3564 to branch-2.7 to fix TestContainerAllocation

2018-02-05 Thread Chen Liang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Liang updated YARN-7895: - Attachment: (was: YARN-7895-branch-2.7.diff) > Backport YARN-3564 to branch-2.7 to fix

[jira] [Reopened] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2018-02-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas reopened YARN-6868: - Sure. Reopening to cherry-pick this to branch-2 and branch-2.9 > Add test scope to certain entries in

[jira] [Resolved] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2018-02-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved YARN-6868. - Resolution: Fixed Fix Version/s: (was: 3.0.0-beta1) 2.9.1 > Add test

[jira] [Comment Edited] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352866#comment-16352866 ] Yufei Gu edited comment on YARN-7655 at 2/5/18 8:11 PM: Hi [~Steven Rand], I made

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-05 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352868#comment-16352868 ] Chandni Singh commented on YARN-7572: - [~eyang] we do print out pre-formatted JSON currently.  The

[jira] [Updated] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-05 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated YARN-7655: -- Attachment: YARN-7655-003.patch > avoid AM preemption caused by RRs for specific nodes or racks >

[jira] [Commented] (YARN-7866) [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit

2018-02-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353302#comment-16353302 ] Wangda Tan commented on YARN-7866: -- Looks good, +1, thanks [~sunilg] > [UI2] Kerberizing the UI doesn't

[jira] [Updated] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7838: -- Attachment: YARN-7838.001.patch > Support AND/OR constraints in Distributed Shell >

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-05 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353324#comment-16353324 ] Weiwei Yang commented on YARN-7838: --- Hi [~asuresh] I just submitted a formal v1 patch, this patch adds a

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353326#comment-16353326 ] Eric Yang commented on YARN-7572: - [~csingh] I think we can also omit null value fields to clean up the

[jira] [Commented] (YARN-7789) Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator

2018-02-05 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353193#comment-16353193 ] Suma Shivaprasad commented on YARN-7789: Patch LGTM. A few minor comments.   1.Can we reword the

[jira] [Created] (YARN-7897) Invalid NM log & NM UI link published on Yarn UI when container fails

2018-02-05 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7897: Summary: Invalid NM log & NM UI link published on Yarn UI when container fails Key: YARN-7897 URL: https://issues.apache.org/jira/browse/YARN-7897 Project: Hadoop YARN

[jira] [Updated] (YARN-7897) Invalid NM log & NM UI link published on Yarn UI when container fails

2018-02-05 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-7897: - Attachment: Screen Shot 2018-02-05 at 4.52.59 PM.png > Invalid NM log & NM UI link published on Yarn UI

[jira] [Commented] (YARN-5742) Serve aggregated logs of historical apps from timeline service

2018-02-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353254#comment-16353254 ] Wangda Tan commented on YARN-5742: -- [~rohithsharma] , do you still plan to work on this item? Is it still

[jira] [Commented] (YARN-7739) DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation

2018-02-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353251#comment-16353251 ] Wangda Tan commented on YARN-7739: -- [~templedf] , could you help to check this patch?  >

[jira] [Commented] (YARN-5848) public/crossdomain.xml is problematic

2018-02-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353260#comment-16353260 ] Wangda Tan commented on YARN-5848: -- Thanks [~aw] for reporting this issue. [~sunilg] , could you help to

[jira] [Commented] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353213#comment-16353213 ] genericqa commented on YARN-7889: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7890) NPE during container relaunch

2018-02-05 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353223#comment-16353223 ] Billie Rinaldi commented on YARN-7890: -- +1 for patch 002. This fixes the NPE. Thanks for the patch,

[jira] [Commented] (YARN-7890) NPE during container relaunch

2018-02-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353243#comment-16353243 ] Hudson commented on YARN-7890: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13615 (See

[jira] [Commented] (YARN-7292) Revisit Resource Profile Behavior

2018-02-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353255#comment-16353255 ] Sunil G commented on YARN-7292: --- It seems Findbugs warning which is shown in the report and the link are

[jira] [Commented] (YARN-5848) public/crossdomain.xml is problematic

2018-02-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353267#comment-16353267 ] Sunil G commented on YARN-5848: --- Sure. I will check and update. > public/crossdomain.xml is problematic >

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-05 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353279#comment-16353279 ] Steven Rand commented on YARN-7655: --- The concern I have with all three RRs being the same size is that we

[jira] [Commented] (YARN-7789) Should fail RM if 3rd resource type is configured but RM uses DefaultResourceCalculator

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353290#comment-16353290 ] genericqa commented on YARN-7789: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7838) Support AND/OR constraints in Distributed Shell

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353362#comment-16353362 ] genericqa commented on YARN-7838: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353364#comment-16353364 ] genericqa commented on YARN-7655: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7890) NPE during container relaunch

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352683#comment-16352683 ] genericqa commented on YARN-7890: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6868) Add test scope to certain entries in hadoop-yarn-server-resourcemanager pom.xml

2018-02-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352774#comment-16352774 ] Chris Douglas commented on YARN-6868: - Verified that the zookeeper and curator test jars aren't part of

[jira] [Commented] (YARN-7655) avoid AM preemption caused by RRs for specific nodes or racks

2018-02-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352866#comment-16352866 ] Yufei Gu commented on YARN-7655: Hi [~Steven Rand], I made it work by using following resource requests:

[jira] [Updated] (YARN-7639) Queue Management scheduling edit policy class needs to be configured dynamically

2018-02-05 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7639: --- Description: This needs to be configured dynamically i.e added to the list of current

[jira] [Updated] (YARN-7890) NPE during container relaunch

2018-02-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7890: - Attachment: YARN-7890.002.patch > NPE during container relaunch > - > >

[jira] [Commented] (YARN-7890) NPE during container relaunch

2018-02-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353007#comment-16353007 ] Jason Lowe commented on YARN-7890: -- Thanks for the review, Shane! I added a token comment to make

[jira] [Updated] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-05 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7889: Attachment: YARN-7889.002.patch > Missing kerberos token when check for RM REST API availability >

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-02-05 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352982#comment-16352982 ] Botong Huang commented on YARN-7849: Hi [~jlowe], I think both v1 and v3 patch are good. Please let me

[jira] [Updated] (YARN-7657) Queue Mapping could provide options to provide 'user' specific auto-created queues under a specified group parent queue

2018-02-05 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7657: --- Attachment: YARN-7657.1.patch > Queue Mapping could provide options to provide 'user' specific

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352976#comment-16352976 ] genericqa commented on YARN-7849: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7639) Queue Management scheduling edit policy class needs to be configured dynamically

2018-02-05 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7639: --- Description: This needs to be configured dynamically for

[jira] [Commented] (YARN-7876) Localized jars that are expanded after localization are not fully copied

2018-02-05 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353017#comment-16353017 ] Miklos Szegedi commented on YARN-7876: -- Thank you for committing this [~jlowe]! > Localized jars that

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 beta release

2018-02-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353449#comment-16353449 ] Rohith Sharma K S commented on YARN-7346: - It appears to be conditional compilation and ACLs story

[jira] [Commented] (YARN-7292) Revisit Resource Profile Behavior

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353435#comment-16353435 ] genericqa commented on YARN-7292: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-05 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353484#comment-16353484 ] wangwj commented on YARN-7859: -- Hi,[~yufeigu],thank you for your reply.:) 1、This phenomenon often happens

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-05 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353520#comment-16353520 ] wangwj commented on YARN-7859: -- [~miklos.szeg...@cloudera.com] Thanks yor your advices... I will try

[jira] [Commented] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353475#comment-16353475 ] Sunil G commented on YARN-7889: --- +1 from me as well. Looks fine. > Missing kerberos token when check for RM

[jira] [Commented] (YARN-7866) [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit

2018-02-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353478#comment-16353478 ] Sunil G commented on YARN-7866: --- Thanks [~leftnoteasy] I ll commit this shortly. > [UI2] Kerberizing the UI

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-05 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353489#comment-16353489 ] wangwj commented on YARN-7859: -- [~miklos.szeg...@cloudera.com] Thank you for your reply vary much!!:):)

[jira] [Commented] (YARN-7889) Missing kerberos token when check for RM REST API availability

2018-02-05 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353497#comment-16353497 ] Hudson commented on YARN-7889: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13616 (See

[jira] [Issue Comment Deleted] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-05 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Comment: was deleted (was: [~miklos.szeg...@cloudera.com] Thank you for your reply vary much!!:):) I will

[jira] [Commented] (YARN-7841) Cleanup AllocationFileLoaderService's reloadAllocations method

2018-02-05 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352896#comment-16352896 ] Robert Kanter commented on YARN-7841: - Thanks for the patch [~snemeth] and the review [~grepas]. 

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-02-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352921#comment-16352921 ] Yufei Gu commented on YARN-7859: Basically, we should be very careful about introducing new properties to

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-02-05 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16352928#comment-16352928 ] genericqa commented on YARN-7849: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7896) AM log link in diagnostic is redirected to old RM UI

2018-02-05 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-7896: Summary: AM log link in diagnostic is redirected to old RM UI Key: YARN-7896 URL: https://issues.apache.org/jira/browse/YARN-7896 Project: Hadoop YARN Issue Type:

  1   2   >