[jira] [Commented] (YARN-6681) Eliminate double-copy of child queues in canAssignToThisQueue

2017-06-02 Thread Ying Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034275#comment-16034275 ] Ying Zhang commented on YARN-6681: -- The new method "hasChildQueues()" in ParentQueue.java, do we need to

[jira] [Updated] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-02 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated YARN-6280: - Attachment: YARN-6280.010.patch > Add a query parameter in ResourceManager Cluster Applications REST API

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034201#comment-16034201 ] Hadoop QA commented on YARN-6208: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6664) Backport YARN-5988 to branch-2.8, branch-2.7

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034506#comment-16034506 ] Hadoop QA commented on YARN-6664: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-02 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated YARN-6280: - Attachment: (was: YARN-6280.010.patch) > Add a query parameter in ResourceManager Cluster Applications

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034478#comment-16034478 ] Hadoop QA commented on YARN-6280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6664) Backport YARN-5988 to branch-2.8, branch-2.7

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034525#comment-16034525 ] Hadoop QA commented on YARN-6664: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6664) Backport YARN-5988 to branch-2.8, branch-2.7

2017-06-02 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6664: Attachment: YARN-5988-branch-2.7.0001.patch > Backport YARN-5988 to branch-2.8, branch-2.7 >

[jira] [Updated] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-02 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated YARN-6280: - Attachment: YARN-6280.010.patch > Add a query parameter in ResourceManager Cluster Applications REST API

[jira] [Updated] (YARN-6664) Backport YARN-5988 to branch-2.8, branch-2.7

2017-06-02 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6664: Attachment: (was: YARN-5988-branch-2.7.0001.patch) > Backport YARN-5988 to branch-2.8,

[jira] [Commented] (YARN-6664) Backport YARN-5988 to branch-2.8, branch-2.7

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034530#comment-16034530 ] Hadoop QA commented on YARN-6664: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034727#comment-16034727 ] Hadoop QA commented on YARN-6280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-02 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated YARN-6280: - Attachment: (was: YARN-6280.010.patch) > Add a query parameter in ResourceManager Cluster Applications

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-02 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034735#comment-16034735 ] Lantao Jin commented on YARN-6280: -- Hi [~rohithsharma], I've updated {{ResourceManagerRest.md}} and the

[jira] [Commented] (YARN-6680) Avoid locking overhead for NO_LABEL lookups

2017-06-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034834#comment-16034834 ] Daryn Sharp commented on YARN-6680: --- I use a profiler for performance work – hunches are inevitable

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-06-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034893#comment-16034893 ] Daniel Templeton commented on YARN-6208: Thanks, [~ajisakaa]! One tiny grammar nit. It should be

[jira] [Updated] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-02 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated YARN-6280: - Attachment: YARN-6280.010.patch > Add a query parameter in ResourceManager Cluster Applications REST API

[jira] [Assigned] (YARN-4030) Make Nodemanager cgroup usage for container easier to use when its running inside a cgroup

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-4030: --- Assignee: (was: Anubhav Dhoot) > Make Nodemanager cgroup usage for container easier to

[jira] [Assigned] (YARN-4144) Add NM that causes LaunchFailedTransition to blacklist

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-4144: --- Assignee: (was: Anubhav Dhoot) > Add NM that causes LaunchFailedTransition to blacklist >

[jira] [Assigned] (YARN-2175) Container localization has no timeouts and tasks can be stuck there for a long time

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-2175: --- Assignee: (was: Anubhav Dhoot) > Container localization has no timeouts and tasks can be

[jira] [Assigned] (YARN-2661) Container Localization is not resource limited

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-2661: --- Assignee: (was: Anubhav Dhoot) > Container Localization is not resource limited >

[jira] [Updated] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-06-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.yarn-native-services.03.patch > Kerberos support for native service AM with the service

[jira] [Updated] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-06-02 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6208: Attachment: YARN-6208.04.patch Thanks! Updated. > Improve the log when FinishAppEvent sent to the

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034994#comment-16034994 ] Hadoop QA commented on YARN-6208: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035003#comment-16035003 ] Hadoop QA commented on YARN-6280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-3257) FairScheduler: MaxAm may be set too low preventing apps from starting

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-3257: --- Assignee: (was: Anubhav Dhoot) > FairScheduler: MaxAm may be set too low preventing apps

[jira] [Assigned] (YARN-3119) Memory limit check need not be enforced unless aggregate usage of all containers is near limit

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-3119: --- Assignee: (was: Anubhav Dhoot) > Memory limit check need not be enforced unless aggregate

[jira] [Assigned] (YARN-3229) Incorrect processing of container as LOST on Interruption during NM shutdown

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-3229: --- Assignee: (was: Anubhav Dhoot) > Incorrect processing of container as LOST on

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035055#comment-16035055 ] Eric Payne commented on YARN-6585: -- bq. I don't understand why we needed to add a deprecated newInstance

[jira] [Commented] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035095#comment-16035095 ] Hadoop QA commented on YARN-6669: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-06-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034968#comment-16034968 ] Hudson commented on YARN-6208: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11819 (See

[jira] [Updated] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-06-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: (was: YARN-6669.yarn-native-services.02.patch) > Kerberos support for native service AM with the

[jira] [Commented] (YARN-6681) Eliminate double-copy of child queues in canAssignToThisQueue

2017-06-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034902#comment-16034902 ] Daryn Sharp commented on YARN-6681: --- Should/could I just unconditionally return true for a parent queue?

[jira] [Commented] (YARN-6208) Improve the log when FinishAppEvent sent to the NodeManager which didn't run the application

2017-06-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034909#comment-16034909 ] Daniel Templeton commented on YARN-6208: LGTM +1 . I'll commit it shortly. > Improve the log when

[jira] [Commented] (YARN-6682) Improve performance of AssignmentInformation datastructures

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034911#comment-16034911 ] Hadoop QA commented on YARN-6682: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-4076) FairScheduler does not allow AM to choose which containers to preempt

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-4076: --- Assignee: (was: Anubhav Dhoot) > FairScheduler does not allow AM to choose which

[jira] [Assigned] (YARN-3994) RM should respect AM resource/placement constraints

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-3994: --- Assignee: (was: Anubhav Dhoot) > RM should respect AM resource/placement constraints >

[jira] [Assigned] (YARN-4021) RuntimeException/YarnRuntimeException sent over to the client can cause client to assume a local fatal failure

2017-06-02 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot reassigned YARN-4021: --- Assignee: (was: Anubhav Dhoot) > RuntimeException/YarnRuntimeException sent over to the

[jira] [Updated] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-06-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.yarn-native-services.02.patch > Kerberos support for native service AM with the service

[jira] [Updated] (YARN-6604) Allow metric TTL for Application table to be specified through cmd

2017-06-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6604: - Attachment: YARN-6604.00.patch > Allow metric TTL for Application table to be specified through cmd >

[jira] [Commented] (YARN-6604) Allow metric TTL for Application table to be specified through cmd

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035098#comment-16035098 ] Hadoop QA commented on YARN-6604: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-02 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034815#comment-16034815 ] Lantao Jin commented on YARN-6280: -- Re-upload the 010.patch to resolve the new 8 checkstyle warnings. >

[jira] [Commented] (YARN-6679) Reduce Resource instance overhead via non-PBImpl

2017-06-02 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035410#comment-16035410 ] Daniel Templeton commented on YARN-6679: bq. Using signum to handle a NaN (impossible, I hope?) may

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: (was: YARN-2113.branch-2.8.0019.patch) > Add cross-user preemption within

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.8.0019.patch Bad 2.8 patch. Sorry about that. Uploading a fixed on that

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035433#comment-16035433 ] Hadoop QA commented on YARN-6608: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2017-06-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035116#comment-16035116 ] Haibo Chen commented on YARN-5094: -- Will update the patch to address the unit test failures. > some YARN

[jira] [Updated] (YARN-5094) some YARN container events have timestamp of -1

2017-06-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5094: - Attachment: YARN-5094.02.patch Patch updated to ignore ApplicationLocalizationEvent timestamp when

[jira] [Assigned] (YARN-5169) most YARN events have timestamp of -1

2017-06-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-5169: Assignee: (was: Haibo Chen) > most YARN events have timestamp of -1 >

[jira] [Updated] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-06-02 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6608: --- Attachment: YARN-6608-branch-2.v2.patch > Backport all SLS improvements from trunk to branch-2 >

[jira] [Commented] (YARN-6669) Kerberos support for native service AM with the service REST API

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035152#comment-16035152 ] Hadoop QA commented on YARN-6669: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6685) Add job count in to SLS JSON input format

2017-06-02 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6685: -- Summary: Add job count in to SLS JSON input format Key: YARN-6685 URL: https://issues.apache.org/jira/browse/YARN-6685 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035208#comment-16035208 ] Sunil G commented on YARN-6585: --- HI [~eepayne] Thanks for the comments. In similar to

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-06-02 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035234#comment-16035234 ] Carlo Curino commented on YARN-6608: I fat-fingered a Class name while diffing. v2 should compile

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035259#comment-16035259 ] Hadoop QA commented on YARN-5094: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6640) AM heartbeat stuck when responseId overflows MAX_INT

2017-06-02 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6640: --- Attachment: YARN-6640.v1.patch > AM heartbeat stuck when responseId overflows MAX_INT >

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-06-02 Thread Ye Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035270#comment-16035270 ] Ye Zhou commented on YARN-6608: --- Thanks, [~curino]. Just checked the patch, looks like YARN-1471 is already

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

2017-06-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035160#comment-16035160 ] Haibo Chen commented on YARN-6047: -- Linked YARN-6382 to document the known writer fault-tolerance issue.

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-06-02 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035458#comment-16035458 ] Carlo Curino commented on YARN-6608: [~yufeigu] The question you ask if very reasonable, yet

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035468#comment-16035468 ] Karthik Kambatla commented on YARN-6670: Couple of comments: # I think there is value in keeping

[jira] [Commented] (YARN-6547) Enhance SLS-based tests leveraging invariant checker

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035528#comment-16035528 ] Hadoop QA commented on YARN-6547: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6199) Support for listing flows with filter userid

2017-06-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035588#comment-16035588 ] Haibo Chen commented on YARN-6199: -- The current /flows query is implemented by setting the scan range. We

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

2017-06-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035595#comment-16035595 ] Konstantin Shvachko commented on YARN-1471: --- I see a new patch in YARN-6608. So this is

[jira] [Commented] (YARN-6680) Avoid locking overhead for NO_LABEL lookups

2017-06-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035505#comment-16035505 ] Daryn Sharp commented on YARN-6680: --- # Maybe it was the same before, I just attacked the top few hot

[jira] [Created] (YARN-6686) Support for adding and removing queue mappings

2017-06-02 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-6686: --- Summary: Support for adding and removing queue mappings Key: YARN-6686 URL: https://issues.apache.org/jira/browse/YARN-6686 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2017-06-02 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035296#comment-16035296 ] Vrushali C commented on YARN-5094: -- Thanks [~haibochen] for the patch. Do you think we might want to put

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2017-06-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035301#comment-16035301 ] Haibo Chen commented on YARN-5094: -- Will look into it and follow up with a new patch > some YARN

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-06-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035308#comment-16035308 ] Yufei Gu commented on YARN-6608: Thanks [~curino] for working on this. Can you provide a list of JIRAs

[jira] [Commented] (YARN-6680) Avoid locking overhead for NO_LABEL lookups

2017-06-02 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035337#comment-16035337 ] Naganarasimha G R commented on YARN-6680: - Thanks for the clarification [~daryn], my query was

[jira] [Commented] (YARN-6511) Federation Intercepting and propagating AM-RM communications (part two: secondary subclusters added)

2017-06-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035370#comment-16035370 ] Subru Krishnan commented on YARN-6511: -- Thanks [~botong] for the patch. I looked at it & please find

[jira] [Commented] (YARN-5094) some YARN container events have timestamp of -1

2017-06-02 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035282#comment-16035282 ] Haibo Chen commented on YARN-5094: -- Findbug warnings are unrelated. > some YARN container events have

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035289#comment-16035289 ] Hadoop QA commented on YARN-2113: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5953) Create CLI for changing YARN configurations

2017-06-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035288#comment-16035288 ] Jonathan Hung commented on YARN-5953: - Hi [~leftnoteasy]/[~xgong], we discussed directly making REST

[jira] [Commented] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035315#comment-16035315 ] Eric Payne commented on YARN-6585: -- bq. In similar to GetClusterNodeLabelsResponse, it was also support

[jira] [Commented] (YARN-6640) AM heartbeat stuck when responseId overflows MAX_INT

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035357#comment-16035357 ] Hadoop QA commented on YARN-6640: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6547) Enhance SLS-based tests leveraging invariant checker

2017-06-02 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-6547: --- Attachment: YARN-6547.v2.patch > Enhance SLS-based tests leveraging invariant checker >

[jira] [Commented] (YARN-6547) Enhance SLS-based tests leveraging invariant checker

2017-06-02 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035387#comment-16035387 ] Carlo Curino commented on YARN-6547: [~leftnoteasy], patch v2 addresses your ask to leave

[jira] [Commented] (YARN-6547) Enhance SLS-based tests leveraging invariant checker

2017-06-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035392#comment-16035392 ] Wangda Tan commented on YARN-6547: -- Thanks [~curino]. +1 to latest patch, please feel free to commit it

[jira] [Updated] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-06-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6687: - Attachment: YARN-6687-v1.patch Attaching patch that validates that the duration of the periodic

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035709#comment-16035709 ] Hadoop QA commented on YARN-2113: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035736#comment-16035736 ] Hadoop QA commented on YARN-6634: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4250) NPE in AppSchedulingInfo#isRequestLabelChanged

2017-06-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035744#comment-16035744 ] Jonathan Hung commented on YARN-4250: - This applies cleanly to branch-2.7 after YARN-4140. [~shv] can

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

2017-06-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035738#comment-16035738 ] Jonathan Hung commented on YARN-4140: - Thanks [~shv], attached branch-2.7 002 patch. > RM container

[jira] [Updated] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

2017-06-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-4140: Attachment: YARN-4140-branch-2.7.002.patch > RM container allocation delayed incase of app submitted

[jira] [Commented] (YARN-6685) Add job count in to SLS JSON input format

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035716#comment-16035716 ] Hadoop QA commented on YARN-6685: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-06-02 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6687: Summary: Validate that the duration of the periodic reservation is less than the periodicity Key: YARN-6687 URL: https://issues.apache.org/jira/browse/YARN-6687

[jira] [Commented] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035775#comment-16035775 ] Hadoop QA commented on YARN-6687: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

2017-06-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035789#comment-16035789 ] Jonathan Hung commented on YARN-4140: - Most unit test failures will be fixed with YARN-4250,

[jira] [Commented] (YARN-6199) Support for listing flows with filter userid

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035713#comment-16035713 ] Hadoop QA commented on YARN-6199: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4925) ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression

2017-06-02 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035730#comment-16035730 ] Jonathan Hung commented on YARN-4925: - Thanks [~shv]! > ContainerRequest in AMRMClient, application

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

2017-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035786#comment-16035786 ] Hadoop QA commented on YARN-4140: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

2017-06-02 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035723#comment-16035723 ] Konstantin Shvachko commented on YARN-4140: --- The backport patch looks good. Minor nits in

[jira] [Commented] (YARN-4250) NPE in AppSchedulingInfo#isRequestLabelChanged

2017-06-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035772#comment-16035772 ] Brahma Reddy Battula commented on YARN-4250: Yes, it will apply cleanly..waiting for YARN-4140

[jira] [Commented] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-06-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035613#comment-16035613 ] Yufei Gu commented on YARN-6608: [~curino], that's a fair point. We cannot set "fix version" to branch-2 in

[jira] [Comment Edited] (YARN-6608) Backport all SLS improvements from trunk to branch-2

2017-06-02 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035613#comment-16035613 ] Yufei Gu edited comment on YARN-6608 at 6/2/17 11:18 PM: - [~curino], that's a fair

[jira] [Commented] (YARN-3053) [Security] Review and implement authentication in ATS v.2

2017-06-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035626#comment-16035626 ] Jian He commented on YARN-3053: --- For token renewal, (not token roll-over), the document mentioned the

[jira] [Commented] (YARN-5647) [Security] Collector side changes for loading auth filters and principals

2017-06-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035634#comment-16035634 ] Jian He commented on YARN-5647: --- Thanks - TimelineUtils#addTimelineFilters has some duplicated code as

[jira] [Comment Edited] (YARN-5647) [Security] Collector side changes for loading auth filters and principals

2017-06-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035634#comment-16035634 ] Jian He edited comment on YARN-5647 at 6/2/17 11:42 PM: Thanks Varun for working on

[jira] [Updated] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-02 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6634: --- Attachment: YARN-6634.v6.patch > [API] Define an API for ResourceManager

[jira] [Commented] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-06-02 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035642#comment-16035642 ] Giovanni Matteo Fumarola commented on YARN-6634: Thanks [~curino] for the review. I

  1   2   >