[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346391#comment-16346391 ] Arun Suresh commented on YARN-7863: --- [~sunilg], There are actually two aspects to this: # Supporting node

[jira] [Comment Edited] (YARN-7863) Modify placement constraints to support node attributes

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346391#comment-16346391 ] Arun Suresh edited comment on YARN-7863 at 1/31/18 7:59 AM: [~sunilg], There

[jira] [Comment Edited] (YARN-7863) Modify placement constraints to support node attributes

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346391#comment-16346391 ] Arun Suresh edited comment on YARN-7863 at 1/31/18 7:59 AM: [~sunilg], There

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346394#comment-16346394 ] genericqa commented on YARN-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-01-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346399#comment-16346399 ] Wangda Tan commented on YARN-7863: -- [~asuresh] / [~sunilg] , is there anything need to be done before

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-01-31 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346404#comment-16346404 ] Tao Yang commented on YARN-7494: Thanks [~cheersyang] for your mention. Some thoughts (parts are the same

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Fix Version/s: (was: 2.6.0) > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: (was: YARN-7859-v1.patch) > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Affects Version/s: (was: 2.6.0) > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Resolved] (YARN-7802) [UI2] Application regex search did not work properly with app name

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G resolved YARN-7802. --- Resolution: Fixed Hadoop Flags: Reviewed Thanks [~Sreenath] > [UI2] Application regex search did not

[jira] [Commented] (YARN-7703) Apps killed from the NEW state are not recorded in the state store

2018-01-31 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346788#comment-16346788 ] lujie commented on YARN-7703: - after reading the discussion in 

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346722#comment-16346722 ] Sunil G commented on YARN-7757: --- Thanks [~cheersyang]. Makes sense. +1 to the patch. I will commit later

[jira] [Resolved] (YARN-7837) TestRMWebServiceAppsNodelabel.testAppsRunning is failing

2018-01-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-7837. -- Resolution: Duplicate > TestRMWebServiceAppsNodelabel.testAppsRunning is failing >

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-01-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346985#comment-16346985 ] Miklos Szegedi commented on YARN-7857: -- Thank you, [~Jim_Brennan] for raising this. Indeed, you are

[jira] [Commented] (YARN-7864) YARN Federation document has error. spelling mistakes.

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346660#comment-16346660 ] genericqa commented on YARN-7864: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7865) Node attributes documentation

2018-01-31 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-7865: - Summary: Node attributes documentation Key: YARN-7865 URL: https://issues.apache.org/jira/browse/YARN-7865 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346683#comment-16346683 ] Sunil G commented on YARN-7757: --- [~cheersyang] Thanks for the updated patch One quick doubt related to

[jira] [Updated] (YARN-7802) [UI2] Application regex search did not work properly with app name

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7802: -- Summary: [UI2] Application regex search did not work properly with app name (was: Application regex search did

[jira] [Commented] (YARN-7802) Application regex search did not work properly with app name

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346687#comment-16346687 ] Sunil G commented on YARN-7802: --- +1 Committing shortly. > Application regex search did not work properly

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Fix Version/s: 3.0.0 > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Commented] (YARN-7802) [UI2] Application regex search did not work properly with app name

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346739#comment-16346739 ] Hudson commented on YARN-7802: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13586 (See

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346762#comment-16346762 ] wangwj commented on YARN-7859: -- In my cluster,I did an experiment. There are two queues in my cluster:

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-01-31 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346940#comment-16346940 ] Shane Kumpf commented on YARN-7221: --- Thanks [~eyang]! Could we consider adding ACLs in YARN to determine

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: screenshot-3.png > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346808#comment-16346808 ] Sunil G commented on YARN-4606: --- [~maniraj...@gmail.com] You can look into

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346882#comment-16346882 ] genericqa commented on YARN-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: YARN-7859-v1.patch > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: screenshot-2.png > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346717#comment-16346717 ] Weiwei Yang commented on YARN-7757: --- Hi [~sunilg] Thanks, regarding to your comments # It is fine to run

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Affects Version/s: 3.0.0 > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-01-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346727#comment-16346727 ] Weiwei Yang commented on YARN-7494: --- Hi [~sunilg] Some updates today, I took a deeper look at the patch.

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Environment: (was:     The environment of my company is hadoop2.6.0-cdh5.4.7) > New feature: add queue

[jira] [Commented] (YARN-7861) [UI2] Logs page shows duplicated containers with ATS

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346877#comment-16346877 ] Hudson commented on YARN-7861: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13587 (See

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-31 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346953#comment-16346953 ] Shane Kumpf commented on YARN-7815: --- Thanks for all the discussion here! {quote}I think that leaves us

[jira] [Commented] (YARN-7842) PB changes to carry node-attributes in NM heartbeat

2018-01-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346747#comment-16346747 ] Weiwei Yang commented on YARN-7842: --- Per discussion with [~sunilg], we'll revisit if we need to keep 

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: screenshot-1.png > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346755#comment-16346755 ] wangwj commented on YARN-7859: -- In my cluster,I did an experiment. !screenshot-1.png! > New

[jira] [Issue Comment Deleted] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Comment: was deleted (was: In my cluster,I did an experiment. !screenshot-1.png! ) > New feature: add

[jira] [Comment Edited] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346762#comment-16346762 ] wangwj edited comment on YARN-7859 at 1/31/18 12:51 PM: In my cluster,I did an

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: (was: screenshot-2.png) > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: log > New feature: add queue scheduling deadLine in fairScheduler. >

[jira] [Commented] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-01-31 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346861#comment-16346861 ] Wangda Tan commented on YARN-7738: -- [~water] This is not an issue exists in 2.7.3, this is a 3.0/3.1

[jira] [Commented] (YARN-7828) Clicking on yarn service should take to component tab

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346876#comment-16346876 ] Hudson commented on YARN-7828: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13587 (See

[jira] [Updated] (YARN-6592) Rich placement constraints in YARN

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6592: -- Fix Version/s: 3.1.0 > Rich placement constraints in YARN > -- > >

[jira] [Assigned] (YARN-6592) Rich placement constraints in YARN

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-6592: - Assignee: Arun Suresh > Rich placement constraints in YARN > -- >

[jira] [Closed] (YARN-7792) Merge work for YARN-6592

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh closed YARN-7792. - Assignee: Sunil G > Merge work for YARN-6592 > > > Key: YARN-7792

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347250#comment-16347250 ] Arun Suresh commented on YARN-7822: --- Cherry-picked to trunk and deleted branch YARN-7812 > Constraint

[jira] [Updated] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7822: -- Target Version/s: 3.1.0 Fix Version/s: (was: YARN-7812) 3.1.0 >

[jira] [Commented] (YARN-7857) -fstack-check compilation flag causes binary incompatibility for container-executor between RHEL 6 and RHEL 7

2018-01-31 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347175#comment-16347175 ] Jim Brennan commented on YARN-7857: --- Thanks [~miklos.szeg...@cloudera.com] for the detailed analysis! I

[jira] [Commented] (YARN-7780) Documentation for Placement Constraints

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347124#comment-16347124 ] Hudson commented on YARN-7780: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347096#comment-16347096 ] Hudson commented on YARN-6593: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Updated] (YARN-7866) [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7866: -- Description: Handle 401 error and show in UI credit to [~ssath...@hortonworks.com] for finding  this issue.

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347183#comment-16347183 ] Eric Badger commented on YARN-7815: --- {quote}I think that leaves us with this proposal which should

[jira] [Commented] (YARN-7862) YARN native service REST endpoint needs user.name as query param

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347205#comment-16347205 ] Sunil G commented on YARN-7862: --- Thanks [~eyang] I agree with the last point of sending WWW-Authenticate

[jira] [Comment Edited] (YARN-7862) YARN native service REST endpoint needs user.name as query param

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347189#comment-16347189 ] Eric Yang edited comment on YARN-7862 at 1/31/18 5:32 PM: -- Hi [~sunilg], YARN

[jira] [Updated] (YARN-7613) Implement Basic algorithm for constraint based placement

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7613: -- Fix Version/s: 3.1.0 > Implement Basic algorithm for constraint based placement >

[jira] [Resolved] (YARN-6592) Rich placement constraints in YARN

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh resolved YARN-6592. --- Resolution: Fixed Target Version/s: 3.1.0 All tasks have been completed. Merged the branch

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-01-31 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347152#comment-16347152 ] Billie Rinaldi commented on YARN-7516: -- I like the idea of having two prefix lists. That would give

[jira] [Updated] (YARN-7866) [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7866: -- Attachment: YARN-7866.001.patch > [UI2] Kerberizing the UI doesn't give any warning or content when UI is >

[jira] [Commented] (YARN-7866) [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347186#comment-16347186 ] Sunil G commented on YARN-7866: --- [~Sreenath] could u pls review this. > [UI2] Kerberizing the UI doesn't

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347220#comment-16347220 ] Sunil G commented on YARN-4606: --- Thanks [~eepayne]. You are correct.  - {{activeUsers}}: users that have at

[jira] [Resolved] (YARN-7862) YARN native service REST endpoint needs user.name as query param

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang resolved YARN-7862. - Resolution: Not A Bug > YARN native service REST endpoint needs user.name as query param >

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346992#comment-16346992 ] Sunil G commented on YARN-7494: --- Thanks [~leftnoteasy] [~cheersyang] [~Tao Yang] for comments. Overall i ll

[jira] [Commented] (YARN-7822) Constraint satisfaction checker support for composite OR and AND constraints

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347161#comment-16347161 ] Hudson commented on YARN-7822: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13590 (See

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-01-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347215#comment-16347215 ] Eric Badger commented on YARN-7221: --- bq. I'm not a huge fan of relying on sudo to provide the ACLs for

[jira] [Updated] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7849: - Summary: TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-01-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347236#comment-16347236 ] Manikandan R commented on YARN-4606: Thanks [~eepayne] [~sunilg] for your comments. {quote}And when we

[jira] [Updated] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7849: --- Attachment: YARN-7849.v1.patch > TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-31 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347030#comment-16347030 ] Jason Lowe commented on YARN-2185: -- +1 lgtm. Committing this. > Use pipes when localizing archives >

[jira] [Comment Edited] (YARN-7862) YARN native service REST endpoint needs user.name as query param

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347205#comment-16347205 ] Sunil G edited comment on YARN-7862 at 1/31/18 5:17 PM: Thanks [~eyang] I agree

[jira] [Commented] (YARN-7862) YARN native service REST endpoint needs user.name as query param

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347248#comment-16347248 ] Eric Yang commented on YARN-7862: - [~sunilg] I don't think we ever said user.name is mandatory. In the

[jira] [Commented] (YARN-7788) Factor out management of temp tags from AllocationTagsManager

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347116#comment-16347116 ] Hudson commented on YARN-7788: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7745) Allow DistributedShell to take a placement specification for containers it wants to launch

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347113#comment-16347113 ] Hudson commented on YARN-7745: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347099#comment-16347099 ] Hudson commented on YARN-7448: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7682) Expose canSatisfyConstraints utility function to validate a placement against a constraint

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347107#comment-16347107 ] Hudson commented on YARN-7682: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7784) Fix Cluster metrics when placement processor is enabled

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347122#comment-16347122 ] Hudson commented on YARN-7784: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7763) Allow Constraints specified in the SchedulingRequest to override application level constraints

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347115#comment-16347115 ] Hudson commented on YARN-7763: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7669) API and interface modifications for placement constraint processor

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347102#comment-16347102 ] Hudson commented on YARN-7669: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7779) Display allocation tags in RM web UI and expose same through REST API

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347117#comment-16347117 ] Hudson commented on YARN-7779: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7681) Double-check placement constraints in scheduling phase before actual allocation is made

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347108#comment-16347108 ] Hudson commented on YARN-7681: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7709) Remove SELF from TargetExpression type

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347111#comment-16347111 ] Hudson commented on YARN-7709: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-6595) [API] Add Placement Constraints at the application level

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347098#comment-16347098 ] Hudson commented on YARN-6595: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7696) Add container tags to ContainerTokenIdentifier, api.Container and NMContainerStatus to handle all recovery cases

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347109#comment-16347109 ] Hudson commented on YARN-7696: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7795) Fix jenkins issues of YARN-6592 branch

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347120#comment-16347120 ] Hudson commented on YARN-7795: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-6599) Support anti-affinity constraint via AppPlacementAllocator

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347112#comment-16347112 ] Hudson commented on YARN-6599: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7653) Rack cardinality support for AllocationTagsManager

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347103#comment-16347103 ] Hudson commented on YARN-7653: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7783) Add validation step to ensure constraints are not violated due to order in which a request is processed

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347118#comment-16347118 ] Hudson commented on YARN-7783: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-6592) Rich placement constraints in YARN

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347121#comment-16347121 ] Hudson commented on YARN-6592: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7670) Modifications to the ResourceScheduler to support SchedulingRequests

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347101#comment-16347101 ] Hudson commented on YARN-7670: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7522) Introduce AllocationTagsManager to associate allocation tags to nodes

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347100#comment-16347100 ] Hudson commented on YARN-7522: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7612) Add Processor Framework for Rich Placement Constraints

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347105#comment-16347105 ] Hudson commented on YARN-7612: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-6619) AMRMClient Changes to use the PlacementConstraint and SchcedulingRequest objects

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347110#comment-16347110 ] Hudson commented on YARN-6619: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347097#comment-16347097 ] Hudson commented on YARN-6594: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-6597) Add RMContainer recovery test to verify tag population in the AllocationTagsManager

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347123#comment-16347123 ] Hudson commented on YARN-6597: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7613) Implement Basic algorithm for constraint based placement

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347106#comment-16347106 ] Hudson commented on YARN-7613: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-6596) Introduce Placement Constraint Manager module

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347104#comment-16347104 ] Hudson commented on YARN-6596: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7774) Miscellaneous fixes to the PlacementProcessor

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347114#comment-16347114 ] Hudson commented on YARN-7774: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-7807) Assume intra-app anti-affinity as default for scheduling request inside AppPlacementAllocator

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347119#comment-16347119 ] Hudson commented on YARN-7807: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13589 (See

[jira] [Commented] (YARN-3153) Capacity Scheduler max AM resource limit for queues is defined as percentage but used as ratio

2018-01-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347144#comment-16347144 ] Manikandan R commented on YARN-3153: [~leftnoteasy] [~sunilg] I am interested in working on this. I

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-01-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347209#comment-16347209 ] Eric Payne commented on YARN-4606: -- Thanks everyone for the thoughtful analysis. I am still analyzing in

  1   2   3   >