[jira] [Commented] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104492#comment-16104492 ] Yufei Gu commented on YARN-6802: Thank [~daemon] for working on this. The patch looks good to me generally.

[jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed

2017-07-27 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104478#comment-16104478 ] Manikandan R commented on YARN-65: -- Based on earlier suggestions, made changes to free memory by clearing

[jira] [Updated] (YARN-65) Reduce RM app memory footprint once app has completed

2017-07-27 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-65: - Attachment: YARN-65.001.patch > Reduce RM app memory footprint once app has completed >

[jira] [Updated] (YARN-6898) RM node labels page should display total used resources of each label.

2017-07-27 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6898: -- Description: The RM node labels page only show *Label Name*、*Label Type*、*Num Of Active NMs*、*Total

[jira] [Updated] (YARN-6898) RM node labels page should display total used resources of each label.

2017-07-27 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6898: -- Description: The RM node labels page only show *Label Name*、*Label Type*、*Num Of Active NMs*、*Total

[jira] [Updated] (YARN-6898) RM node labels page should display total used resources of each label.

2017-07-27 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6898: -- Summary: RM node labels page should display total used resources of each label. (was: RM node labels

[jira] [Created] (YARN-6898) RM node labels page show display total used resources of each label.

2017-07-27 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-6898: - Summary: RM node labels page show display total used resources of each label. Key: YARN-6898 URL: https://issues.apache.org/jira/browse/YARN-6898 Project: Hadoop YARN

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104341#comment-16104341 ] Hadoop QA commented on YARN-6593: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104304#comment-16104304 ] Sunil G commented on YARN-5892: --- I will help to commit the same to branch-2.8. Jenkins seems fine and test

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-07-27 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104294#comment-16104294 ] Eric Payne commented on YARN-5892: -- Thanks [~sunilg] for all your help on this JIRA. Were you planning on

[jira] [Updated] (YARN-6698) Backport YARN-5121 to branch-2.7

2017-07-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated YARN-6698: -- Fix Version/s: (was: 2.7.4) > Backport YARN-5121 to branch-2.7 >

[jira] [Created] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-27 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-6897: -- Summary: Refactoring RMWebServices by moving some util methods in RMWebAppUtil Key: YARN-6897 URL: https://issues.apache.org/jira/browse/YARN-6897

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-27 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104264#comment-16104264 ] Konstantinos Karanasos commented on YARN-6593: -- Thanks [~leftnoteasy] -- I addressed your

[jira] [Updated] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-27 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-6593: - Attachment: YARN-6593.007.patch Adding new version to address latest comments from

[jira] [Commented] (YARN-3477) TimelineClientImpl swallows exceptions

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104253#comment-16104253 ] Hadoop QA commented on YARN-3477: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6864) FSPreemptionThread cleanup for readability

2017-07-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104250#comment-16104250 ] Yufei Gu commented on YARN-6864: +1 > FSPreemptionThread cleanup for readability >

[jira] [Commented] (YARN-6893) Fix Missing Memory and CPU Metric in WebUI v2 Flow Activity Tab

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104160#comment-16104160 ] Hadoop QA commented on YARN-6893: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6893) Fix Missing Memory and CPU Metric in WebUI v2 Flow Activity Tab

2017-07-27 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-6893: --- Attachment: YARN-6893.001.patch > Fix Missing Memory and CPU Metric in WebUI v2 Flow Activity

[jira] [Created] (YARN-6896) Federation: routing REST invocations transparently to multiple RMs

2017-07-27 Thread Giovanni Matteo Fumarola (JIRA)
Giovanni Matteo Fumarola created YARN-6896: -- Summary: Federation: routing REST invocations transparently to multiple RMs Key: YARN-6896 URL: https://issues.apache.org/jira/browse/YARN-6896

[jira] [Updated] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-27 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6853: --- Attachment: YARN-6853.proto.patch > Add MySql Scripts for FederationStateStore

[jira] [Commented] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104049#comment-16104049 ] Vrushali C commented on YARN-6734: -- I looked over the patch. LGTM over all. Thanks for updating the api

[jira] [Assigned] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-27 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reassigned YARN-6853: -- Assignee: Giovanni Matteo Fumarola > Add MySql Scripts for

[jira] [Commented] (YARN-3254) HealthReport should include disk full information

2017-07-27 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103993#comment-16103993 ] Suma Shivaprasad commented on YARN-3254: Thanks [~sunilg] Will update patch to address comments. >

[jira] [Comment Edited] (YARN-6594) [API] Introduce SchedulingRequest object

2017-07-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103986#comment-16103986 ] Arun Suresh edited comment on YARN-6594 at 7/27/17 10:01 PM: - Given that

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-07-27 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103986#comment-16103986 ] Arun Suresh commented on YARN-6594: --- Given that YARN-6593 looks close to committing, Think we should move

[jira] [Commented] (YARN-6875) New aggregated log file format for YARN log aggregation.

2017-07-27 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103982#comment-16103982 ] Robert Kanter commented on YARN-6875: - [~xgong], have you taken a look at YARN-2942 and subtasks? I

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-27 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103963#comment-16103963 ] Wangda Tan commented on YARN-6593: -- Thanks [~kkaranasos] for updating the patch, could you check the

[jira] [Commented] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-27 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103955#comment-16103955 ] Carlo Curino commented on YARN-5412: Thanks [~giovanni.fumarola] for the large code contribution. The

[jira] [Resolved] (YARN-6793) Duplicated reservation in Fair Scheduler preemption

2017-07-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-6793. Resolution: Duplicate > Duplicated reservation in Fair Scheduler preemption >

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-27 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103863#comment-16103863 ] Jian He commented on YARN-6130: --- looks good to me, +1 > [ATSv2 Security] Generate a delegation token for AM

[jira] [Commented] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103861#comment-16103861 ] Hadoop QA commented on YARN-5412: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6612) Update fair scheduler policies to be aware of resource types

2017-07-27 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103856#comment-16103856 ] Yufei Gu commented on YARN-6612: Some major thoughts: # I prefer to put functionality of ResourceWeights

[jira] [Commented] (YARN-6890) If UI is not secured, we allow user to kill other users' job even yarn cluster is secured.

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103854#comment-16103854 ] Hadoop QA commented on YARN-6890: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6876) Create an abstract log writer for extendability

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103842#comment-16103842 ] Hadoop QA commented on YARN-6876: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103823#comment-16103823 ] Hadoop QA commented on YARN-6788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6895) Preemption reservation may cause regular reservation leaks

2017-07-27 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6895: Summary: Preemption reservation may cause regular reservation leaks Key: YARN-6895 URL: https://issues.apache.org/jira/browse/YARN-6895 Project: Hadoop YARN

[jira] [Commented] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-07-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103728#comment-16103728 ] Sunil G commented on YARN-5219: --- Thanks [~suma.shivaprasad] I will update patch based on the comments. >

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103724#comment-16103724 ] Varun Saxena commented on YARN-5548: Committed to trunk, branch-2. Thanks [~bibinchundatt] for your

[jira] [Commented] (YARN-5219) When an export var command fails in launch_container.sh, the full container launch should fail

2017-07-27 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103722#comment-16103722 ] Suma Shivaprasad commented on YARN-5219: 3. The sb.setExitOnFailure should be called outside of

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103717#comment-16103717 ] Hudson commented on YARN-5548: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12058 (See

[jira] [Updated] (YARN-6890) If UI is not secured, we allow user to kill other users' job even yarn cluster is secured.

2017-07-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6890: - Attachment: YARN-6890.patch The fix is straight-forward. > If UI is not secured, we allow user to kill

[jira] [Created] (YARN-6894) RM Apps API returns only active apps when query parameter queue used

2017-07-27 Thread Grant Sohn (JIRA)
Grant Sohn created YARN-6894: Summary: RM Apps API returns only active apps when query parameter queue used Key: YARN-6894 URL: https://issues.apache.org/jira/browse/YARN-6894 Project: Hadoop YARN

[jira] [Created] (YARN-6893) Fix Missing Memory and CPU Metric in WebUI v2 Flow Activity Tab

2017-07-27 Thread Abdullah Yousufi (JIRA)
Abdullah Yousufi created YARN-6893: -- Summary: Fix Missing Memory and CPU Metric in WebUI v2 Flow Activity Tab Key: YARN-6893 URL: https://issues.apache.org/jira/browse/YARN-6893 Project: Hadoop YARN

[jira] [Updated] (YARN-6892) Improve API implementation in Resources and DominantResourceCalculator in align to ResourceInformation

2017-07-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6892: -- Attachment: YARN-6892-YARN-3926.001.patch Attaching an initial version of patch. This work is done based on

[jira] [Created] (YARN-6892) Improve API implementation in Resources and DominantResourceCalculator in align to ResourceInformation

2017-07-27 Thread Sunil G (JIRA)
Sunil G created YARN-6892: - Summary: Improve API implementation in Resources and DominantResourceCalculator in align to ResourceInformation Key: YARN-6892 URL: https://issues.apache.org/jira/browse/YARN-6892

[jira] [Commented] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-27 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103677#comment-16103677 ] Giovanni Matteo Fumarola commented on YARN-5412: Fixed the remaining 2 yetus warnings in

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103675#comment-16103675 ] Varun Saxena commented on YARN-5548: Had missed to push the newly added file. So made another commit to

[jira] [Updated] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2017-07-27 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-5412: --- Attachment: YARN-5412-YARN-2915.7.patch > Create a proxy chain for

[jira] [Updated] (YARN-6890) If UI is not secured, we allow user to kill other users' job even yarn cluster is secured.

2017-07-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6890: - Target Version/s: 3.0.0-beta1, 2.8.2 (was: 2.8.2) > If UI is not secured, we allow user to kill other

[jira] [Resolved] (YARN-6891) Can kill other user's applications via RM UI

2017-07-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-6891. -- Resolution: Duplicate > Can kill other user's applications via RM UI >

[jira] [Created] (YARN-6891) Can kill other user's applications via RM UI

2017-07-27 Thread Sumana Sathish (JIRA)
Sumana Sathish created YARN-6891: Summary: Can kill other user's applications via RM UI Key: YARN-6891 URL: https://issues.apache.org/jira/browse/YARN-6891 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-27 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103611#comment-16103611 ] Hudson commented on YARN-5548: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #12057 (See

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103603#comment-16103603 ] Varun Saxena commented on YARN-5548: Thanks [~bibinchundatt] for the patch. LGTM. Will commit it

[jira] [Created] (YARN-6890) If UI is not secured, we allow user to kill other users' job even yarn cluster is secured.

2017-07-27 Thread Junping Du (JIRA)
Junping Du created YARN-6890: Summary: If UI is not secured, we allow user to kill other users' job even yarn cluster is secured. Key: YARN-6890 URL: https://issues.apache.org/jira/browse/YARN-6890

[jira] [Commented] (YARN-6889) The throughput of timeline server is too small

2017-07-27 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103517#comment-16103517 ] Ravi Prakash commented on YARN-6889: Also, it would be good if you can publish your methodology and

[jira] [Resolved] (YARN-6889) The throughput of timeline server is too small

2017-07-27 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved YARN-6889. Resolution: Duplicate > The throughput of timeline server is too small >

[jira] [Commented] (YARN-6889) The throughput of timeline server is too small

2017-07-27 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103515#comment-16103515 ] Ravi Prakash commented on YARN-6889: Which version are you using? Are you aware of

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.015.patch Fixed test cases and improved FixedResource as per suggestion Daniel

[jira] [Updated] (YARN-6889) The throughput of timeline server is too small

2017-07-27 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6889: -- Description: Recent large-scale pressure test single timeline server, and I found the throughput of

[jira] [Updated] (YARN-6889) The throughput of timeline server is too small

2017-07-27 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6889: -- Priority: Critical (was: Major) > The throughput of timeline server is too small >

[jira] [Updated] (YARN-6889) The throughput of timeline server is too small

2017-07-27 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6889: -- Description: Recent large-scale pressure test timeline server, and I found the > The throughput of

[jira] [Created] (YARN-6889) The throughput of timeline server is too small

2017-07-27 Thread YunFan Zhou (JIRA)
YunFan Zhou created YARN-6889: - Summary: The throughput of timeline server is too small Key: YARN-6889 URL: https://issues.apache.org/jira/browse/YARN-6889 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103372#comment-16103372 ] Hadoop QA commented on YARN-5548: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6875) New aggregated log file format for YARN log aggregation.

2017-07-27 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103346#comment-16103346 ] Jason Lowe commented on YARN-6875: -- Thanks for posting the doc! I'm not a big fan of having a separate

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-27 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103338#comment-16103338 ] YunFan Zhou commented on YARN-6842: --- [~sunilg] [~templedf] [~bibinchundatt] Could you please review my

[jira] [Commented] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-27 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103335#comment-16103335 ] YunFan Zhou commented on YARN-6802: --- [~yufeigu] Hi, YuFei, could you please review my code? > Support

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103250#comment-16103250 ] Hadoop QA commented on YARN-6788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-27 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103213#comment-16103213 ] Bibin A Chundatt edited comment on YARN-5548 at 7/27/17 1:37 PM: - Test

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-27 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103213#comment-16103213 ] Bibin A Chundatt commented on YARN-5548: Test failures in no related to patch attached > Use

[jira] [Commented] (YARN-6861) Reader API for sub application entities

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103125#comment-16103125 ] Hadoop QA commented on YARN-6861: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6762) ChildQueue can override AbstractCSQueue.hasChildQueues to return false always

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103121#comment-16103121 ] Hadoop QA commented on YARN-6762: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6494) add mounting of HDFS Short-Circuit path for docker containers

2017-07-27 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103113#comment-16103113 ] Shane Kumpf commented on YARN-6494: --- Thanks for the patch [~Jaeboo]! I do have a concern as this

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.014.patch Thanks [~templedf] Updating new patch based on your comments. There

[jira] [Commented] (YARN-6861) Reader API for sub application entities

2017-07-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103083#comment-16103083 ] Rohith Sharma K S commented on YARN-6861: - Call for initial review. cc :/ [~varun_saxena]

[jira] [Updated] (YARN-6861) Reader API for sub application entities

2017-07-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6861: Attachment: YARN-6861-YARN-5355.001.patch updating v0 patch for REST API to read from sub

[jira] [Assigned] (YARN-6762) ChildQueue can override AbstractCSQueue.hasChildQueues to return false always

2017-07-27 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-6762: --- Assignee: Naganarasimha G R > ChildQueue can override AbstractCSQueue.hasChildQueues

[jira] [Commented] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103054#comment-16103054 ] Hadoop QA commented on YARN-6872: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103007#comment-16103007 ] Hadoop QA commented on YARN-6734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-07-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16103000#comment-16103000 ] Rohith Sharma K S commented on YARN-6872: - Ahh I see. I submitted the patch for triggering Jenkins

[jira] [Commented] (YARN-6888) Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created

2017-07-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102986#comment-16102986 ] Rohith Sharma K S commented on YARN-6888: - +1 LGTM, will commit it later if no more objections >

[jira] [Commented] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-07-27 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102978#comment-16102978 ] Sunil G commented on YARN-6872: --- Thanks [~rohithsharma] When new container requests comes, its been

[jira] [Commented] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102977#comment-16102977 ] Hadoop QA commented on YARN-5548: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102968#comment-16102968 ] Rohith Sharma K S commented on YARN-6130: - cc :/ [~jianhe] would you take a look at last patch i.e

[jira] [Updated] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-27 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6734: Attachment: YARN-6734-YARN-5355.004.patch updated the patch with below delta changes #

[jira] [Commented] (YARN-5728) TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout

2017-07-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102897#comment-16102897 ] Akira Ajisaka commented on YARN-5728: - Hi [~rchiang], would you please review this? >

[jira] [Commented] (YARN-5728) TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102892#comment-16102892 ] Hadoop QA commented on YARN-5728: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5728) TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout

2017-07-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-5728: Attachment: YARN-5728.002.patch 002: fix grammar >

[jira] [Assigned] (YARN-5728) TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout

2017-07-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned YARN-5728: --- Assignee: Akira Ajisaka > TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization

[jira] [Updated] (YARN-5728) TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout

2017-07-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-5728: Attachment: YARN-5728.001.patch 01 patch: Set hostname to "localhost" for MiniYARNCluster RM if the

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-27 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102844#comment-16102844 ] Varun Saxena commented on YARN-6130: bq. token renewer is set to application owner. Is it intended?

[jira] [Commented] (YARN-6888) Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created

2017-07-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102829#comment-16102829 ] Hadoop QA commented on YARN-6888: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5548) Use MockRMMemoryStateStore to reduce test failures

2017-07-27 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-5548: --- Attachment: YARN-5548.0018.patch Attaching after checkstyle fix.

[jira] [Commented] (YARN-5728) TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout

2017-07-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102805#comment-16102805 ] Akira Ajisaka commented on YARN-5728: - Ran this test with some log levels raised. Probably this is the

[jira] [Updated] (YARN-6888) Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created

2017-07-27 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6888: - Attachment: YARN-6888-YARN-5355.0001.patch Attaching v001. Created subclass

[jira] [Created] (YARN-6888) Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created

2017-07-27 Thread Vrushali C (JIRA)
Vrushali C created YARN-6888: Summary: Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created Key: YARN-6888 URL: https://issues.apache.org/jira/browse/YARN-6888

[jira] [Commented] (YARN-5728) TestMiniYarnClusterNodeUtilization.testUpdateNodeUtilization timeout

2017-07-27 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102772#comment-16102772 ] Akira Ajisaka commented on YARN-5728: - I could reproduce this error locally by using Docker environment