[jira] [Commented] (YARN-6336) Jenkins report YARN new UI build failure

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925566#comment-15925566 ] Hadoop QA commented on YARN-6336: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925554#comment-15925554 ] Akira Ajisaka commented on YARN-6288: - Thanks [~haibochen] for the review. Hi [~dan...@cloudera.com],

[jira] [Updated] (YARN-6336) Jenkins report YARN new UI build failure

2017-03-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6336: -- Attachment: YARN-6336.0001.patch It seems an underlying dependency change happened in ember and yarn-ui was

[jira] [Assigned] (YARN-6336) Jenkins report YARN new UI build failure

2017-03-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-6336: - Assignee: Sunil G > Jenkins report YARN new UI build failure > -

[jira] [Commented] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby.

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925511#comment-15925511 ] Hadoop QA commented on YARN-6334: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6336) Jenkins report YARN new UI build failure

2017-03-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925500#comment-15925500 ] Sunil G commented on YARN-6336: --- I ll analyze and update fix ASAP. > Jenkins report YARN new UI build

[jira] [Updated] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby.

2017-03-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6334: --- Attachment: YARN-6334.003.patch Uploaded patch v3 for the style issue. > TestRMFailover#testAutomaticFailover

[jira] [Commented] (YARN-6336) Jenkins report YARN new UI build failure

2017-03-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925452#comment-15925452 ] Chris Douglas commented on YARN-6336: - Also HDFS-6984 > Jenkins report YARN new UI build failure >

[jira] [Commented] (YARN-6265) yarn.resourcemanager.fail-fast is used inconsistently

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925434#comment-15925434 ] Hadoop QA commented on YARN-6265: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6319) race condition between deleting app dir and deleting container dir

2017-03-14 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925421#comment-15925421 ] Hong Zhiguo commented on YARN-6319: --- [~haibochen], thanks for your comments. I found solution 1 may need

[jira] [Commented] (YARN-6265) yarn.resourcemanager.fail-fast is used inconsistently

2017-03-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925400#comment-15925400 ] Yuanbo Liu commented on YARN-6265: -- [~djp] Thanks > yarn.resourcemanager.fail-fast is used inconsistently

[jira] [Commented] (YARN-6265) yarn.resourcemanager.fail-fast is used inconsistently

2017-03-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925381#comment-15925381 ] Junping Du commented on YARN-6265: -- bq. Does jenkins have any issue? Hi [~yuanbo], it could be. I just

[jira] [Commented] (YARN-6339) Improve performance for createAndGetApplicationReport

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925379#comment-15925379 ] Hadoop QA commented on YARN-6339: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6265) yarn.resourcemanager.fail-fast is used inconsistently

2017-03-14 Thread Yuanbo Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925368#comment-15925368 ] Yuanbo Liu commented on YARN-6265: -- [~templedf] / [~djp] Does jenkins have any issue? I submitted the

[jira] [Commented] (YARN-6246) Identifying starved apps does not need the scheduler writelock

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925363#comment-15925363 ] Hadoop QA commented on YARN-6246: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby.

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925356#comment-15925356 ] Hadoop QA commented on YARN-6334: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925352#comment-15925352 ] Hadoop QA commented on YARN-5952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-03-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925298#comment-15925298 ] Robert Kanter commented on YARN-6050: - Build issues are due to YARN-6336. Will have to rerun after

[jira] [Updated] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby.

2017-03-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6334: --- Attachment: YARN-6334.002.patch > TestRMFailover#testAutomaticFailover always passes even RM didn't transition

[jira] [Commented] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby.

2017-03-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925297#comment-15925297 ] Yufei Gu commented on YARN-6334: Thanks [~haibochen] for the review. Uploaded patch v2 for your comment. >

[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications

2017-03-14 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925292#comment-15925292 ] yunjiong zhao commented on YARN-6285: - On one of our cluster GetApplicationsAvgTime looks very bad:

[jira] [Updated] (YARN-6246) Identifying starved apps does not need the scheduler writelock

2017-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-6246: --- Attachment: YARN-6246.002.patch > Identifying starved apps does not need the scheduler

[jira] [Commented] (YARN-5369) Improve Yarn logs command to get container logs based on Node Id

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925261#comment-15925261 ] Hadoop QA commented on YARN-5369: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6285) Add option to set max limit on ResourceManager for ApplicationClientProtocol.getApplications

2017-03-14 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925255#comment-15925255 ] yunjiong zhao commented on YARN-6285: - I created another issue

[jira] [Updated] (YARN-6339) Improve performance for createAndGetApplicationReport

2017-03-14 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yunjiong zhao updated YARN-6339: Attachment: YARN-6339.001.patch This patch have 3 improvements: 1. Use substring instead of replace

[jira] [Commented] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925247#comment-15925247 ] Hadoop QA commented on YARN-6050: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925240#comment-15925240 ] Hadoop QA commented on YARN-5952: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6331) Fix flakiness in TestFairScheduler#testDumpState

2017-03-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925237#comment-15925237 ] Yufei Gu commented on YARN-6331: Thanks [~rchiang] for the review and commit. > Fix flakiness in

[jira] [Created] (YARN-6339) Improve performance for createAndGetApplicationReport

2017-03-14 Thread yunjiong zhao (JIRA)
yunjiong zhao created YARN-6339: --- Summary: Improve performance for createAndGetApplicationReport Key: YARN-6339 URL: https://issues.apache.org/jira/browse/YARN-6339 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5369) Improve Yarn logs command to get container logs based on Node Id

2017-03-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925193#comment-15925193 ] Junping Du commented on YARN-5369: -- Hi [~xgong], sorry for coming late on this. Do we still need this

[jira] [Commented] (YARN-6332) Make RegistrySecurity use short user names for ZK ACLs

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925180#comment-15925180 ] Hadoop QA commented on YARN-6332: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6331) Fix flakiness in TestFairScheduler#testDumpState

2017-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925171#comment-15925171 ] Hudson commented on YARN-6331: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11404 (See

[jira] [Commented] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-03-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925167#comment-15925167 ] Jonathan Hung commented on YARN-5952: - 004 should fix the related unit test failures. > Create REST

[jira] [Commented] (YARN-6319) race condition between deleting app dir and deleting container dir

2017-03-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925161#comment-15925161 ] Haibo Chen commented on YARN-6319: -- Thanks [~zhiguohong] for the analysis! This seems an important issue

[jira] [Commented] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

2017-03-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925152#comment-15925152 ] Jason Lowe commented on YARN-6315: -- Thanks for the patch! Looks good overall, just some minor nits:

[jira] [Commented] (YARN-6331) Fix flakiness in TestFairScheduler#testDumpState

2017-03-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925141#comment-15925141 ] Yufei Gu commented on YARN-6331: Thanks [~rchiang]. Don't need to commit this to branch2 since I have

[jira] [Updated] (YARN-6332) Make RegistrySecurity use short user names for ZK ACLs

2017-03-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6332: - Attachment: YARN-6332.001.patch > Make RegistrySecurity use short user names for ZK ACLs >

[jira] [Updated] (YARN-5952) Create REST API for changing YARN scheduler configurations

2017-03-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5952: Attachment: YARN-5952-YARN-5734.004.patch > Create REST API for changing YARN scheduler

[jira] [Commented] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby.

2017-03-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925133#comment-15925133 ] Haibo Chen commented on YARN-6334: -- Thanks for the fix, [~yufeigu]! Can we extract a new method that does

[jira] [Commented] (YARN-6331) Fix flakiness in TestFairScheduler#testDumpState

2017-03-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925110#comment-15925110 ] Ray Chiang commented on YARN-6331: -- Looks good to me [~yufeigu]. +1. Will commit soon. > Fix flakiness

[jira] [Commented] (YARN-6042) Dump scheduler and queue state information into FairScheduler DEBUG log

2017-03-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925090#comment-15925090 ] Yufei Gu commented on YARN-6042: Thanks [~rchiang] for the commit. > Dump scheduler and queue state

[jira] [Updated] (YARN-6042) Dump scheduler and queue state information into FairScheduler DEBUG log

2017-03-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-6042: - Fix Version/s: (was: 3.0.0-alpha3) 2.9.0 Pushed to branch-2. Updated version to

[jira] [Updated] (YARN-6331) Fix flakiness in TestFairScheduler#testDumpState

2017-03-14 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-6331: - Summary: Fix flakiness in TestFairScheduler#testDumpState (was: Potential flakiness in

[jira] [Commented] (YARN-6294) ATS client should better handle Socket closed case

2017-03-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925057#comment-15925057 ] Junping Du commented on YARN-6294: -- +1. Will commit it shortly. > ATS client should better handle Socket

[jira] [Commented] (YARN-6336) Jenkins report YARN new UI build failure

2017-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925042#comment-15925042 ] Wangda Tan commented on YARN-6336: -- Will look into the issue. > Jenkins report YARN new UI build failure

[jira] [Created] (YARN-6338) Typos in Docker docs: contains => containers

2017-03-14 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6338: -- Summary: Typos in Docker docs: contains => containers Key: YARN-6338 URL: https://issues.apache.org/jira/browse/YARN-6338 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925029#comment-15925029 ] Wangda Tan commented on YARN-5892: -- bq. My reasoning is that UsersManager#addUser always retrieves a fresh

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-03-14 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925012#comment-15925012 ] Eric Payne commented on YARN-5892: -- Thanks a lot, [~leftnoteasy], for your comments. bq. 1) Can this patch

[jira] [Created] (YARN-6337) Docker docs incorrectly specify the group for the container-executor

2017-03-14 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6337: -- Summary: Docker docs incorrectly specify the group for the container-executor Key: YARN-6337 URL: https://issues.apache.org/jira/browse/YARN-6337 Project: Hadoop

[jira] [Commented] (YARN-6326) Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925002#comment-15925002 ] Hadoop QA commented on YARN-6326: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6336) Jenkins report YARN new UI build failure

2017-03-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924982#comment-15924982 ] Yufei Gu commented on YARN-6336: Also spotted in YARN-6326. > Jenkins report YARN new UI build failure >

[jira] [Commented] (YARN-6325) ParentQueue and LeafQueue with same name can cause queue name based operations to fail

2017-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924965#comment-15924965 ] Wangda Tan commented on YARN-6325: -- [~jlowe] thanks for jumping in. I agree that client operations

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2017-03-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924953#comment-15924953 ] Eric Badger commented on YARN-4266: --- [~tangzhankun], would you like to put up an updated version of your

[jira] [Commented] (YARN-6325) ParentQueue and LeafQueue with same name can cause queue name based operations to fail

2017-03-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924952#comment-15924952 ] Jason Lowe commented on YARN-6325: -- I don't have the full backstory on queue name requirements, but I

[jira] [Commented] (YARN-4236) Metric for aggregated resources allocation per queue

2017-03-14 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924945#comment-15924945 ] Eric Badger commented on YARN-4236: --- Hey [~lichangleo], looks like [~jlowe] found a small issue with the

[jira] [Commented] (YARN-6327) Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator

2017-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924938#comment-15924938 ] Hudson commented on YARN-6327: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11402 (See

[jira] [Commented] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is still running

2017-03-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924939#comment-15924939 ] Hudson commented on YARN-6313: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11402 (See

[jira] [Commented] (YARN-6327) Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator

2017-03-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924937#comment-15924937 ] Jonathan Hung commented on YARN-6327: - Thanks [~Naganarasimha]! > Removing queues from

[jira] [Commented] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is still running

2017-03-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924896#comment-15924896 ] Junping Du commented on YARN-6313: -- Filed YARN-6336 to address YARN new UI build failure. I have commit

[jira] [Updated] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is still running

2017-03-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6313: - Fix Version/s: 3.0.0-alpha3 > yarn logs cli should provide logs for a completed container even when >

[jira] [Updated] (YARN-6314) Potential infinite redirection on YARN log redirection web service

2017-03-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-6314: - Fix Version/s: 3.0.0-alpha3 > Potential infinite redirection on YARN log redirection web service >

[jira] [Commented] (YARN-6336) Jenkins report YARN new UI build failure

2017-03-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924892#comment-15924892 ] Junping Du commented on YARN-6336: -- cc [~leftnoteasy], [~sunilg]. > Jenkins report YARN new UI build

[jira] [Comment Edited] (YARN-6327) Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator

2017-03-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924885#comment-15924885 ] Naganarasimha G R edited comment on YARN-6327 at 3/14/17 8:02 PM: -- Thanks

[jira] [Created] (YARN-6336) Jenkins report YARN new UI build failure

2017-03-14 Thread Junping Du (JIRA)
Junping Du created YARN-6336: Summary: Jenkins report YARN new UI build failure Key: YARN-6336 URL: https://issues.apache.org/jira/browse/YARN-6336 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-5674) FairScheduler handles "dots" in user names inconsistently in the config

2017-03-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-5674: --- Target Version/s: 3.0.0-alpha3 > FairScheduler handles "dots" in user names inconsistently in

[jira] [Commented] (YARN-6327) Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator

2017-03-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924885#comment-15924885 ] Naganarasimha G R commented on YARN-6327: - Thanks [~jhung] > Removing queues from

[jira] [Commented] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is still running

2017-03-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924881#comment-15924881 ] Junping Du commented on YARN-6313: -- After checking from log, it seems build failure on UI is not related:

[jira] [Updated] (YARN-6050) AMs can't be scheduled on racks or nodes

2017-03-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-6050: Attachment: YARN-6050.011.patch The 011 patch: - rebases on latest trunk - uses concurrent sets in

[jira] [Created] (YARN-6335) Port slider's groovy unit tests to yarn native services

2017-03-14 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-6335: Summary: Port slider's groovy unit tests to yarn native services Key: YARN-6335 URL: https://issues.apache.org/jira/browse/YARN-6335 Project: Hadoop YARN

[jira] [Commented] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby.

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924830#comment-15924830 ] Hadoop QA commented on YARN-6334: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-3884) App History status not updated when RMContainer transitions from RESERVED to KILLED

2017-03-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924805#comment-15924805 ] Varun Saxena edited comment on YARN-3884 at 3/14/17 7:05 PM: - bq. If only

[jira] [Commented] (YARN-3884) App History status not updated when RMContainer transitions from RESERVED to KILLED

2017-03-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924805#comment-15924805 ] Varun Saxena commented on YARN-3884: bq. If only nodemanagers are reporting then allocations that are

[jira] [Commented] (YARN-6326) Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924798#comment-15924798 ] Hadoop QA commented on YARN-6326: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby.

2017-03-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6334: --- Description: Due to a bug in {{while}} loop. {code} int maxWaitingAttempts = 2000; while

[jira] [Updated] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby.

2017-03-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6334: --- Attachment: YARN-6334.001.patch > TestRMFailover#testAutomaticFailover always passes even RM didn't transition

[jira] [Created] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby.

2017-03-14 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6334: -- Summary: TestRMFailover#testAutomaticFailover always passes even RM didn't transition to Standby. Key: YARN-6334 URL: https://issues.apache.org/jira/browse/YARN-6334 Project:

[jira] [Commented] (YARN-6325) ParentQueue and LeafQueue with same name can cause queue name based operations to fail

2017-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924745#comment-15924745 ] Wangda Tan commented on YARN-6325: -- Thanks [~jhung], Actually this is added since a very early patch,

[jira] [Commented] (YARN-6313) yarn logs cli should provide logs for a completed container even when application is still running

2017-03-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924734#comment-15924734 ] Junping Du commented on YARN-6313: -- I can build locally too. But Jenkins keep saying build failure which

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-03-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924727#comment-15924727 ] Wangda Tan commented on YARN-5892: -- Thanks [~eepayne] for updating the patch, haven't looked into details

[jira] [Created] (YARN-6333) Improve doc for minSharePreemptionTimeout, fairSharePreemptionTimeout and fairSharePreemptionThreshold

2017-03-14 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6333: -- Summary: Improve doc for minSharePreemptionTimeout, fairSharePreemptionTimeout and fairSharePreemptionThreshold Key: YARN-6333 URL: https://issues.apache.org/jira/browse/YARN-6333

[jira] [Commented] (YARN-6327) Removing queues from CapacitySchedulerQueueManager and ParentQueue should be done with iterator

2017-03-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924701#comment-15924701 ] Naganarasimha G R commented on YARN-6327: - Thanks for the clarification ! My Bad i was wrong

[jira] [Updated] (YARN-6298) Metric preemptCall is not used in new preemption.

2017-03-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6298: --- Labels: newbie (was: ) > Metric preemptCall is not used in new preemption. >

[jira] [Commented] (YARN-3884) App History status not updated when RMContainer transitions from RESERVED to KILLED

2017-03-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924637#comment-15924637 ] Jason Lowe commented on YARN-3884: -- If only nodemanagers are reporting then allocations that are never

[jira] [Commented] (YARN-3884) App History status not updated when RMContainer transitions from RESERVED to KILLED

2017-03-14 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924601#comment-15924601 ] Joep Rottinghuis commented on YARN-3884: Since nodemanagers report the container allocations (and

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924588#comment-15924588 ] Hadoop QA commented on YARN-2113: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6332) Make RegistrySecurity use short user names for ZK ACLs

2017-03-14 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-6332: Summary: Make RegistrySecurity use short user names for ZK ACLs Key: YARN-6332 URL: https://issues.apache.org/jira/browse/YARN-6332 Project: Hadoop YARN

[jira] [Commented] (YARN-6279) Scheduler rest api JSON is not providing all child queues names

2017-03-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924533#comment-15924533 ] Haibo Chen commented on YARN-6279: -- Agree with [~GergelyNovak]'s observation. > Scheduler rest api JSON

[jira] [Commented] (YARN-6288) Refactor AppLogAggregatorImpl#uploadLogsForContainers

2017-03-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924506#comment-15924506 ] Haibo Chen commented on YARN-6288: -- The latest patch LGTM. +1 non-binding. > Refactor

[jira] [Assigned] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-03-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-2113: - Assignee: Sunil G (was: Vinod Kumar Vavilapalli) > Add cross-user preemption within CapacityScheduler's

[jira] [Commented] (YARN-6262) org.apache.hadoop.security.Groups should include YARN in the privacy scope

2017-03-14 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924317#comment-15924317 ] Daniel Templeton commented on YARN-6262: LGTM. I'll verify it and commit when I get a chance,

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924299#comment-15924299 ] Hadoop QA commented on YARN-6280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-03-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924263#comment-15924263 ] Hadoop QA commented on YARN-6280: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-03-14 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924166#comment-15924166 ] Ayappan edited comment on YARN-6141 at 3/14/17 1:36 PM: The predefined macros

[jira] [Comment Edited] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-03-14 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924166#comment-15924166 ] Ayappan edited comment on YARN-6141 at 3/14/17 1:34 PM: The predefined macros

[jira] [Comment Edited] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-03-14 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924166#comment-15924166 ] Ayappan edited comment on YARN-6141 at 3/14/17 1:31 PM: The predefined macros

[jira] [Commented] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-03-14 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924166#comment-15924166 ] Ayappan commented on YARN-6141: --- The predefined macros "__linux" and "linux' are not POSIX-compliant (neither

[jira] [Assigned] (YARN-6262) org.apache.hadoop.security.Groups should include YARN in the privacy scope

2017-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák reassigned YARN-6262: --- Assignee: Gergely Novák > org.apache.hadoop.security.Groups should include YARN in the

[jira] [Updated] (YARN-6262) org.apache.hadoop.security.Groups should include YARN in the privacy scope

2017-03-14 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-6262: Attachment: YARN-6262.001.patch Uploaded a trivial patch for this. >

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-03-14 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924142#comment-15924142 ] Lantao Jin commented on YARN-6280: -- Hi [~sunilg], I've updated the parameter with {{hideResourceRequest}}

[jira] [Updated] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-03-14 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lantao Jin updated YARN-6280: - Attachment: YARN-6280.004.patch > Add a query parameter in ResourceManager Cluster Applications REST API

  1   2   >