[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256596#comment-16256596 ] Hadoop QA commented on YARN-7119: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256573#comment-16256573 ] Hudson commented on YARN-7430: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13252 (See

[jira] [Updated] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-16 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-7430: Summary: Enable user re-mapping for Docker containers by default (was: User and Group mapping are

[jira] [Commented] (YARN-5542) Scheduling of opportunistic containers

2017-11-16 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256544#comment-16256544 ] Weiwei Yang commented on YARN-5542: --- Hi [~kkaranasos], is this work still on-going? It seems there is no

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256526#comment-16256526 ] Hadoop QA commented on YARN-7337: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256514#comment-16256514 ] Arun Suresh commented on YARN-1015: --- +1, looks good. > FS should watch node resource utilization and

[jira] [Commented] (YARN-7004) Add configs cache to optimize refreshQueues performance for large scale of queues

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256515#comment-16256515 ] Hadoop QA commented on YARN-7004: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7003) DRAINING state of queues can't be recovered after RM restart

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256513#comment-16256513 ] Hadoop QA commented on YARN-7003: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7508) NPE in FiCaSchedulerApp when debug log enabled and try to commit outdated reserved proposal in async-scheduling mode

2017-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256506#comment-16256506 ] Bibin A Chundatt commented on YARN-7508: Thank you [~Tao Yang] for confirming the same. I plan to

[jira] [Created] (YARN-7526) Add --debug option for yarn service framework

2017-11-16 Thread Jian He (JIRA)
Jian He created YARN-7526: - Summary: Add --debug option for yarn service framework Key: YARN-7526 URL: https://issues.apache.org/jira/browse/YARN-7526 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7489) ConcurrentModificationException in RMAppImpl#getRMAppMetrics

2017-11-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256503#comment-16256503 ] Bibin A Chundatt commented on YARN-7489: Will commit patch today . >

[jira] [Comment Edited] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-16 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256488#comment-16256488 ] Manikandan R edited comment on YARN-7119 at 11/17/17 5:24 AM: -- [~templedf]

[jira] [Commented] (YARN-7471) queueUsagePercentage is wrongly calculated for applications in zero-capacity queues

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256502#comment-16256502 ] Hadoop QA commented on YARN-7471: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256498#comment-16256498 ] Hadoop QA commented on YARN-7509: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-16 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256488#comment-16256488 ] Manikandan R commented on YARN-7119: [~templedf] Thanks for detailed reviews. 1: Currently if there is

[jira] [Updated] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-16 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7119: --- Attachment: YARN-7119.007.patch > yarn rmadmin -updateNodeResource should be updated for resource

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256477#comment-16256477 ] Hadoop QA commented on YARN-7448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256478#comment-16256478 ] Ted Yu commented on YARN-7213: -- See HBASE-18368

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2017-11-16 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256472#comment-16256472 ] Manikandan R commented on YARN-6523: Attached patch based on our earlier discussions. Thanks

[jira] [Updated] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2017-11-16 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6523: --- Attachment: YARN-6523.001.patch > Newly retrieved security Tokens are sent as part of each heartbeat

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256470#comment-16256470 ] Haibo Chen commented on YARN-7213: -- cc [~varun_saxena] and [~vrushalic] on this issue. > [Umbrella] Test

[jira] [Updated] (YARN-7522) Add application tags manager implementation

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7522: - Attachment: YARN-7522.YARN-6592.wip-001.patch Attached wip implementation which included tracking and look

[jira] [Comment Edited] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256466#comment-16256466 ] Haibo Chen edited comment on YARN-7213 at 11/17/17 4:44 AM: [~openinx],

[jira] [Comment Edited] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256466#comment-16256466 ] Haibo Chen edited comment on YARN-7213 at 11/17/17 4:42 AM: [~openinx],

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256466#comment-16256466 ] Haibo Chen commented on YARN-7213: -- [~openinx], [~te...@apache.org] Here is a test that you can add to

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256462#comment-16256462 ] Hadoop QA commented on YARN-7461: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256449#comment-16256449 ] Hadoop QA commented on YARN-7525: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256435#comment-16256435 ] Hadoop QA commented on YARN-7448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: YARN-7448-YARN-6592.007.patch > [API] Add SchedulingRequest to the

[jira] [Updated] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

2017-11-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7525: --- Fix Version/s: (was: 2.9.1) (was: 3.0.0-alpha4) > Incorrect query parameters in

[jira] [Commented] (YARN-6486) FairScheduler: Deprecate continuous scheduling

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256419#comment-16256419 ] Hadoop QA commented on YARN-6486: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

2017-11-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7525: --- Attachment: YARN-7525.001.patch > Incorrect query parameters in cluster nodes REST API document >

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256416#comment-16256416 ] Zheng Hu commented on YARN-7213: Sorry for the delay. Well, when I open the

[jira] [Created] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

2017-11-16 Thread Tao Yang (JIRA)
Tao Yang created YARN-7525: -- Summary: Incorrect query parameters in cluster nodes REST API document Key: YARN-7525 URL: https://issues.apache.org/jira/browse/YARN-7525 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7524) Remove unused FairSchedulerEventLog

2017-11-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-7524: Attachment: YARN-7524.001.patch Patch to remove: - log init and writing the log -

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256375#comment-16256375 ] Hadoop QA commented on YARN-7448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7524) Remove unused FairSchedulerEventLog

2017-11-16 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-7524: --- Summary: Remove unused FairSchedulerEventLog Key: YARN-7524 URL: https://issues.apache.org/jira/browse/YARN-7524 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: YARN-7448-YARN-6592.006.patch > [API] Add SchedulingRequest to the

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: YARN-7448-YARN-6592.005.patch > [API] Add SchedulingRequest to the

[jira] [Created] (YARN-7523) Introduce description and version field in Service record

2017-11-16 Thread Gour Saha (JIRA)
Gour Saha created YARN-7523: --- Summary: Introduce description and version field in Service record Key: YARN-7523 URL: https://issues.apache.org/jira/browse/YARN-7523 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7508) NPE in FiCaSchedulerApp when debug log enabled and try to commit outdated reserved proposal in async-scheduling mode

2017-11-16 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256364#comment-16256364 ] Tao Yang commented on YARN-7508: Thanks [~sunilg] and [~bibinchundatt] for your review and comments. Other

[jira] [Commented] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256357#comment-16256357 ] Hadoop QA commented on YARN-6168: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256315#comment-16256315 ] Ted Yu commented on YARN-7213: -- Haibo: Time permitting, formulating simplified Filter test (independent of ATS

[jira] [Updated] (YARN-6486) FairScheduler: Deprecate continuous scheduling

2017-11-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-6486: Attachment: YARN-6486.003.patch oops, forgot one annotation to fix the javac

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256279#comment-16256279 ] Sunil G commented on YARN-7469: --- Yes. :) I missed 2.9. Will backport now. > Capacity Scheduler Intra-queue

[jira] [Commented] (YARN-7521) Add some misisng @VisibleForTesting annotations

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256272#comment-16256272 ] Hadoop QA commented on YARN-7521: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: YARN-7448-YARN-6592.004.patch > [API] Add SchedulingRequest to the

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256258#comment-16256258 ] Hadoop QA commented on YARN-7473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: (was: YARN-7448-YARN-6592.004.patch) > [API] Add SchedulingRequest

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: (was: YARN-7448-YARN-6592.005.patch) > [API] Add SchedulingRequest

[jira] [Commented] (YARN-7513) FindBugs in FSAppAttempt.getWeight()

2017-11-16 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256238#comment-16256238 ] Wilfred Spiegelenburg commented on YARN-7513: - Holding the scheduler lock to get the demand for

[jira] [Created] (YARN-7522) Add application tags manager implementation

2017-11-16 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-7522: Summary: Add application tags manager implementation Key: YARN-7522 URL: https://issues.apache.org/jira/browse/YARN-7522 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7274) Ability to disable elasticity at leaf queue level

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256195#comment-16256195 ] Wangda Tan commented on YARN-7274: -- [~asuresh], could you share your thoughts on this as well? > Ability

[jira] [Commented] (YARN-7460) Exclude findbugs warnings on SchedulerNode.numGuaranteedContainers and numOpportunisticContainers

2017-11-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256192#comment-16256192 ] Miklos Szegedi commented on YARN-7460: -- +1 (binding). Thank you, for the patch [~haibochen]. >

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256187#comment-16256187 ] Hadoop QA commented on YARN-7448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-6168: Attachment: YARN-6168.001.patch This patch includes addition of {{containersFromPreviousAttempt}} in

[jira] [Comment Edited] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-16 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256169#comment-16256169 ] Chandni Singh edited comment on YARN-6168 at 11/16/17 11:43 PM: The patch 1

[jira] [Updated] (YARN-7521) Add some misisng @VisibleForTesting annotations

2017-11-16 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-7521: - Attachment: YARN-7521.001.patch > Add some misisng @VisibleForTesting annotations >

[jira] [Updated] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-11-16 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7520: --- Description: Queue Ordering policy currently uses priority, utilization and absolute capacity

[jira] [Created] (YARN-7521) Add some misisng @VisibleForTesting annotations

2017-11-16 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-7521: Summary: Add some misisng @VisibleForTesting annotations Key: YARN-7521 URL: https://issues.apache.org/jira/browse/YARN-7521 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-11-16 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad reassigned YARN-7520: -- Assignee: Suma Shivaprasad > Queue Ordering policy changes for ordering auto created

[jira] [Created] (YARN-7520) Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues

2017-11-16 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-7520: -- Summary: Queue Ordering policy changes for ordering auto created leaf queues within Managed parent Queues Key: YARN-7520 URL: https://issues.apache.org/jira/browse/YARN-7520

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256151#comment-16256151 ] Eric Yang commented on YARN-5673: - It would be safer for container-executor to follow specific workflow,

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256141#comment-16256141 ] Haibo Chen commented on YARN-7213: -- [~te...@apache.org] Please hold your further investigation. Our

[jira] [Updated] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-16 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-7473: --- Attachment: YARN-7473.2.patch Added code changes for node label entitlement updates, fixed

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256115#comment-16256115 ] Eric Yang commented on YARN-7506: - IMO, Container-executor is essentially a light weight sudo with extra

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: YARN-7448-YARN-6592.005.patch > [API] Add SchedulingRequest to the

[jira] [Commented] (YARN-914) (Umbrella) Support graceful decommission of nodemanager

2017-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256106#comment-16256106 ] Junping Du commented on YARN-914: - Client side graceful decommission work has been done together with proper

[jira] [Created] (YARN-7519) Exception during RM shutdown - "No enum constant YarnApplicationAttemptState.FINAL_SAVING"

2017-11-16 Thread Gour Saha (JIRA)
Gour Saha created YARN-7519: --- Summary: Exception during RM shutdown - "No enum constant YarnApplicationAttemptState.FINAL_SAVING" Key: YARN-7519 URL: https://issues.apache.org/jira/browse/YARN-7519

[jira] [Commented] (YARN-7519) Exception during RM shutdown - "No enum constant YarnApplicationAttemptState.FINAL_SAVING"

2017-11-16 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256102#comment-16256102 ] Gour Saha commented on YARN-7519: - Not sure if it has anything to do with YARN-4587 > Exception during RM

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256093#comment-16256093 ] Junping Du commented on YARN-5464: -- I am working on a design doc for this, will upload for review soon. >

[jira] [Assigned] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-5464: Assignee: Junping Du > Server-Side NM Graceful Decommissioning with RM HA >

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256061#comment-16256061 ] ASF GitHub Bot commented on YARN-6483: -- Github user xslogic commented on a diff in the pull request:

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256057#comment-16256057 ] Hadoop QA commented on YARN-7330: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-16 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256051#comment-16256051 ] Vinod Kumar Vavilapalli commented on YARN-7506: --- This is either a dup or sub-task of

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256045#comment-16256045 ] ASF GitHub Bot commented on YARN-6483: -- Github user xslogic commented on a diff in the pull request:

[jira] [Updated] (YARN-7517) RegistryDNS does not work with secure ZooKeeper

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7517: Attachment: YARN-7517.001.patch Rebase Jian's code to trunk. > RegistryDNS does not work with secure

[jira] [Updated] (YARN-7517) RegistryDNS does not work with secure ZooKeeper

2017-11-16 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7517: Issue Type: Sub-task (was: Bug) Parent: YARN-7054 > RegistryDNS does not work with secure ZooKeeper

[jira] [Created] (YARN-7518) Node manager should allow resource units to be lower cased

2017-11-16 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7518: -- Summary: Node manager should allow resource units to be lower cased Key: YARN-7518 URL: https://issues.apache.org/jira/browse/YARN-7518 Project: Hadoop YARN

[jira] [Commented] (YARN-7517) RegistryDNS does not work with secure ZooKeeper

2017-11-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256033#comment-16256033 ] Junping Du commented on YARN-7517: -- CC [~jianhe], [~billie.rinaldi]. > RegistryDNS does not work with

[jira] [Created] (YARN-7517) RegistryDNS does not work with secure ZooKeeper

2017-11-16 Thread Eric Yang (JIRA)
Eric Yang created YARN-7517: --- Summary: RegistryDNS does not work with secure ZooKeeper Key: YARN-7517 URL: https://issues.apache.org/jira/browse/YARN-7517 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256012#comment-16256012 ] Hadoop QA commented on YARN-7438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255998#comment-16255998 ] Hadoop QA commented on YARN-7473: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255988#comment-16255988 ] Ted Yu commented on YARN-7213: -- Recently there were a lot of changes for Filters, starting from (trunk):

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-16 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255982#comment-16255982 ] Ted Yu commented on YARN-7213: -- I took a brief look at TestTimelineReaderWebServicesHBaseStorage.java which

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255978#comment-16255978 ] Hadoop QA commented on YARN-7448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255976#comment-16255976 ] Wangda Tan commented on YARN-7487: -- [~sunilg], could you help to review the patch? > Make sure volume

[jira] [Commented] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255970#comment-16255970 ] Hadoop QA commented on YARN-7487: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations

2017-11-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-7496: - Attachment: YARN-7496.001.branch-2.8.patch Attaching a fix for branch-2.8. This change is in

[jira] [Commented] (YARN-6486) FairScheduler: Deprecate continuous scheduling

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255913#comment-16255913 ] Hadoop QA commented on YARN-6486: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255901#comment-16255901 ] Konstantinos Karanasos commented on YARN-7448: -- Thank you guys for working on this. Please

[jira] [Commented] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-11-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255898#comment-16255898 ] Robert Kanter commented on YARN-4813: - If there's a system property for disabling the cache, I'd rather

[jira] [Commented] (YARN-7513) FindBugs in FSAppAttempt.getWeight()

2017-11-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255896#comment-16255896 ] Hadoop QA commented on YARN-7513: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255891#comment-16255891 ] Eric Payne commented on YARN-7469: -- Thank you very much [~sunilg]. Just one concern is that this fix

[jira] [Updated] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7487: - Attachment: YARN-7487.003.patch Attached ver.3 patch addressed cc warnings. > Make sure volume includes

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255885#comment-16255885 ] Wangda Tan commented on YARN-7448: -- Thanks [~pgaref] for working on this. In general patch looks good.

[jira] [Updated] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7438: - Attachment: YARN-7438.002.patch > Additional changes to make SchedulingPlacementSet agnostic to

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255878#comment-16255878 ] Wangda Tan commented on YARN-7438: -- [~sunilg], bq. lastPendingAsk and newPendingAsk seems a little

[jira] [Commented] (YARN-7419) CapacityScheduler: Allow auto leaf queue creation after queue mapping

2017-11-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255867#comment-16255867 ] Hudson commented on YARN-7419: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13249 (See

[jira] [Comment Edited] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-16 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255864#comment-16255864 ] Panagiotis Garefalakis edited comment on YARN-7448 at 11/16/17 7:50 PM:

  1   2   >