[jira] [Commented] (YARN-5150) [YARN-3368] Add a sunburst chart view for queues/applications resource usage to new YARN UI

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256872#comment-16256872 ] Hadoop QA commented on YARN-5150: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

2017-11-17 Thread Tao Yang (JIRA)
Tao Yang created YARN-7527: -- Summary: Over-allocate node resource in async-scheduling mode of CapacityScheduler Key: YARN-7527 URL: https://issues.apache.org/jira/browse/YARN-7527 Project: Hadoop YARN

[jira] [Commented] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

2017-11-17 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256639#comment-16256639 ] Bibin A Chundatt commented on YARN-7525: Thank you [~Tao Yang] for patch. Yes. param supported is

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256843#comment-16256843 ] Hadoop QA commented on YARN-6523: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256796#comment-16256796 ] Hadoop QA commented on YARN-7527: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5150) [YARN-3368] Add a sunburst chart view for queues/applications resource usage to new YARN UI

2017-11-17 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-5150: Attachment: (was: Screen Shot 2017-03-31 at 15.06.49.png) > [YARN-3368] Add a sunburst chart

[jira] [Updated] (YARN-5150) [YARN-3368] Add a sunburst chart view for queues/applications resource usage to new YARN UI

2017-11-17 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-5150: Attachment: YARN-5150.002.patch Rebased to the latest trunk, updated the colors and the tooltip

[jira] [Updated] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

2017-11-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7527: --- Attachment: YARN-7527.001.patch Attaching init patch for review. > Over-allocate node resource in

[jira] [Updated] (YARN-5150) [YARN-3368] Add a sunburst chart view for queues/applications resource usage to new YARN UI

2017-11-17 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-5150: Attachment: Screen Shot 2017-11-17 at 12.05.28.png > [YARN-3368] Add a sunburst chart view for

[jira] [Updated] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

2017-11-17 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-7525: --- Attachment: YARN-7525.002.patch Thanks [~bibinchundatt] for your review and suggestion. Yes, it's good to add

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256633#comment-16256633 ] Konstantinos Karanasos commented on YARN-7448: -- Please find some quick comments (for v7 of the

[jira] [Commented] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256729#comment-16256729 ] Hadoop QA commented on YARN-7525: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: YARN-7448-YARN-6592.008.patch > [API] Add SchedulingRequest to the

[jira] [Comment Edited] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-17 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257127#comment-16257127 ] Zheng Hu edited comment on YARN-7213 at 11/17/17 3:41 PM: -- [~haibo.chen], I

[jira] [Updated] (YARN-7510) Merge work for YARN-5881

2017-11-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7510: -- Attachment: YARN-7510.002.patch branch is rebased and running jenkins again on branch patch (combined) > Merge

[jira] [Comment Edited] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257150#comment-16257150 ] Arun Suresh edited comment on YARN-7448 at 11/17/17 3:54 PM: - [~kkaranasos]

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257150#comment-16257150 ] Arun Suresh commented on YARN-7448: --- [~kkaranasos] bq. setSchedulingRequests seems to do nothing at the

[jira] [Commented] (YARN-1015) FS should watch node resource utilization and allocate opportunistic containers if appropriate

2017-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257112#comment-16257112 ] Haibo Chen commented on YARN-1015: -- Thanks [~asuresh] and [~miklos.szeg...@cloudera.com] for the reviews!

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-17 Thread Zheng Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257127#comment-16257127 ] Zheng Hu commented on YARN-7213: [~haibo.chen], I written a UT based on your HBase folks discussion.

[jira] [Updated] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7506: - Issue Type: Sub-task (was: Wish) Parent: YARN-5673 > Overhaul the design of the Linux

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257426#comment-16257426 ] ASF GitHub Bot commented on YARN-6483: -- Github user xslogic commented on a diff in the pull request:

[jira] [Commented] (YARN-7513) FindBugs in FSAppAttempt.getWeight()

2017-11-17 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257451#comment-16257451 ] Yufei Gu commented on YARN-7513: By looking at the callers of {{getWeight()}}, they are in sorting

[jira] [Created] (YARN-7529) TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently

2017-11-17 Thread Chandni Singh (JIRA)
Chandni Singh created YARN-7529: --- Summary: TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently Key: YARN-7529 URL: https://issues.apache.org/jira/browse/YARN-7529

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-11-17 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257486#comment-16257486 ] Zian Chen commented on YARN-6124: - [~leftnoteasy] Thank you for your suggestions, I have modified the patch

[jira] [Updated] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7506: - Attachment: (was: YARN-Docker control options.pdf) > Overhaul the design of the Linux

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-17 Thread Brad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257379#comment-16257379 ] Brad commented on YARN-6483: I think this would would be useful for another spark change I am working on,

[jira] [Updated] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7506: - Attachment: YARN-Docker control options.pdf > Overhaul the design of the Linux container-executor

[jira] [Created] (YARN-7528) Need to document that resource types that use units need to be defined at RM level and NM level

2017-11-17 Thread Grant Sohn (JIRA)
Grant Sohn created YARN-7528: Summary: Need to document that resource types that use units need to be defined at RM level and NM level Key: YARN-7528 URL: https://issues.apache.org/jira/browse/YARN-7528

[jira] [Commented] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations

2017-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257384#comment-16257384 ] Wangda Tan commented on YARN-7496: -- [~eepayne], thanks for filing the JIRA and working on the fix, change

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257446#comment-16257446 ] Eric Yang commented on YARN-7506: - [~miklos.szeg...@cloudera.com] We agree on trust and verify is the way

[jira] [Commented] (YARN-7525) Incorrect query parameters in cluster nodes REST API document

2017-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257443#comment-16257443 ] Wangda Tan commented on YARN-7525: -- Thanks [~Tao Yang], patch looks good. [~bibinchundatt], please proceed

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257366#comment-16257366 ] Arun Suresh commented on YARN-7448: --- Thanks for the reviews [~kkaranasos] and [~leftnoteasy] and for the

[jira] [Commented] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257375#comment-16257375 ] Miklos Szegedi commented on YARN-7506: -- Thank you for the comments. [~ebadger], the main reason a Java

[jira] [Updated] (YARN-7506) Overhaul the design of the Linux container-executor regarding Docker and future runtimes

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7506: - Attachment: YARN-Docker control options.pdf > Overhaul the design of the Linux container-executor

[jira] [Commented] (YARN-7470) TestYarnNativeServices testRecoverComponentsAfterRMRestart fails due to BindingException

2017-11-17 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257427#comment-16257427 ] Chandni Singh commented on YARN-7470: - I need to verify if using HATestUtil is necessary here. The test

[jira] [Commented] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

2017-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257440#comment-16257440 ] Wangda Tan commented on YARN-7527: -- [~Tao Yang], fix looks good to me. And test failures are not related.

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-17 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Rodríguez Hortalá updated YARN-6483: - Attachment: YARN-6483.002.patch > Add nodes transitioning to DECOMMISSIONING state

[jira] [Updated] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6921: - Attachment: YARN-6921-YARN-1011.00.patch > Allow resource request to opt out of oversubscription in Fair

[jira] [Updated] (YARN-7529) TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently

2017-11-17 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7529: Attachment: YARN-7529.001.patch > TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails

[jira] [Commented] (YARN-7523) Introduce description and version field in Service record

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257479#comment-16257479 ] Eric Yang commented on YARN-7523: - [~gsaha] For catalog, can we consider these fields? # Organization #

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257360#comment-16257360 ] Wangda Tan commented on YARN-6124: -- [~Zian Chen], thanks for investigating this, I personally prefer to

[jira] [Commented] (YARN-7274) Ability to disable elasticity at leaf queue level

2017-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257386#comment-16257386 ] Wangda Tan commented on YARN-7274: -- Thanks [~jlowe], bq. The only thing we should care about is absolute

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257393#comment-16257393 ] ASF GitHub Bot commented on YARN-6483: -- Github user juanrh commented on a diff in the pull request:

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257394#comment-16257394 ] Miklos Szegedi commented on YARN-5673: -- [~eyang], thank you for the explanation. Indeed, these might

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-17 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257452#comment-16257452 ] ASF GitHub Bot commented on YARN-6483: -- Github user juanrh commented on a diff in the pull request:

[jira] [Commented] (YARN-7004) Add configs cache to optimize refreshQueues performance for large scale of queues

2017-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257454#comment-16257454 ] Wangda Tan commented on YARN-7004: -- [~Tao Yang], thanks for filing this ticket. I haven't reviewed much

[jira] [Updated] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-11-17 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-6124: Attachment: YARN-6124.wip.3.patch > Make SchedulingEditPolicy can be enabled / disabled / updated with

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257190#comment-16257190 ] Hadoop QA commented on YARN-7448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7274) Ability to disable elasticity at leaf queue level

2017-11-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257228#comment-16257228 ] Jason Lowe commented on YARN-7274: -- bq. Basically we want to make sure queue.absolute_capacity <=

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-17 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257268#comment-16257268 ] Miklos Szegedi commented on YARN-5673: -- [~eyang], Thank you for your comment. I have a few questions.

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257270#comment-16257270 ] Eric Yang commented on YARN-7218: - Thank you [~billie.rinaldi]. I just committed this. > ApiServer REST

[jira] [Commented] (YARN-7430) Enable user re-mapping for Docker containers by default

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257348#comment-16257348 ] Eric Yang commented on YARN-7430: - Thank you [~vvasudev]. > Enable user re-mapping for Docker containers

[jira] [Commented] (YARN-7515) HA related tests fails in trunk

2017-11-17 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257182#comment-16257182 ] Jason Lowe commented on YARN-7515: -- There aren't enough logs from the precommit build to prove this, but I

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-17 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257208#comment-16257208 ] Billie Rinaldi commented on YARN-7218: -- I have convinced myself that the unit test and findbugs issues

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257245#comment-16257245 ] Konstantinos Karanasos commented on YARN-7448: -- [~asuresh], I see your points regarding the

[jira] [Commented] (YARN-7510) Merge work for YARN-5881

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257275#comment-16257275 ] Hadoop QA commented on YARN-7510: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257286#comment-16257286 ] Daniel Templeton commented on YARN-7119: bq. Currently if there is any non-alpha characters in

[jira] [Commented] (YARN-7218) ApiServer REST API naming convention /ws/v1 is already used in Hadoop v2

2017-11-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257305#comment-16257305 ] Hudson commented on YARN-7218: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13254 (See

[jira] [Updated] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-7448: - Attachment: YARN-7448-YARN-6592.009.patch [~kkaranasos] [~asuresh] thanks for the

[jira] [Updated] (YARN-6750) Add a configuration to cap how much a NM can be overallocated

2017-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6750: - Attachment: YARN-6750-YARN-1011.00.patch > Add a configuration to cap how much a NM can be overallocated >

[jira] [Assigned] (YARN-6942) Add examples for placement constraints usage in applications

2017-11-17 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis reassigned YARN-6942: Assignee: Panagiotis Garefalakis > Add examples for placement constraints

[jira] [Commented] (YARN-7470) TestYarnNativeServices testRecoverComponentsAfterRMRestart fails due to BindingException

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257254#comment-16257254 ] Eric Yang commented on YARN-7470: - [~csingh] Are we at risk of introducing circular dependencies?

[jira] [Comment Edited] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257315#comment-16257315 ] Eric Yang edited comment on YARN-5673 at 11/17/17 6:11 PM: --- Hi

[jira] [Comment Edited] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257195#comment-16257195 ] Panagiotis Garefalakis edited comment on YARN-7448 at 11/17/17 4:49 PM:

[jira] [Commented] (YARN-5673) [Umbrella] Re-write container-executor to improve security, extensibility, and portability

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257315#comment-16257315 ] Eric Yang commented on YARN-5673: - Hi [~miklos.szeg...@cloudera.com] 4) For clean up container, it *might*

[jira] [Commented] (YARN-7448) [API] Add SchedulingRequest to the AllocateRequest

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257327#comment-16257327 ] Hadoop QA commented on YARN-7448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257532#comment-16257532 ] Haibo Chen commented on YARN-7337: -- The license warning and findbug issue are unrelated, so are the

[jira] [Updated] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7337: - Attachment: YARN-7337-YARN-1011.04.patch > Expose per-node over-allocation info in Node Report >

[jira] [Commented] (YARN-7529) TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257537#comment-16257537 ] Hadoop QA commented on YARN-7529: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257593#comment-16257593 ] Eric Yang edited comment on YARN-7530 at 11/17/17 9:23 PM: --- This patch is same

[jira] [Assigned] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7530: --- Assignee: Eric Yang > hadoop-yarn-services-api should be part of hadoop-yarn-services >

[jira] [Commented] (YARN-7529) TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently

2017-11-17 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257598#comment-16257598 ] Chandni Singh commented on YARN-7529: - [~billie.rinaldi] Can you please review? >

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257513#comment-16257513 ] Hadoop QA commented on YARN-7337: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7530: Attachment: YARN-7530.001.patch This patch is same as: {{code}} git mv hadoop-yarn-services-api

[jira] [Commented] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257595#comment-16257595 ] Hadoop QA commented on YARN-7530: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7529) TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently

2017-11-17 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257596#comment-16257596 ] Chandni Singh commented on YARN-7529: - The test seemed to be failing because it wasn't waiting for the

[jira] [Comment Edited] (YARN-7529) TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently

2017-11-17 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257602#comment-16257602 ] Chandni Singh edited comment on YARN-7529 at 11/17/17 9:29 PM: --- Patch 2:

[jira] [Created] (YARN-7530) hadoop-yarn-services-api should be part of hadoop-yarn-services

2017-11-17 Thread Eric Yang (JIRA)
Eric Yang created YARN-7530: --- Summary: hadoop-yarn-services-api should be part of hadoop-yarn-services Key: YARN-7530 URL: https://issues.apache.org/jira/browse/YARN-7530 Project: Hadoop YARN

[jira] [Updated] (YARN-7529) TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently

2017-11-17 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7529: Attachment: YARN-7529.002.patch Address checkstyle warning >

[jira] [Updated] (YARN-7495) Improve robustness of the AggregatedLogDeletionService

2017-11-17 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-7495: -- Attachment: YARN-7495.002.patch > Improve robustness of the AggregatedLogDeletionService >

[jira] [Commented] (YARN-7119) yarn rmadmin -updateNodeResource should be updated for resource types

2017-11-17 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257629#comment-16257629 ] Daniel Templeton commented on YARN-7119: # ResourceUtils:L24, javadoc summary must end with a

[jira] [Commented] (YARN-7531) ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType()

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257846#comment-16257846 ] Hadoop QA commented on YARN-7531: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257858#comment-16257858 ] Subru Krishnan commented on YARN-6128: -- Thanks [~botong]. I have committed to trunk but couldn't

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257868#comment-16257868 ] Hudson commented on YARN-6128: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13255 (See

[jira] [Commented] (YARN-7524) Remove unused FairSchedulerEventLog

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257883#comment-16257883 ] Hadoop QA commented on YARN-7524: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7469: -- Fix Version/s: 2.9.1 > Capacity Scheduler Intra-queue preemption: User can starve if newest app is > exactly at

[jira] [Commented] (YARN-7469) Capacity Scheduler Intra-queue preemption: User can starve if newest app is exactly at user limit

2017-11-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257011#comment-16257011 ] Sunil G commented on YARN-7469: --- Pushed to 2.9 as well. > Capacity Scheduler Intra-queue preemption: User

[jira] [Commented] (YARN-7531) ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType()

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257792#comment-16257792 ] Hadoop QA commented on YARN-7531: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257798#comment-16257798 ] Wangda Tan commented on YARN-6124: -- [~Zian Chen], thanks for updating the patch. In general I think the

[jira] [Commented] (YARN-7523) Introduce description and version field in Service record

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257695#comment-16257695 ] Eric Yang commented on YARN-7523: - It would be nice if we create a wrapper object on Service record as a

[jira] [Updated] (YARN-7531) ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType()

2017-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7531: - Priority: Major (was: Critical) > ResourceRequest.equal does not check >

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257722#comment-16257722 ] Wangda Tan commented on YARN-7473: -- Thanks [~suma.shivaprasad], comments:

[jira] [Assigned] (YARN-6922) Findbugs warning in YARN NodeManager

2017-11-17 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen reassigned YARN-6922: --- Assignee: Weiwei Yang (was: Xiao Chen) > Findbugs warning in YARN NodeManager >

[jira] [Commented] (YARN-7529) TestYarnNativeServices#testRecoverComponentsAfterRMRestart() fails intermittently

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257680#comment-16257680 ] Hadoop QA commented on YARN-7529: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-11-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257731#comment-16257731 ] Hadoop QA commented on YARN-6124: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7531) ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType()

2017-11-17 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7531: Summary: ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType() Key: YARN-7531 URL: https://issues.apache.org/jira/browse/YARN-7531 Project: Hadoop

[jira] [Updated] (YARN-7399) Yarn services metadata storage improvement

2017-11-17 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7399: Attachment: YARN-7399.001.patch First draft of the storage API. Main features of this interface divided

[jira] [Updated] (YARN-7531) ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType()

2017-11-17 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7531: - Attachment: YARN-7531.prelim.patch Upload a preliminary patch to check what tests fails because of this

[jira] [Updated] (YARN-7528) Need to document that resource types that use units need to be defined at RM level and NM level

2017-11-17 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Sohn updated YARN-7528: - Component/s: resourcemanager > Need to document that resource types that use units need to be defined at

[jira] [Commented] (YARN-7528) Need to document that resource types that use units need to be defined at RM level and NM level

2017-11-17 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257713#comment-16257713 ] Grant Sohn commented on YARN-7528: -- This has the unpleasant side-effect of causing the job to hang. >

  1   2   >