[jira] [Comment Edited] (YARN-4743) ResourceManager crash because TimSort

2016-09-07 Thread Benedict Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15469789#comment-15469789 ] Benedict Jin edited comment on YARN-4743 at 9/7/16 12:00 PM: - 感觉这是一个

[jira] [Commented] (YARN-5621) Support LinuxContainerExecutor to create symlinks

2016-09-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470494#comment-15470494 ] Jian He commented on YARN-5621: --- Because it is a actually a script file and can also be used for other

[jira] [Commented] (YARN-5621) Support LinuxContainerExecutor to create symlinks

2016-09-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470454#comment-15470454 ] Allen Wittenauer commented on YARN-5621: Also, why is container-executor's symlink support actually

[jira] [Updated] (YARN-5366) Add support for toggling the removal of completed and failed docker containers

2016-09-07 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5366: -- Attachment: YARN-5366.004.patch > Add support for toggling the removal of completed and failed docker

[jira] [Commented] (YARN-4232) TopCLI console support for HA mode

2016-09-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470463#comment-15470463 ] Bibin A Chundatt commented on YARN-4232: [~vvasudev] {quote} HTTPS doesn't imply kerberos - you

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470469#comment-15470469 ] Varun Saxena commented on YARN-5585: Thanks Rohith for the patch. A single column value filter of

[jira] [Comment Edited] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470538#comment-15470538 ] Rohith Sharma K S edited comment on YARN-5585 at 9/7/16 12:56 PM: -- bq. Can

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470657#comment-15470657 ] Varun Saxena commented on YARN-5585: Hmm...Then what we can do is that fetch the specific entity

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470538#comment-15470538 ] Rohith Sharma K S commented on YARN-5585: - bq. Can you tell me the use case ? Listing all DAGs' or

[jira] [Commented] (YARN-5606) Support multi-label merge into one node label

2016-09-07 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470038#comment-15470038 ] jialei weng commented on YARN-5606: --- yes, as current node label will divide the current cluster into

[jira] [Issue Comment Deleted] (YARN-5606) Support multi-label merge into one node label

2016-09-07 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jialei weng updated YARN-5606: -- Comment: was deleted (was: yes, as current node label will divide the current cluster into several

[jira] [Commented] (YARN-5606) Support multi-label merge into one node label

2016-09-07 Thread jialei weng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470037#comment-15470037 ] jialei weng commented on YARN-5606: --- yes, as current node label will divide the current cluster into

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470338#comment-15470338 ] Rohith Sharma K S commented on YARN-5585: - One of the challenge for supporting fromId is to iterate

[jira] [Commented] (YARN-4232) TopCLI console support for HA mode

2016-09-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470059#comment-15470059 ] Naganarasimha G R commented on YARN-4232: - [~bibinchundatt], Also as discussed offline seems like

[jira] [Commented] (YARN-5586) Update the Resources class to consider all resource types

2016-09-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470203#comment-15470203 ] Rohith Sharma K S commented on YARN-5586: - Overall patch look fine, one doubt on the patch, While

[jira] [Commented] (YARN-4232) TopCLI console support for HA mode

2016-09-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470049#comment-15470049 ] Varun Vasudev commented on YARN-4232: - [~bibinchundatt] - couple of points - 1) HTTPS doesn't imply

[jira] [Commented] (YARN-2865) Application recovery continuously fails with "Application with id already present. Cannot duplicate"

2016-09-07 Thread s.a....@accenture.com (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470223#comment-15470223 ] s.a@accenture.com commented on YARN-2865: - Hi, Issues with YARN were it is not becoming

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472837#comment-15472837 ] Varun Saxena commented on YARN-5585: IIUC, Tez DAG ID is a combination of YARN App ID and DAG sequence

[jira] [Comment Edited] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472837#comment-15472837 ] Varun Saxena edited comment on YARN-5585 at 9/8/16 5:29 AM: IIUC, Tez DAG ID is

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472777#comment-15472777 ] Jian He commented on YARN-5620: --- [~asuresh], thanks for the explanation bq. Only the AM knows if the upgrade

[jira] [Comment Edited] (YARN-5621) Support LinuxContainerExecutor to create symlinks

2016-09-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472814#comment-15472814 ] Varun Vasudev edited comment on YARN-5621 at 9/8/16 5:17 AM: - Thanks for the

[jira] [Comment Edited] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472777#comment-15472777 ] Jian He edited comment on YARN-5620 at 9/8/16 5:06 AM: --- [~asuresh], thanks for the

[jira] [Commented] (YARN-5621) Support LinuxContainerExecutor to create symlinks

2016-09-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472814#comment-15472814 ] Varun Vasudev commented on YARN-5621: - 1) {code} + File srcFile = +

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470687#comment-15470687 ] Rohith Sharma K S commented on YARN-5585: - bq. fetch the specific entity mentioned in fromId using

[jira] [Commented] (YARN-5366) Add support for toggling the removal of completed and failed docker containers

2016-09-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470725#comment-15470725 ] Hadoop QA commented on YARN-5366: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5366) Add support for toggling the removal of completed and failed docker containers

2016-09-07 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470769#comment-15470769 ] Shane Kumpf commented on YARN-5366: --- Thank you for the review, [~vvasudev]! The latest patch addresses

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470739#comment-15470739 ] Varun Saxena commented on YARN-5585: bq. But problem is entities may not stored in their creation time

[jira] [Commented] (YARN-4232) TopCLI console support for HA mode

2016-09-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470812#comment-15470812 ] Naganarasimha G R commented on YARN-4232: - [~bibinchundatt], & [~vvasudev], bq. IIUC for

[jira] [Commented] (YARN-5552) Add Builder methods for common yarn API records

2016-09-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470993#comment-15470993 ] Wangda Tan commented on YARN-5552: -- [~Tao Jie], bq. Storing local variables in builder here is to give a

[jira] [Commented] (YARN-4954) TestYarnClient.testReservationAPIs fails on machines with less than 4 GB available memory

2016-09-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470986#comment-15470986 ] Jason Lowe commented on YARN-4954: -- We're seeing this unit test still failing sporadically in our builds,

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470803#comment-15470803 ] Varun Saxena commented on YARN-5585: The best solution for this will be that keys are stored in sorted

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471772#comment-15471772 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

2016-09-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471794#comment-15471794 ] Wangda Tan commented on YARN-4945: -- Hi [~eepayne], Maybe there're some misunderstandings, first of all,

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471764#comment-15471764 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471783#comment-15471783 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Comment Edited] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471809#comment-15471809 ] Arun Suresh edited comment on YARN-5620 at 9/7/16 9:07 PM: --- Thanks for the review

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471809#comment-15471809 ] Arun Suresh commented on YARN-5620: --- Thanks for the review [~jianhe] bq. The COMMIT_UPGRADE API: I don’t

[jira] [Comment Edited] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471809#comment-15471809 ] Arun Suresh edited comment on YARN-5620 at 9/7/16 9:17 PM: --- Thanks for the review

[jira] [Resolved] (YARN-5539) AM fails due to "java.net.SocketTimeoutException: Read timed out"

2016-09-07 Thread Sumana Sathish (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumana Sathish resolved YARN-5539. -- Resolution: Cannot Reproduce Not able to reproduce the issue. > AM fails due to

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472049#comment-15472049 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472083#comment-15472083 ] Li Lu commented on YARN-5585: - I think we're overcomplicating the problem here... I believe the general use

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2016-09-07 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472088#comment-15472088 ] Ming Ma commented on YARN-5464: --- Maybe this was discussed in the other jira, currently the timeout value

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-09-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471959#comment-15471959 ] Wangda Tan commented on YARN-4734: -- [~sunilg], Javadocs warnings should related to changes for UI hosting,

[jira] [Comment Edited] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472021#comment-15472021 ] Arun Suresh edited comment on YARN-5620 at 9/7/16 10:42 PM: [~leftnoteasy], I

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472021#comment-15472021 ] Arun Suresh commented on YARN-5620: --- [~leftnoteasy], I feel the YARN-5221 and this are orthogonal.

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472060#comment-15472060 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472056#comment-15472056 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472054#comment-15472054 ] Wangda Tan commented on YARN-5620: -- [~asuresh], I still think two APIs should be merged. In YARN-5221,

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472129#comment-15472129 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471981#comment-15471981 ] Wangda Tan commented on YARN-5620: -- [~asuresh], In YARN-5221 we have merged update container resource and

[jira] [Comment Edited] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472021#comment-15472021 ] Arun Suresh edited comment on YARN-5620 at 9/7/16 10:43 PM: [~leftnoteasy], I

[jira] [Created] (YARN-5622) TestYarnCLI.testGetContainers fails due to mismatched date formats

2016-09-07 Thread Eric Badger (JIRA)
Eric Badger created YARN-5622: - Summary: TestYarnCLI.testGetContainers fails due to mismatched date formats Key: YARN-5622 URL: https://issues.apache.org/jira/browse/YARN-5622 Project: Hadoop YARN

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471149#comment-15471149 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471165#comment-15471165 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471166#comment-15471166 ] Jian He commented on YARN-5620: --- Thanks Arun, some questions on the API: - The COMMIT_UPGRADE API: I don’t

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471191#comment-15471191 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Updated] (YARN-5586) Update the Resources class to consider all resource types

2016-09-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-5586: Attachment: YARN-5586-YARN-3926.002.patch Good point. The root bug here really in the

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471261#comment-15471261 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5616) Clean up WeightAdjuster

2016-09-07 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471092#comment-15471092 ] Yufei Gu commented on YARN-5616: Thanks [~kasha] for the review and committing. > Clean up WeightAdjuster

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471161#comment-15471161 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15471241#comment-15471241 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

2016-09-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472191#comment-15472191 ] Eric Payne commented on YARN-4945: -- Thank you [~leftnoteasy]. I see now that

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472206#comment-15472206 ] ASF GitHub Bot commented on YARN-5605: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472267#comment-15472267 ] ASF GitHub Bot commented on YARN-5605: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472292#comment-15472292 ] ASF GitHub Bot commented on YARN-5605: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472306#comment-15472306 ] Karthik Kambatla commented on YARN-5605: Thanks for the reviews, [~templedf]. Just pushed a second

[jira] [Commented] (YARN-5561) [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST

2016-09-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472318#comment-15472318 ] Li Lu commented on YARN-5561: - OK I revisited the patch and our reader REST APIs. Right now we have 26 (!)

[jira] [Commented] (YARN-5561) [Atsv2] : Support for ability to retrieve apps/app-attempt/containers and entities via REST

2016-09-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472330#comment-15472330 ] Li Lu commented on YARN-5561: - Sequence 2 in this list seems to be replacing the majority part of the old AHS

[jira] [Commented] (YARN-4676) Automatic and Asynchronous Decommissioning Nodes Status Tracking

2016-09-07 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472063#comment-15472063 ] Ming Ma commented on YARN-4676: --- Thanks all! [~djp], sorry I missed your earlier question about the format.

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472064#comment-15472064 ] ASF GitHub Bot commented on YARN-5605: -- Github user templedf commented on a diff in the pull request:

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472111#comment-15472111 ] Li Lu commented on YARN-5585: - Just realized that a normal converter will not address the use case where users

[jira] [Updated] (YARN-4091) Add REST API to retrieve scheduler activity

2016-09-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4091: - Attachment: YARN-4091-branch-2.001.patch Attached patch for branch-2, it will be good to put to branch-2

[jira] [Reopened] (YARN-4091) Add REST API to retrieve scheduler activity

2016-09-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-4091: -- > Add REST API to retrieve scheduler activity > --- > >

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472217#comment-15472217 ] ASF GitHub Bot commented on YARN-5605: -- Github user kambatla commented on a diff in the pull request:

[jira] [Created] (YARN-5625) FairScheduler should use FSContext more aggressively to avoid constructors with many parameters

2016-09-07 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-5625: -- Summary: FairScheduler should use FSContext more aggressively to avoid constructors with many parameters Key: YARN-5625 URL: https://issues.apache.org/jira/browse/YARN-5625

[jira] [Commented] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-09-07 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472220#comment-15472220 ] Giovanni Matteo Fumarola commented on YARN-5323: +1 Thanks [~curino]. > Policies APIs (for

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472225#comment-15472225 ] ASF GitHub Bot commented on YARN-5605: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5620) Core changes in NodeManager to support for upgrade and rollback of Containers

2016-09-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472223#comment-15472223 ] Wangda Tan commented on YARN-5620: -- Just have an offline chat with [~asuresh], since this is a

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472237#comment-15472237 ] ASF GitHub Bot commented on YARN-5605: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

2016-09-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472235#comment-15472235 ] Eric Payne commented on YARN-4945: -- [~sunilg], thanks again for all of the great work you are doing on

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472246#comment-15472246 ] ASF GitHub Bot commented on YARN-5605: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472254#comment-15472254 ] ASF GitHub Bot commented on YARN-5605: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-09-07 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472253#comment-15472253 ] Subru Krishnan commented on YARN-5323: -- The latest patch LGTM too, committing it shortly. > Policies

[jira] [Commented] (YARN-4945) [Umbrella] Capacity Scheduler Preemption Within a queue

2016-09-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472262#comment-15472262 ] Wangda Tan commented on YARN-4945: -- [~eepayne], bq. I actually would like to have the priority policy and

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472279#comment-15472279 ] ASF GitHub Bot commented on YARN-5605: -- Github user kambatla commented on a diff in the pull request:

[jira] [Comment Edited] (YARN-5323) Policies APIs (for Router and AMRMProxy policies)

2016-09-07 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472220#comment-15472220 ] Giovanni Matteo Fumarola edited comment on YARN-5323 at 9/8/16 12:45 AM:

[jira] [Commented] (YARN-5605) Preempt containers (all on one node) to meet the requirement of starved applications

2016-09-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472287#comment-15472287 ] ASF GitHub Bot commented on YARN-5605: -- Github user kambatla commented on a diff in the pull request:

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472526#comment-15472526 ] Varun Saxena commented on YARN-5585: bq. Just realized that a normal converter will not address the use

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472636#comment-15472636 ] Li Lu commented on YARN-5585: - bq. DAG ID seems to be generated same way. Unfortunately this is not true for

[jira] [Commented] (YARN-5567) Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus

2016-09-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472384#comment-15472384 ] Allen Wittenauer commented on YARN-5567: -1 Please revert this change. The exit code getting

[jira] [Reopened] (YARN-5567) Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus

2016-09-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reopened YARN-5567: > Fix script exit code checking in NodeHealthScriptRunner#reportHealthStatus >

[jira] [Commented] (YARN-4091) Add REST API to retrieve scheduler activity

2016-09-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472668#comment-15472668 ] Hadoop QA commented on YARN-4091: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472669#comment-15472669 ] Varun Saxena commented on YARN-5585: Another solution which comes to mind is that we keep another

[jira] [Commented] (YARN-4091) Add REST API to retrieve scheduler activity

2016-09-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472674#comment-15472674 ] Hadoop QA commented on YARN-4091: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472676#comment-15472676 ] Varun Saxena commented on YARN-5585: Another option would be to change the row key of entity table to

[jira] [Commented] (YARN-5585) [Atsv2] Add a new filter fromId in REST endpoints

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472689#comment-15472689 ] Varun Saxena commented on YARN-5585: Also [~rohithsharma] if its feasible, kindly consolidate all the

[jira] [Created] (YARN-5626) Support long running apps handling multiple flows

2016-09-07 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-5626: -- Summary: Support long running apps handling multiple flows Key: YARN-5626 URL: https://issues.apache.org/jira/browse/YARN-5626 Project: Hadoop YARN Issue Type:

[jira] [Assigned] (YARN-5626) Support long running apps handling multiple flows

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-5626: -- Assignee: Varun Saxena > Support long running apps handling multiple flows >

[jira] [Commented] (YARN-5626) Support long running apps handling multiple flows

2016-09-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472701#comment-15472701 ] Varun Saxena commented on YARN-5626: As discussed in call we can still serve this use case by allowing

[jira] [Commented] (YARN-4205) Add a service for monitoring application life time out

2016-09-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15472732#comment-15472732 ] Vinod Kumar Vavilapalli commented on YARN-4205: --- bq. And I believe monitoring interval should

  1   2   >