[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-18 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201835#comment-15201835 ] Varun Saxena commented on YARN-4712: bq. Varun Saxena, will you do the honors of committing this

[jira] [Created] (YARN-4829) Add support for binary units

2016-03-18 Thread Varun Vasudev (JIRA)
Varun Vasudev created YARN-4829: --- Summary: Add support for binary units Key: YARN-4829 URL: https://issues.apache.org/jira/browse/YARN-4829 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

2016-03-18 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200655#comment-15200655 ] Haibo Chen commented on YARN-4766: -- fixed the liscense + checkstyle issues. The unit test failure is

[jira] [Commented] (YARN-4814) ATS 1.5 timelineclient impl call flush after every event write

2016-03-18 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197348#comment-15197348 ] Jason Lowe commented on YARN-4814: -- +1 lgtm, holding off on committing to allow others to comment. I

[jira] [Commented] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

2016-03-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202584#comment-15202584 ] Wangda Tan commented on YARN-4576: -- Thanks [~vinodkv] for starting this discussion, After ramped up most

[jira] [Updated] (YARN-998) Persistent resource change during NM/RM restart

2016-03-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-998: Attachment: YARN-998-v2.patch Update the patch to incorporate with Jian's comments and fix Jenkins whitespace

[jira] [Updated] (YARN-4830) Add support for resource types in the nodemanager

2016-03-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4830: Description: The RM has support for multiple resource types. The same should be added for the NMs.

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-03-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201655#comment-15201655 ] Sangjin Lee commented on YARN-4837: --- I just wanted to add my 2 cents to the discussion, specifically

[jira] [Assigned] (YARN-4831) Recovered containers will be killed after NM stateful restart

2016-03-18 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reassigned YARN-4831: - Assignee: Siqi Li > Recovered containers will be killed after NM stateful restart >

[jira] [Commented] (YARN-4711) NM is going down with NPE's due to single thread processing of events by Timeline client

2016-03-18 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197858#comment-15197858 ] Naganarasimha G R commented on YARN-4711: - Hi [~sjlee0], Following issues needs to be fixed as

[jira] [Commented] (YARN-998) Persistent resource change during NM/RM restart

2016-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197900#comment-15197900 ] Hadoop QA commented on YARN-998: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4743) ResourceManager crash because TimSort

2016-03-18 Thread Zephyr Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zephyr Guo updated YARN-4743: - Attachment: YARN-4743-cdh5.4.7.patch > ResourceManager crash because TimSort >

[jira] [Commented] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199604#comment-15199604 ] Hadoop QA commented on YARN-4062: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197763#comment-15197763 ] Varun Vasudev commented on YARN-3926: - bq. That should work... But I feel, maybe allow mismatch should

[jira] [Commented] (YARN-4576) Enhancement for tracking Blacklist in AM Launching

2016-03-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201559#comment-15201559 ] Junping Du commented on YARN-4576: -- bq. this whole "AM blacklisting" feature is unnecessarily blown way

[jira] [Commented] (YARN-4636) Make blacklist tracking policy pluggable for more extensions.

2016-03-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201373#comment-15201373 ] Junping Du commented on YARN-4636: -- bq. -1 for something like this without understanding the use-cases. We

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-03-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202323#comment-15202323 ] Sangjin Lee commented on YARN-4837: --- Yes, [~vinodkv], I agree with the direction you laid out. > User

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-18 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199736#comment-15199736 ] Eric Badger commented on YARN-4686: --- [~kasha] When HA is not enabled, the RM will be transitioned to

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2016-03-18 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197826#comment-15197826 ] Kuhu Shukla commented on YARN-4311: --- Requesting Jason Lowe, Daniel Templeton for review/comments. Thanks

[jira] [Commented] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200770#comment-15200770 ] Hadoop QA commented on YARN-4746: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4699) Scheduler UI and REST o/p is not in sync when -replaceLabelsOnNode is used to change label of a node

2016-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200371#comment-15200371 ] Hadoop QA commented on YARN-4699: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4390) Consider container request size during CS preemption

2016-03-18 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4390: - Issue Type: Sub-task (was: Bug) Parent: YARN-45 > Consider container request size during CS

[jira] [Comment Edited] (YARN-4829) Add support for binary units

2016-03-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197449#comment-15197449 ] Varun Vasudev edited comment on YARN-4829 at 3/16/16 3:12 PM: -- Attached a file

[jira] [Commented] (YARN-4833) For Queue AccessControlException client retries multiple times on both RM

2016-03-18 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202550#comment-15202550 ] Sunil G commented on YARN-4833: --- Hi [~bibinchundatt] and [~jianhe] I have some doubts here.

[jira] [Updated] (YARN-4694) Document ATS v1.5

2016-03-18 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4694: Assignee: Li Lu (was: Xuan Gong) > Document ATS v1.5 > - > > Key: YARN-4694

[jira] [Commented] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202365#comment-15202365 ] Hadoop QA commented on YARN-4815: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4837) User facing aspects of 'AM blacklisting' feature need fixing

2016-03-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202500#comment-15202500 ] Junping Du commented on YARN-4837: -- Hi [~vinodkv], did you see my comments at YARN-4576

[jira] [Commented] (YARN-1040) De-link container life cycle from an Allocation

2016-03-18 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202391#comment-15202391 ] Bikas Saha commented on YARN-1040: -- This design doc effectively looks like a re-design of almost all core

[jira] [Commented] (YARN-810) Support CGroup ceiling enforcement on CPU

2016-03-18 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202256#comment-15202256 ] Karthik Kambatla commented on YARN-810: --- Hasn't this been recently added with strict cpu usage? >

[jira] [Created] (YARN-4840) Add option to upload files recursively from container directory

2016-03-18 Thread Brook Zhou (JIRA)
Brook Zhou created YARN-4840: Summary: Add option to upload files recursively from container directory Key: YARN-4840 URL: https://issues.apache.org/jira/browse/YARN-4840 Project: Hadoop YARN

[jira] [Commented] (YARN-4595) Add support for configurable read-only mounts

2016-03-18 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200076#comment-15200076 ] Allen Wittenauer commented on YARN-4595: What's preventing users from mounting files and file

[jira] [Updated] (YARN-4823) Refactor the nested reservation id field in listReservation to simple string field

2016-03-18 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4823: - Description: The listReservation REST API returns a ReservationId field which has a nested id

[jira] [Updated] (YARN-4785) inconsistent value type of the "type" field for LeafQueueInfo in response of RM REST API - cluster/scheduler

2016-03-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4785: Attachment: YARN-4785.branch-2.6.001.patch YARN-4785.branch-2.7.001.patch Thanks for

[jira] [Commented] (YARN-4712) CPU Usage Metric is not captured properly in YARN-2928

2016-03-18 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15201695#comment-15201695 ] Sangjin Lee commented on YARN-4712: --- For the record (and following up on yesterday's offline discussion),

[jira] [Created] (YARN-4833) For Queue AccessControlException client retries multiple times on both RM

2016-03-18 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-4833: -- Summary: For Queue AccessControlException client retries multiple times on both RM Key: YARN-4833 URL: https://issues.apache.org/jira/browse/YARN-4833 Project:

[jira] [Commented] (YARN-4829) Add support for binary units

2016-03-18 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198012#comment-15198012 ] Arun Suresh commented on YARN-4829: --- Thanks, LGTM +1 pending Jenkins > Add support for binary units >

[jira] [Commented] (YARN-4820) ResourceManager web redirects in HA mode drops query parameters

2016-03-18 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199524#comment-15199524 ] Varun Vasudev commented on YARN-4820: - bq. I was just looking at the redirect logic and noting it was

[jira] [Commented] (YARN-4607) AppAttempt page TotalOutstandingResource Requests table support pagination

2016-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202269#comment-15202269 ] Hadoop QA commented on YARN-4607: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4815) ATS 1.5 timelineclinet impl try to create attempt directory for every event call

2016-03-18 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202431#comment-15202431 ] Junping Du commented on YARN-4815: -- v2 patch LGTM. However, can we fix checkstyle issues? > ATS 1.5

[jira] [Commented] (YARN-4746) yarn web services should convert parse failures of appId to 400

2016-03-18 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202503#comment-15202503 ] Hadoop QA commented on YARN-4746: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||