[jira] [Comment Edited] (YARN-4424) YARN CLI command hangs

2015-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046453#comment-15046453 ] Jian He edited comment on YARN-4424 at 12/8/15 6:34 AM: sorry, I pasted a wrong

[jira] [Commented] (YARN-4424) YARN CLI command hangs

2015-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046453#comment-15046453 ] Jian He commented on YARN-4424: --- sorry, I pasted a wrong thread stack, below thread is holding the

[jira] [Commented] (YARN-4301) NM disk health checker should have a timeout

2015-12-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046489#comment-15046489 ] Hadoop QA commented on YARN-4301: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4240) Add documentation for delegated-centralized node labels feature

2015-12-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046508#comment-15046508 ] Naganarasimha G R commented on YARN-4240: - Hi [~dian.fu], I am adding documentation to the

[jira] [Created] (YARN-4434) NodeManager Disk Checker parameter documentation is not correct

2015-12-07 Thread Takashi Ohnishi (JIRA)
Takashi Ohnishi created YARN-4434: - Summary: NodeManager Disk Checker parameter documentation is not correct Key: YARN-4434 URL: https://issues.apache.org/jira/browse/YARN-4434 Project: Hadoop YARN

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-12-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-1856: Attachment: YARN-1856.003.patch bq. The constants should have ‘MEMORY’ in their names. For example,

[jira] [Commented] (YARN-4240) Add documentation for delegated-centralized node labels feature

2015-12-07 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046513#comment-15046513 ] Dian Fu commented on YARN-4240: --- Hi [~Naganarasimha], Cool! Yes, of course. Feel free to do it and thanks a

[jira] [Updated] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

2015-12-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4356: -- Attachment: YARN-4356-feature-YARN-2928.002.patch Posted patch v.2. This should be a reasonably complete

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045026#comment-15045026 ] Hudson commented on YARN-3456: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #672 (See

[jira] [Updated] (YARN-4428) Redirect RM page to AHS page when AHS turned on and RM page is not avaialable

2015-12-07 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4428: --- Attachment: YARN-4428.1.patch > Redirect RM page to AHS page when AHS turned on and RM page is not avaialable

[jira] [Created] (YARN-4428) Redirect RM page to AHS page when AHS turned on and RM page is not avaialable

2015-12-07 Thread Chang Li (JIRA)
Chang Li created YARN-4428: -- Summary: Redirect RM page to AHS page when AHS turned on and RM page is not avaialable Key: YARN-4428 URL: https://issues.apache.org/jira/browse/YARN-4428 Project: Hadoop YARN

[jira] [Updated] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-12-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3542: Attachment: YARN-3542.003.patch bq.Move the implementation from CgroupsLCEResourcesHandler into

[jira] [Created] (YARN-4429) RetryPolicies (other than FailoverOnNetworkExceptionRetry) should put on retry failed reason or the log from RMProxy's retry could be very misleading.

2015-12-07 Thread Junping Du (JIRA)
Junping Du created YARN-4429: Summary: RetryPolicies (other than FailoverOnNetworkExceptionRetry) should put on retry failed reason or the log from RMProxy's retry could be very misleading. Key: YARN-4429 URL:

[jira] [Updated] (YARN-4428) Redirect RM page to AHS page when AHS turned on and RM page is not avaialable

2015-12-07 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4428: --- Description: When AHS is turned on, if we can't view application in RM page, RM page should redirect us to AHS

[jira] [Created] (YARN-4430) registry security validation can fail when downgrading to insecure would work

2015-12-07 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-4430: Summary: registry security validation can fail when downgrading to insecure would work Key: YARN-4430 URL: https://issues.apache.org/jira/browse/YARN-4430 Project:

[jira] [Updated] (YARN-4418) AM Resource Limit per partition can be updated to ResourceUsage as well

2015-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4418: -- Attachment: 0002-YARN-4418.patch Uploading a newer version of patching after looking into test failures. One

[jira] [Commented] (YARN-1488) Allow containers to delegate resources to another container

2015-12-07 Thread YONG FENG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045310#comment-15045310 ] YONG FENG commented on YARN-1488: - [YARN-1197] is a workaround of this JIRA. It allows resizing an

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

2015-12-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045329#comment-15045329 ] Kuhu Shukla commented on YARN-4413: --- [~templedf] Also, YARN-4386 would still be needed since currently

[jira] [Updated] (YARN-4309) Add debug information to application logs when a container fails

2015-12-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4309: Attachment: YARN-4309.008.patch Uploaded a new patch to address comments by [~leftnoteasy]. bq.

[jira] [Assigned] (YARN-4414) Nodemanager connection errors are retried at multiple levels

2015-12-07 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li reassigned YARN-4414: -- Assignee: Chang Li > Nodemanager connection errors are retried at multiple levels >

[jira] [Commented] (YARN-3863) Enhance filters in TimelineReader

2015-12-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044546#comment-15044546 ] Varun Saxena commented on YARN-3863: [~djp], sorry for replying so late to this comment. bq. Actually,

[jira] [Commented] (YARN-3542) Re-factor support for CPU as a resource using the new ResourceHandler mechanism

2015-12-07 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044562#comment-15044562 ] Sidharta Seethana commented on YARN-3542: - Given that one of the goals of this JIRA/patch is to

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-12-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044672#comment-15044672 ] Rohith Sharma K S commented on YARN-3456: - Committed to trunk/branch-2/branch-2.8 Thanks Varun for

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-12-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044693#comment-15044693 ] Varun Saxena commented on YARN-3456: Thanks [~rohithsharma] for the review and commit. > Improve

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-12-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044664#comment-15044664 ] Rohith Sharma K S commented on YARN-3456: - committing shortly > Improve handling of incomplete

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-12-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044638#comment-15044638 ] Hadoop QA commented on YARN-3456: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4427) NPE on handleNMContainerStatus when NM is registering to RM

2015-12-07 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044751#comment-15044751 ] Brahma Reddy Battula commented on YARN-4427: Marking as critical since {{Nodemanger}} will not

[jira] [Commented] (YARN-4381) Add container launchEvent and container localizeFailed metrics in container

2015-12-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044770#comment-15044770 ] Junping Du commented on YARN-4381: -- bq. That's NodeManagerMetrics#containersLaunched is not actually means

[jira] [Updated] (YARN-4427) NPE on handleNMContainerStatus when NM is registering to RM

2015-12-07 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-4427: --- Priority: Critical (was: Major) > NPE on handleNMContainerStatus when NM is

[jira] [Commented] (YARN-4381) Add container launchEvent and container localizeFailed metrics in container

2015-12-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044744#comment-15044744 ] Hadoop QA commented on YARN-4381: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4427) NPE on handleNMContainerStatus when NM is registering to RM

2015-12-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044775#comment-15044775 ] Rohith Sharma K S commented on YARN-4427: - IIUC, {{masterContainer}} never be null since NM is

[jira] [Commented] (YARN-4381) Add container launchEvent and container localizeFailed metrics in container

2015-12-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044740#comment-15044740 ] Junping Du commented on YARN-4381: -- Oh. I think there are some problem with Jenkins test kick off... Will

[jira] [Commented] (YARN-4424) YARN CLI command hangs

2015-12-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044804#comment-15044804 ] Rohith Sharma K S commented on YARN-4424: - very interesting!! From the thread dumps, I see that

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

2015-12-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045370#comment-15045370 ] Kuhu Shukla commented on YARN-4413: --- I see, so that answers my transition query, thanks [~templedf]. But

[jira] [Commented] (YARN-2882) Add ExecutionType to denote if a container execution is GUARANTEED or QUEUEABLE

2015-12-07 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046023#comment-15046023 ] Konstantinos Karanasos commented on YARN-2882: -- Thanks for the feedback, [~leftnoteasy]: bq.

[jira] [Commented] (YARN-4427) NPE on handleNMContainerStatus when NM is registering to RM

2015-12-07 Thread gu-chi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15044871#comment-15044871 ] gu-chi commented on YARN-4427: -- NM recovery is enabled, this is the precondition > NPE on

[jira] [Commented] (YARN-2885) Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers

2015-12-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046199#comment-15046199 ] Arun Suresh commented on YARN-2885: --- Thanks for the review [~leftnoteasy].. I understand your concerns

[jira] [Resolved] (YARN-4426) unhealthy disk makes NM LOST

2015-12-07 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee resolved YARN-4426. Resolution: Duplicate > unhealthy disk makes NM LOST > > > Key:

[jira] [Commented] (YARN-4426) unhealthy disk makes NM LOST

2015-12-07 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046203#comment-15046203 ] sandflee commented on YARN-4426: Thanks [~suda], they are caused by hanged mkdir > unhealthy disk makes NM

[jira] [Commented] (YARN-4418) AM Resource Limit per partition can be updated to ResourceUsage as well

2015-12-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046225#comment-15046225 ] Sunil G commented on YARN-4418: --- Thank you [~leftnoteasy] for clarifying the scenario. I still have one doubt

[jira] [Updated] (YARN-4301) NM disk health checker should have a timeout

2015-12-07 Thread Akihiro Suda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akihiro Suda updated YARN-4301: --- Attachment: YARN-4301-2.patch Attached YARN-4301-2.patch with a JUnit testcase. > NM disk health

[jira] [Commented] (YARN-4301) NM disk health checker should have a timeout

2015-12-07 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046252#comment-15046252 ] sandflee commented on YARN-4301: it maybe change the behaviour of NM_MIN_HEALTHY_DISKS_FRACTION, could we

[jira] [Assigned] (YARN-4196) Enhance ReservationAgent(s) to support node-label

2015-12-07 Thread Alexey Tumanov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Tumanov reassigned YARN-4196: Assignee: Alexey Tumanov > Enhance ReservationAgent(s) to support node-label >

[jira] [Assigned] (YARN-4194) Extend Reservation Definition Langauge (RDL) extensions to support node labels

2015-12-07 Thread Alexey Tumanov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Tumanov reassigned YARN-4194: Assignee: Alexey Tumanov > Extend Reservation Definition Langauge (RDL) extensions to

[jira] [Assigned] (YARN-4196) Enhance ReservationAgent(s) to support node-label

2015-12-07 Thread Alexey Tumanov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Tumanov reassigned YARN-4196: Assignee: (was: Alexey Tumanov) > Enhance ReservationAgent(s) to support node-label >

[jira] [Commented] (YARN-4157) Merge YARN-1197 back to trunk

2015-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045548#comment-15045548 ] Wangda Tan commented on YARN-4157: -- Hi [~Naganarasimha], This is a task and don't add new code, so I

[jira] [Commented] (YARN-4418) AM Resource Limit per partition can be updated to ResourceUsage as well

2015-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045543#comment-15045543 ] Wangda Tan commented on YARN-4418: -- [~sunilg], I'm not sure if we need to update am limit when called by

[jira] [Commented] (YARN-4431) Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM

2015-12-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045544#comment-15045544 ] Hadoop QA commented on YARN-4431: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3623) We should have a config to indicate the Timeline Service version

2015-12-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045609#comment-15045609 ] Sangjin Lee commented on YARN-3623: --- {quote} 4. Can raise new jira and handle REST interface support to

[jira] [Commented] (YARN-4392) ApplicationCreatedEvent event time resets after RM restart/failover

2015-12-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045649#comment-15045649 ] Xuan Gong commented on YARN-4392: - +1 lgtm. Checking this in > ApplicationCreatedEvent event time resets

[jira] [Commented] (YARN-4392) ApplicationCreatedEvent event time resets after RM restart/failover

2015-12-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045653#comment-15045653 ] Xuan Gong commented on YARN-4392: - Committed into trunk/branch-2. Thanks, Naganarasimha. And thanks Jason

[jira] [Commented] (YARN-4392) ApplicationCreatedEvent event time resets after RM restart/failover

2015-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045669#comment-15045669 ] Hudson commented on YARN-4392: -- FAILURE: Integrated in Hadoop-trunk-Commit #8933 (See

[jira] [Commented] (YARN-4422) Generic AHS sometimes doesn't show started, node, or logs on App page

2015-12-07 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045720#comment-15045720 ] Jonathan Eagles commented on YARN-4422: --- +1. Thanks, [~eepayne]. > Generic AHS sometimes doesn't

[jira] [Commented] (YARN-4422) Generic AHS sometimes doesn't show started, node, or logs on App page

2015-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045748#comment-15045748 ] Hudson commented on YARN-4422: -- FAILURE: Integrated in Hadoop-trunk-Commit #8934 (See

[jira] [Updated] (YARN-4432) yarn launch script works by chance

2015-12-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-4432: --- Component/s: scripts > yarn launch script works by chance > --

[jira] [Updated] (YARN-4432) yarn launch script works by chance

2015-12-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-4432: --- Description: The YARN launch script has (at least) three big problems: * Usage of env vars

[jira] [Commented] (YARN-4415) Scheduler Web Ui shows max capacity for the queue is 100% but when we submit application doesnt get assigned

2015-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045800#comment-15045800 ] Wangda Tan commented on YARN-4415: -- Thanks for looking at this issue, [~Naganarasimha]/[~xinxianyin]. I

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045810#comment-15045810 ] Hudson commented on YARN-4248: -- FAILURE: Integrated in Hadoop-trunk-Commit #8935 (See

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-12-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045828#comment-15045828 ] Carlo Curino commented on YARN-4248: Committed this to trunk/branch-2/branch-2.8. I will update the

[jira] [Updated] (YARN-3863) Enhance filters in TimelineReader

2015-12-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3863: --- Attachment: YARN-3863-feature-YARN-2928.wip.01.patch > Enhance filters in TimelineReader >

[jira] [Commented] (YARN-4392) ApplicationCreatedEvent event time resets after RM restart/failover

2015-12-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045878#comment-15045878 ] Hudson commented on YARN-4392: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #673 (See

[jira] [Commented] (YARN-4309) Add debug information to application logs when a container fails

2015-12-07 Thread Ivan Mitic (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045879#comment-15045879 ] Ivan Mitic commented on YARN-4309: -- Thanks [~vvasudev], the proposal and the patch look good overall. I

[jira] [Commented] (YARN-3946) Allow fetching exact reason as to why a submitted app is in ACCEPTED state in CS

2015-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045899#comment-15045899 ] Wangda Tan commented on YARN-3946: -- [~Naganarasimha], thanks for updating the patch. Some minor comments:

[jira] [Commented] (YARN-4309) Add debug information to application logs when a container fails

2015-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045907#comment-15045907 ] Wangda Tan commented on YARN-4309: -- [~vvasudev]. bq. The echo will end up being captured by the

[jira] [Commented] (YARN-3863) Enhance filters in TimelineReader

2015-12-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045932#comment-15045932 ] Hadoop QA commented on YARN-3863: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2882) Add ExecutionType to denote if a container execution is GUARANTEED or QUEUEABLE

2015-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045943#comment-15045943 ] Wangda Tan commented on YARN-2882: -- [~asuresh], sorry for my late response, few comments: 1) How about

[jira] [Commented] (YARN-4350) TestDistributedShell fails

2015-12-07 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045962#comment-15045962 ] Vrushali C commented on YARN-4350: -- Hi [~Naganarasimha] Is the patch 001 the latest patch? If we want to

[jira] [Commented] (YARN-1856) cgroups based memory monitoring for containers

2015-12-07 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045966#comment-15045966 ] Sidharta Seethana commented on YARN-1856: - Hi [~vvasudev], some comments below on the latest

[jira] [Commented] (YARN-4415) Scheduler Web Ui shows max capacity for the queue is 100% but when we submit application doesnt get assigned

2015-12-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045338#comment-15045338 ] Naganarasimha G R commented on YARN-4415: - Hi [~xinxianyin] Thanks for the feedback, but your

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045443#comment-15045443 ] Wangda Tan commented on YARN-1197: -- [~sershe], This will be an alpha feature in Hadoop 2.8. > Support

[jira] [Commented] (YARN-1856) cgroups based memory monitoring for containers

2015-12-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045515#comment-15045515 ] Hadoop QA commented on YARN-1856: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3305) AM-Used Resource for leafqueue is wrongly populated if AM ResourceRequest is less than minimumAllocation

2015-12-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046033#comment-15046033 ] ASF GitHub Bot commented on YARN-3305: -- Github user smarella commented on the pull request:

[jira] [Commented] (YARN-4348) ZKRMStateStore.syncInternal shouldn't wait for sync completion for avoiding blocking ZK's event thread

2015-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045402#comment-15045402 ] Jian He commented on YARN-4348: --- lgtm, thanks ! > ZKRMStateStore.syncInternal shouldn't wait for sync

[jira] [Updated] (YARN-4428) Redirect RM page to AHS page when AHS turned on and RM page is not avaialable

2015-12-07 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4428: --- Description: When AHS is turned on, if we can't view application in RM page, RM page should redirect us to

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-12-07 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045442#comment-15045442 ] Sergey Shelukhin commented on YARN-1197: Will this feature be usable in YARN/Hadoop 2.8? I see most

[jira] [Commented] (YARN-4309) Add debug information to application logs when a container fails

2015-12-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045444#comment-15045444 ] Hadoop QA commented on YARN-4309: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4431) Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM

2015-12-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4431: - Attachment: YARN-4431.patch Upload a patch which is quite stright-forward so no need a unit test. > Not

[jira] [Commented] (YARN-3368) Improve YARN web UI

2015-12-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046007#comment-15046007 ] Vinod Kumar Vavilapalli commented on YARN-3368: --- bq. In order to advance the work faster, I

[jira] [Commented] (YARN-4424) YARN CLI command hangs

2015-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045512#comment-15045512 ] Wangda Tan commented on YARN-4424: -- I also think remove readlock of getFinalApplicationStatus should

[jira] [Commented] (YARN-4428) Redirect RM page to AHS page when AHS turned on and RM page is not avaialable

2015-12-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045349#comment-15045349 ] Hadoop QA commented on YARN-4428: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-1856) cgroups based memory monitoring for containers

2015-12-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-1856: Attachment: YARN-1856.002.patch bq. Could you move these constants to CGroupsHandler ? There are

[jira] [Created] (YARN-4431) Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM

2015-12-07 Thread Junping Du (JIRA)
Junping Du created YARN-4431: Summary: Not necessary to do unRegisterNM() if NM get stop due to failed to connect to RM Key: YARN-4431 URL: https://issues.apache.org/jira/browse/YARN-4431 Project: Hadoop

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-12-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045438#comment-15045438 ] Chris Douglas commented on YARN-4248: - +1 lgtm If it's appropriate for this to go into 2.8, set the

[jira] [Comment Edited] (YARN-4309) Add debug information to application logs when a container fails

2015-12-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045432#comment-15045432 ] Allen Wittenauer edited comment on YARN-4309 at 12/7/15 6:51 PM: - (As a

[jira] [Commented] (YARN-4356) ensure the timeline service v.2 is disabled cleanly and has no impact when it's turned off

2015-12-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045528#comment-15045528 ] Sangjin Lee commented on YARN-4356: --- Thanks for your quick comments [~vrushalic]! bq. +1 on creating a

[jira] [Commented] (YARN-4418) AM Resource Limit per partition can be updated to ResourceUsage as well

2015-12-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045531#comment-15045531 ] Hadoop QA commented on YARN-4418: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

2015-12-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045333#comment-15045333 ] Kuhu Shukla commented on YARN-4413: --- Small comment on the patch, {code} new

[jira] [Commented] (YARN-4413) Nodes in the includes list should not be listed as decommissioned in the UI

2015-12-07 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045344#comment-15045344 ] Daniel Templeton commented on YARN-4413: [~kshukla], this patch is more for the UI. The point is

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

2015-12-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045420#comment-15045420 ] Kuhu Shukla commented on YARN-4311: --- {code}

[jira] [Commented] (YARN-4430) registry security validation can fail when downgrading to insecure would work

2015-12-07 Thread Jonathan Maron (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045386#comment-15045386 ] Jonathan Maron commented on YARN-4430: -- Given the nature of the underlying issue, the logging of the

[jira] [Commented] (YARN-4403) (AM/NM/Container)LivelinessMonitor should use monotonic time when calculating period

2015-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045461#comment-15045461 ] Jian He commented on YARN-4403: --- we can actually add a separate one ? > (AM/NM/Container)LivelinessMonitor

[jira] [Commented] (YARN-4432) yarn launch script works by chance

2015-12-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045477#comment-15045477 ] Allen Wittenauer commented on YARN-4432: See output of

[jira] [Created] (YARN-4432) yarn launch script works by chance

2015-12-07 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-4432: -- Summary: yarn launch script works by chance Key: YARN-4432 URL: https://issues.apache.org/jira/browse/YARN-4432 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-4424) YARN CLI command hangs

2015-12-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046277#comment-15046277 ] Jian He commented on YARN-4424: --- not related > YARN CLI command hangs > -- > >

[jira] [Commented] (YARN-4301) NM disk health checker should have a timeout

2015-12-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046319#comment-15046319 ] Hadoop QA commented on YARN-4301: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4348) ZKRMStateStore.syncInternal shouldn't wait for sync completion for avoiding blocking ZK's event thread

2015-12-07 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046332#comment-15046332 ] Tsuyoshi Ozawa commented on YARN-4348: -- Committed this to branch-2.7. Thanks [~jianhe] for reviewing

[jira] [Commented] (YARN-3996) YARN-789 (Support for zero capabilities in fairscheduler) is broken after YARN-3305

2015-12-07 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046055#comment-15046055 ] Hitesh Shah commented on YARN-3996: --- Why should a minimum resource of 0 be ever supported? > YARN-789

[jira] [Commented] (YARN-4157) Merge YARN-1197 back to trunk

2015-12-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046063#comment-15046063 ] Naganarasimha G R commented on YARN-4157: - Thanks for the clarification [~wangda], > Merge

[jira] [Commented] (YARN-4257) Move scheduler validateConf method to AbstractYarnScheduler and make it protected

2015-12-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046067#comment-15046067 ] Wangda Tan commented on YARN-4257: -- IMHO, minimum-allocation-mb shouldn't be zero in any cases. zero-sized

[jira] [Commented] (YARN-4425) Pluggable sharing policy for Partition Node Label resources

2015-12-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15046077#comment-15046077 ] Naganarasimha G R commented on YARN-4425: - [~wangda] & [~jianhe], can you share your opinion on

  1   2   >