[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681226#comment-14681226 ] Rohith Sharma K S commented on YARN-4041: - One correction in my previous comment,

[jira] [Commented] (YARN-3986) getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead

2015-08-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681237#comment-14681237 ] Rohith Sharma K S commented on YARN-3986: - This behavior is added in YARN-1041.

[jira] [Commented] (YARN-4035) Some tests in TestRMAdminService fails with NPE

2015-08-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681252#comment-14681252 ] Rohith Sharma K S commented on YARN-4035: - bq. given the patch all happens in

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681271#comment-14681271 ] Hudson commented on YARN-3887: -- FAILURE: Integrated in Hadoop-trunk-Commit #8282 (See

[jira] [Updated] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Attachment: YARN-3999.5.patch Fixing tests failures. RM hangs on draing events -

[jira] [Commented] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

2015-08-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680210#comment-14680210 ] Jason Lowe commented on YARN-4000: -- I don't believe changing a leaf queue into a parent

[jira] [Commented] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680329#comment-14680329 ] Hadoop QA commented on YARN-3975: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3940) Application moveToQueue should check NodeLabel permission

2015-08-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680272#comment-14680272 ] Bibin A Chundatt commented on YARN-3940: [~leftnoteasy] Any thoughts??

[jira] [Updated] (YARN-3937) Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM when a container is no longer to be preempted

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3937: -- Attachment: 0003-YARN-3937.patch Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM

[jira] [Updated] (YARN-3250) Support admin cli interface in for Application Priority

2015-08-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-3250: Attachment: 0002-YARN-3250.patch Thanks [~sunilg] for the review.. Updating the patch with

[jira] [Updated] (YARN-3937) Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM when a container is no longer to be preempted

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3937: -- Attachment: (was: 0003-YARN-3937.patch) Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify

[jira] [Updated] (YARN-3937) Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM when a container is no longer to be preempted

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3937: -- Attachment: 0003-YARN-3937.patch Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680294#comment-14680294 ] Sunil G commented on YARN-3212: --- Sorry. A typo. I meant TestRMAdminService. :) RMNode State

[jira] [Commented] (YARN-4035) Some tests in TestRMAdminService fails with NPE

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680331#comment-14680331 ] Junping Du commented on YARN-4035: -- Thanks [~gliptak] for working out a patch and

[jira] [Updated] (YARN-4029) LogAggregationStatus and Diagnostics value wrong after RM recovery

2015-08-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4029: --- Summary: LogAggregationStatus and Diagnostics value wrong after RM recovery (was:

[jira] [Updated] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-10 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-3975: Attachment: YARN-3975.3.patch Refined the patch. The test failure is not related to the patch. I tested it

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680275#comment-14680275 ] Hadoop QA commented on YARN-3212: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680292#comment-14680292 ] Sunil G commented on YARN-3212: --- Hi [~djp] Looks like test case failures are due to

[jira] [Updated] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3212: - Attachment: YARN-3212-v5.1.patch Fix the checkstyle/whitespace issues in 5.1 patch. Checked that the test

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680306#comment-14680306 ] Junping Du commented on YARN-3212: -- bq. Sorry. A typo. I meant TestRMAdminService. Thanks

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680230#comment-14680230 ] Sunil G commented on YARN-3873: --- Thank you [~leftnoteasy] for the comments. {code}

[jira] [Updated] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3216: -- Attachment: 0001-YARN-3216.patch Hi [~leftnoteasy] Attaching an initial version of work in progress patch. I

[jira] [Commented] (YARN-4031) Add JvmPauseMonitor to ApplicationHistoryServer and WebAppProxyServer

2015-08-10 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680416#comment-14680416 ] Robert Kanter commented on YARN-4031: - For the {{WebAppProxyServer}}, I think we should

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680396#comment-14680396 ] Li Lu commented on YARN-3814: - HI [~varun_saxena], any updates on this JIRA? Thanks! REST

[jira] [Commented] (YARN-3940) Application moveToQueue should check NodeLabel permission

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680538#comment-14680538 ] Wangda Tan commented on YARN-3940: -- [~bibinchundatt], Rethink about this, I think to make

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680393#comment-14680393 ] Li Lu commented on YARN-4025: - Hi [~sjlee0][~vrushalic], I slightly prefer to firstly move with

[jira] [Commented] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680408#comment-14680408 ] Wangda Tan commented on YARN-4000: -- +1 to what [~jlowe]'s suggestion, we should kill app

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680517#comment-14680517 ] Wangda Tan commented on YARN-3873: -- [~sunilg], Sorry I misread your patch. I think the

[jira] [Updated] (YARN-3986) getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead

2015-08-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3986: --- Attachment: YARN-3986.02.patch Fixed checkstyle issues getTransferredContainers in

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680388#comment-14680388 ] Sangjin Lee commented on YARN-4025: --- Thanks for the patch [~vrushalic]. I believe you

[jira] [Commented] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680442#comment-14680442 ] Sunil G commented on YARN-4000: --- Agreeing for killing apps when fail-fast is false. Also as

[jira] [Created] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4041: Summary: Slow delegation token renewal can severely prolong RM recovery Key: YARN-4041 URL: https://issues.apache.org/jira/browse/YARN-4041 Project: Hadoop YARN

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680450#comment-14680450 ] Sangjin Lee commented on YARN-4025: --- No, not really. I just wanted to understand the

[jira] [Commented] (YARN-4029) LogAggregationStatus and Diagnostics value wrong after RM recovery

2015-08-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680495#comment-14680495 ] Xuan Gong commented on YARN-4029: - Thanks for reporting this issue. bq. In state store we

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680515#comment-14680515 ] Jason Lowe commented on YARN-4041: -- The active apps already have the tokens and are

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680545#comment-14680545 ] Sangjin Lee commented on YARN-3045: --- Thanks for the update [~djp]. Just so we're all on

[jira] [Created] (YARN-4042) YARN registry should handle the absence of ZK node

2015-08-10 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created YARN-4042: -- Summary: YARN registry should handle the absence of ZK node Key: YARN-4042 URL: https://issues.apache.org/jira/browse/YARN-4042 Project: Hadoop YARN

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680410#comment-14680410 ] Sangjin Lee commented on YARN-4025: --- Went over the patch pretty quickly, and have some

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680430#comment-14680430 ] Vrushali C commented on YARN-4025: -- Thanks [~sjlee0] and [~gtCarrera9] I will rebase and

[jira] [Commented] (YARN-3986) getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680484#comment-14680484 ] Wangda Tan commented on YARN-3986: -- Patch LGTM, thanks [~varun_saxena]. [~xiaodike],

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680526#comment-14680526 ] Junping Du commented on YARN-3045: -- bq. Junping Du one more favor can you join us in slack

[jira] [Commented] (YARN-3986) getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead

2015-08-10 Thread Xiaodi Ke (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680213#comment-14680213 ] Xiaodi Ke commented on YARN-3986: - I also hit this problem when I practiced to write a

[jira] [Commented] (YARN-3937) Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM when a container is no longer to be preempted

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680289#comment-14680289 ] Sunil G commented on YARN-3937: --- Thank you [~leftnoteasy] for the comments. bq.there're

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680578#comment-14680578 ] Hadoop QA commented on YARN-3212: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-4043) Unnecessary warning message : an attempt to override final parameter:

2015-08-10 Thread Spandan Dutta (JIRA)
Spandan Dutta created YARN-4043: --- Summary: Unnecessary warning message : an attempt to override final parameter: Key: YARN-4043 URL: https://issues.apache.org/jira/browse/YARN-4043 Project: Hadoop YARN

[jira] [Commented] (YARN-4043) Unnecessary warning message : an attempt to override final parameter:

2015-08-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680655#comment-14680655 ] Allen Wittenauer commented on YARN-4043: Errr, isn't this the warning that users

[jira] [Commented] (YARN-4043) Unnecessary warning message : an attempt to override final parameter:

2015-08-10 Thread Spandan Dutta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680673#comment-14680673 ] Spandan Dutta commented on YARN-4043: - hmm. ryt. We could also change the LOG level to

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680744#comment-14680744 ] Junping Du commented on YARN-3212: -- The test failures are not related and get tracked in

[jira] [Updated] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3873: -- Attachment: 0006-YARN-3873.patch Thank you [~leftnoteasy]. Updating a patch addressing the comments..

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680620#comment-14680620 ] Sunil G commented on YARN-4041: --- Could we use an async way here and use

[jira] [Updated] (YARN-4043) Unnecessary warning message : an attempt to override final parameter:

2015-08-10 Thread Spandan Dutta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spandan Dutta updated YARN-4043: Attachment: warn-msg.patch Unnecessary warning message : an attempt to override final parameter:

[jira] [Updated] (YARN-3737) Add support for recovery of reserved apps (running under dynamic queues) to Fair Scheduler

2015-08-10 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3737: Assignee: Subru Krishnan (was: Anubhav Dhoot) Add support for recovery of reserved apps (running

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680670#comment-14680670 ] Varun Saxena commented on YARN-3814: Thanks for the review [~gtCarrera9]. Sorry hadn't

[jira] [Updated] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Summary: RM hangs on draing events (was: Add a timeout when drain the dispatcher) RM hangs on draing events

[jira] [Updated] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Description: If external systems like ATS, or ZK becomes very slow, draining all the events take a lot of time.

[jira] [Commented] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680795#comment-14680795 ] Wangda Tan commented on YARN-3931: -- Sorry for response late. Fix looks good, thanks

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680833#comment-14680833 ] Hadoop QA commented on YARN-3814: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-10 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-3975: Attachment: YARN-3975.4.patch Updated patch. Also fixed YarnClient and WebAppProxyServlet catching

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680778#comment-14680778 ] Li Lu commented on YARN-3814: - bq. We have a JIRA for aggregation implementation for reader

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680874#comment-14680874 ] Sangjin Lee commented on YARN-3045: --- Sounds good. Thanks. [Event producers] Implement

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680827#comment-14680827 ] Wangda Tan commented on YARN-3873: -- Looks good, committing... pendingApplications in

[jira] [Commented] (YARN-2369) Environment variable handling assumes values should be appended

2015-08-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680872#comment-14680872 ] Jason Lowe commented on YARN-2369: -- Sorry for the long delay, and thanks for your

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680754#comment-14680754 ] Hadoop QA commented on YARN-3873: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680806#comment-14680806 ] Hadoop QA commented on YARN-3999: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-2918) Don't fail RM if queue's configured labels are not existed in cluster-node-labels

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680812#comment-14680812 ] Wangda Tan commented on YARN-2918: -- [~dheeren], Sorry for the inconvenience. The label

[jira] [Commented] (YARN-4043) Unnecessary warning message : an attempt to override final parameter:

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680861#comment-14680861 ] Hadoop QA commented on YARN-4043: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680860#comment-14680860 ] Hudson commented on YARN-3873: -- FAILURE: Integrated in Hadoop-trunk-Commit #8280 (See

[jira] [Commented] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680891#comment-14680891 ] Jian He commented on YARN-3999: --- Thanks for reviewing the patch. Rohith. bq. For expire , the

[jira] [Updated] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Attachment: YARN-3999.4.patch uploaded a new patch. RM hangs on draing events -

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680907#comment-14680907 ] Jian He commented on YARN-4041: --- YARN-2010 was done to actually ignore the failure on token

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680920#comment-14680920 ] Li Lu commented on YARN-3906: - Latest patch LGTM. While it appears possible to remove some code

[jira] [Updated] (YARN-2894) When ACL's are enabled, if RM switches then application can not be viewed from web.

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2894: -- Labels: 2.6.1-candidate (was: ) When ACL's are enabled, if RM switches then

[jira] [Updated] (YARN-3990) AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3990: -- Labels: 2.6.1-candidate (was: ) AsyncDispatcher may overloaded with

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680935#comment-14680935 ] Jian He commented on YARN-3887: --- +1, [~rohithsharma], do you have any other comments

[jira] [Commented] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-10 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680943#comment-14680943 ] Mit Desai commented on YARN-3975: - The test does not fail for me. {noformat}

[jira] [Commented] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680916#comment-14680916 ] Hadoop QA commented on YARN-3975: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-2922) ConcurrentModificationException in CapacityScheduler's LeafQueue

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2922: -- Labels: 2.6.1-candidate (was: ) ConcurrentModificationException in

[jira] [Updated] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3487: -- Labels: 2.6.1-candidate (was: ) CapacityScheduler scheduler lock obtained

[jira] [Updated] (YARN-3011) NM dies because of the failure of resource localization

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3011: -- Labels: 2.6.1-candidate (was: ) NM dies because of the failure of resource

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680931#comment-14680931 ] Sangjin Lee commented on YARN-3906: --- Thanks for the review. Yes, I tried to reduce the

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680942#comment-14680942 ] Naganarasimha G R commented on YARN-3045: - Hi [~djp] [~sjlee0], I was in transit

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680904#comment-14680904 ] Jian He commented on YARN-4041: --- bq. I don't think the RM should blindly renew all tokens for

[jira] [Updated] (YARN-3733) Fix DominantRC#compare() does not work as expected if cluster resource is empty

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3733: -- Labels: 2.6.1-candidate (was: ) Fix DominantRC#compare() does not work as

[jira] [Updated] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3832: -- Labels: 2.6.1-candidate (was: ) Resource Localization fails on a cluster due

[jira] [Commented] (YARN-4035) Some tests in TestRMAdminService fails with NPE

2015-08-10 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680939#comment-14680939 ] Gabor Liptak commented on YARN-4035: [~rohithsharma] That is my attempt to make this

[jira] [Updated] (YARN-3999) Add a timeout when drain the dispatcher

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Attachment: YARN-3999.3.patch Add a timeout when drain the dispatcher ---

[jira] [Updated] (YARN-4043) Unnecessary warning message : an attempt to override final parameter:

2015-08-10 Thread Spandan Dutta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spandan Dutta updated YARN-4043: Attachment: warn-msg.patch Unnecessary warning message : an attempt to override final parameter:

[jira] [Updated] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3814: --- Attachment: YARN-3814-YARN-2928.04.patch REST API implementation for getting raw entities in

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680699#comment-14680699 ] Junping Du commented on YARN-3045: -- [~sjlee0], there is no further big issues but still

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680731#comment-14680731 ] Wangda Tan commented on YARN-4002: -- [~xinxianyin], YARN-3091 is mostly for grouping all RM

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681217#comment-14681217 ] Rohith Sharma K S commented on YARN-4041: - Recently in test cluster faced the

[jira] [Commented] (YARN-4043) Unnecessary warning message : an attempt to override final parameter:

2015-08-10 Thread Spandan Dutta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680693#comment-14680693 ] Spandan Dutta commented on YARN-4043: - sorry for the typo above. Replace the level of

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14680730#comment-14680730 ] Jason Lowe commented on YARN-4041: -- Maybe. The synchronous recovery was added as part of

[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container

2015-08-10 Thread Gagan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681141#comment-14681141 ] Gagan commented on YARN-4037: - Hi Xuan, Could you please confirm upon the points mentioned in

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681029#comment-14681029 ] Li Lu commented on YARN-3814: - Hi [~varun_saxena], thanks for the work. I've gone through the

[jira] [Assigned] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-4041: - Assignee: Sunil G Slow delegation token renewal can severely prolong RM recovery

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681048#comment-14681048 ] Sunil G commented on YARN-4041: --- I wud like to take this. [~jlowe] cud I take over this.

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681059#comment-14681059 ] Rohith Sharma K S commented on YARN-3887: - +1 lgtm Support for changing

[jira] [Commented] (YARN-4039) New AM instances waste resource by waiting only for resource availability when all available resources are already used

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679746#comment-14679746 ] Hadoop QA commented on YARN-4039: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-4029) LogAggregationStatus and Diagnostics value wrong after RM switch

2015-08-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679826#comment-14679826 ] Bibin A Chundatt commented on YARN-4029: *Diagnostics value null on recovery* In

  1   2   >