[jira] [Commented] (YARN-3999) Add a timeout when drain the dispatcher

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679673#comment-14679673 ] Hadoop QA commented on YARN-3999: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3999) Add a timeout when drain the dispatcher

2015-08-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679679#comment-14679679 ] Rohith Sharma K S commented on YARN-3999: - thanks [~jianhe] for the patch, I have s

[jira] [Created] (YARN-4039) New AM instances waste resource by waiting only for resource availability when all available resources are already used

2015-08-10 Thread Sadayuki Furuhashi (JIRA)
Sadayuki Furuhashi created YARN-4039: Summary: New AM instances waste resource by waiting only for resource availability when all available resources are already used Key: YARN-4039 URL: https://issues.apache.

[jira] [Updated] (YARN-4039) New AM instances waste resource by waiting only for resource availability when all available resources are already used

2015-08-10 Thread Sadayuki Furuhashi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sadayuki Furuhashi updated YARN-4039: - Attachment: YARN-4039.1.patch > New AM instances waste resource by waiting only for resourc

[jira] [Updated] (YARN-4039) New AM instances waste resource by waiting only for resource availability when all available resources are already used

2015-08-10 Thread Sadayuki Furuhashi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sadayuki Furuhashi updated YARN-4039: - Description: Problem: In FairScheduler, maxRunningApps doesn't work well if we can't predic

[jira] [Updated] (YARN-4039) New AM instances waste resource by waiting only for resource availability when all available resources are already used

2015-08-10 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-4039: - Assignee: Sadayuki Furuhashi > New AM instances waste resource by waiting only for resource availab

[jira] [Commented] (YARN-4039) New AM instances waste resource by waiting only for resource availability when all available resources are already used

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679746#comment-14679746 ] Hadoop QA commented on YARN-4039: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-4029) LogAggregationStatus and Diagnostics value wrong after RM switch

2015-08-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679826#comment-14679826 ] Bibin A Chundatt commented on YARN-4029: *Diagnostics value null on recovery* In {

[jira] [Created] (YARN-4040) container complete msg should passed to AM,even if the container is released.

2015-08-10 Thread sandflee (JIRA)
sandflee created YARN-4040: -- Summary: container complete msg should passed to AM,even if the container is released. Key: YARN-4040 URL: https://issues.apache.org/jira/browse/YARN-4040 Project: Hadoop YARN

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680137#comment-14680137 ] Sunil G commented on YARN-3887: --- Test failures are unrelated to this patch. > Support for ch

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680139#comment-14680139 ] Sunil G commented on YARN-4023: --- YARN-4035 is the correct issue. By mistake i gave wrong one

[jira] [Updated] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3212: - Attachment: YARN-3212-v5.patch Update the patch to v5 with fixing following issues: - The unit test failure

[jira] [Updated] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-10 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-3975: Attachment: YARN-3975.3.patch Refined the patch. The test failure is not related to the patch. I tested it o

[jira] [Commented] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

2015-08-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680210#comment-14680210 ] Jason Lowe commented on YARN-4000: -- I don't believe changing a leaf queue into a parent qu

[jira] [Commented] (YARN-3986) getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead

2015-08-10 Thread Xiaodi Ke (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680213#comment-14680213 ] Xiaodi Ke commented on YARN-3986: - I also hit this problem when I practiced to write a simp

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680230#comment-14680230 ] Sunil G commented on YARN-3873: --- Thank you [~leftnoteasy] for the comments. {code} set

[jira] [Commented] (YARN-3940) Application moveToQueue should check NodeLabel permission

2015-08-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680272#comment-14680272 ] Bibin A Chundatt commented on YARN-3940: [~leftnoteasy] Any thoughts?? > Applicati

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680275#comment-14680275 ] Hadoop QA commented on YARN-3212: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3937) Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM when a container is no longer to be preempted

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680289#comment-14680289 ] Sunil G commented on YARN-3937: --- Thank you [~leftnoteasy] for the comments. bq.there're alway

[jira] [Updated] (YARN-3937) Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM when a container is no longer to be preempted

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3937: -- Attachment: 0003-YARN-3937.patch > Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM

[jira] [Updated] (YARN-3937) Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM when a container is no longer to be preempted

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3937: -- Attachment: (was: 0003-YARN-3937.patch) > Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Schedu

[jira] [Updated] (YARN-3937) Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM when a container is no longer to be preempted

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3937: -- Attachment: 0003-YARN-3937.patch > Introducing REMOVE_CONTAINER_FROM_PREEMPTION event to notify Scheduler and AM

[jira] [Updated] (YARN-3250) Support admin cli interface in for Application Priority

2015-08-10 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-3250: Attachment: 0002-YARN-3250.patch Thanks [~sunilg] for the review.. Updating the patch with re

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680292#comment-14680292 ] Sunil G commented on YARN-3212: --- Hi [~djp] Looks like test case failures are due to TestRMCon

[jira] [Updated] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3212: - Attachment: YARN-3212-v5.1.patch Fix the checkstyle/whitespace issues in 5.1 patch. Checked that the test

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680294#comment-14680294 ] Sunil G commented on YARN-3212: --- Sorry. A typo. I meant TestRMAdminService. :) > RMNode Stat

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680306#comment-14680306 ] Junping Du commented on YARN-3212: -- bq. Sorry. A typo. I meant TestRMAdminService. Thanks

[jira] [Commented] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680329#comment-14680329 ] Hadoop QA commented on YARN-3975: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-4035) Some tests in TestRMAdminService fails with NPE

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680331#comment-14680331 ] Junping Du commented on YARN-4035: -- Thanks [~gliptak] for working out a patch and [~rohith

[jira] [Updated] (YARN-4029) LogAggregationStatus and Diagnostics value wrong after RM recovery

2015-08-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4029: --- Summary: LogAggregationStatus and Diagnostics value wrong after RM recovery (was: LogAggregati

[jira] [Updated] (YARN-3986) getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead

2015-08-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3986: --- Attachment: YARN-3986.02.patch Fixed checkstyle issues > getTransferredContainers in AbstractYarnSched

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680388#comment-14680388 ] Sangjin Lee commented on YARN-4025: --- Thanks for the patch [~vrushalic]. I believe you nee

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680393#comment-14680393 ] Li Lu commented on YARN-4025: - Hi [~sjlee0][~vrushalic], I slightly prefer to firstly move with

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680396#comment-14680396 ] Li Lu commented on YARN-3814: - HI [~varun_saxena], any updates on this JIRA? Thanks! > REST A

[jira] [Commented] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680408#comment-14680408 ] Wangda Tan commented on YARN-4000: -- +1 to what [~jlowe]'s suggestion, we should kill app (

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680410#comment-14680410 ] Sangjin Lee commented on YARN-4025: --- Went over the patch pretty quickly, and have some hi

[jira] [Updated] (YARN-3216) Max-AM-Resource-Percentage should respect node labels

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3216: -- Attachment: 0001-YARN-3216.patch Hi [~leftnoteasy] Attaching an initial version of work in progress patch. I used

[jira] [Commented] (YARN-4031) Add JvmPauseMonitor to ApplicationHistoryServer and WebAppProxyServer

2015-08-10 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680416#comment-14680416 ] Robert Kanter commented on YARN-4031: - For the {{WebAppProxyServer}}, I think we should

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680430#comment-14680430 ] Vrushali C commented on YARN-4025: -- Thanks [~sjlee0] and [~gtCarrera9] I will rebase and

[jira] [Commented] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680442#comment-14680442 ] Sunil G commented on YARN-4000: --- Agreeing for killing apps when fail-fast is false. Also as [

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680450#comment-14680450 ] Sangjin Lee commented on YARN-4025: --- No, not really. I just wanted to understand the situ

[jira] [Commented] (YARN-3986) getTransferredContainers in AbstractYarnScheduler should be present in YarnScheduler interface instead

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680484#comment-14680484 ] Wangda Tan commented on YARN-3986: -- Patch LGTM, thanks [~varun_saxena]. [~xiaodike], IMHO

[jira] [Commented] (YARN-4029) LogAggregationStatus and Diagnostics value wrong after RM recovery

2015-08-10 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680495#comment-14680495 ] Xuan Gong commented on YARN-4029: - Thanks for reporting this issue. bq. In state store we a

[jira] [Created] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-4041: Summary: Slow delegation token renewal can severely prolong RM recovery Key: YARN-4041 URL: https://issues.apache.org/jira/browse/YARN-4041 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680515#comment-14680515 ] Jason Lowe commented on YARN-4041: -- The active apps already have the tokens and are runnin

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680517#comment-14680517 ] Wangda Tan commented on YARN-3873: -- [~sunilg], Sorry I misread your patch. I think the pat

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680526#comment-14680526 ] Junping Du commented on YARN-3045: -- bq. Junping Du one more favor can you join us in slack

[jira] [Commented] (YARN-3940) Application moveToQueue should check NodeLabel permission

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680538#comment-14680538 ] Wangda Tan commented on YARN-3940: -- [~bibinchundatt], Rethink about this, I think to make

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680545#comment-14680545 ] Sangjin Lee commented on YARN-3045: --- Thanks for the update [~djp]. Just so we're all on t

[jira] [Created] (YARN-4042) YARN registry should handle the absence of ZK node

2015-08-10 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created YARN-4042: -- Summary: YARN registry should handle the absence of ZK node Key: YARN-4042 URL: https://issues.apache.org/jira/browse/YARN-4042 Project: Hadoop YARN Issu

[jira] [Updated] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3873: -- Attachment: 0006-YARN-3873.patch Thank you [~leftnoteasy]. Updating a patch addressing the comments.. > pendingA

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680578#comment-14680578 ] Hadoop QA commented on YARN-3212: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3737) Add support for recovery of reserved apps (running under dynamic queues) to Fair Scheduler

2015-08-10 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3737: Assignee: Subru Krishnan (was: Anubhav Dhoot) > Add support for recovery of reserved apps (running u

[jira] [Updated] (YARN-3999) Add a timeout when drain the dispatcher

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Attachment: YARN-3999.3.patch > Add a timeout when drain the dispatcher > ---

[jira] [Created] (YARN-4043) Unnecessary warning message : "an attempt to override final parameter:"

2015-08-10 Thread Spandan Dutta (JIRA)
Spandan Dutta created YARN-4043: --- Summary: Unnecessary warning message : "an attempt to override final parameter:" Key: YARN-4043 URL: https://issues.apache.org/jira/browse/YARN-4043 Project: Hadoop YAR

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680620#comment-14680620 ] Sunil G commented on YARN-4041: --- Could we use an async way here and use {{DelegationTokenRene

[jira] [Updated] (YARN-4043) Unnecessary warning message : "an attempt to override final parameter:"

2015-08-10 Thread Spandan Dutta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spandan Dutta updated YARN-4043: Attachment: warn-msg.patch > Unnecessary warning message : "an attempt to override final parameter:"

[jira] [Commented] (YARN-4043) Unnecessary warning message : "an attempt to override final parameter:"

2015-08-10 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680655#comment-14680655 ] Allen Wittenauer commented on YARN-4043: Errr, isn't this the warning that users se

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680670#comment-14680670 ] Varun Saxena commented on YARN-3814: Thanks for the review [~gtCarrera9]. Sorry hadn't

[jira] [Commented] (YARN-4043) Unnecessary warning message : "an attempt to override final parameter:"

2015-08-10 Thread Spandan Dutta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680673#comment-14680673 ] Spandan Dutta commented on YARN-4043: - hmm. ryt. We could also change the LOG level to

[jira] [Updated] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3814: --- Attachment: YARN-3814-YARN-2928.04.patch > REST API implementation for getting raw entities in Timeline

[jira] [Updated] (YARN-4043) Unnecessary warning message : "an attempt to override final parameter:"

2015-08-10 Thread Spandan Dutta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spandan Dutta updated YARN-4043: Attachment: warn-msg.patch > Unnecessary warning message : "an attempt to override final parameter:"

[jira] [Commented] (YARN-4043) Unnecessary warning message : "an attempt to override final parameter:"

2015-08-10 Thread Spandan Dutta (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680693#comment-14680693 ] Spandan Dutta commented on YARN-4043: - sorry for the typo above. Replace the level of t

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680699#comment-14680699 ] Junping Du commented on YARN-3045: -- [~sjlee0], there is no further big issues but still le

[jira] [Updated] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Summary: RM hangs on draing events (was: Add a timeout when drain the dispatcher) > RM hangs on draing events >

[jira] [Updated] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Description: If external systems like ATS, or ZK becomes very slow, draining all the events take a lot of time.

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680730#comment-14680730 ] Jason Lowe commented on YARN-4041: -- Maybe. The synchronous recovery was added as part of

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680731#comment-14680731 ] Wangda Tan commented on YARN-4002: -- [~xinxianyin], YARN-3091 is mostly for grouping all RM

[jira] [Commented] (YARN-3212) RMNode State Transition Update with DECOMMISSIONING state

2015-08-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680744#comment-14680744 ] Junping Du commented on YARN-3212: -- The test failures are not related and get tracked in Y

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680754#comment-14680754 ] Hadoop QA commented on YARN-3873: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-10 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-3975: Attachment: YARN-3975.4.patch Updated patch. Also fixed YarnClient and WebAppProxyServlet catching YarnExcep

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680778#comment-14680778 ] Li Lu commented on YARN-3814: - bq. We have a JIRA for aggregation implementation for reader sid

[jira] [Commented] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680795#comment-14680795 ] Wangda Tan commented on YARN-3931: -- Sorry for response late. Fix looks good, thanks [~kyun

[jira] [Commented] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680806#comment-14680806 ] Hadoop QA commented on YARN-3999: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-2918) Don't fail RM if queue's configured labels are not existed in cluster-node-labels

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680812#comment-14680812 ] Wangda Tan commented on YARN-2918: -- [~dheeren], Sorry for the inconvenience. The label whe

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680827#comment-14680827 ] Wangda Tan commented on YARN-3873: -- Looks good, committing... > pendingApplications in Le

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680833#comment-14680833 ] Hadoop QA commented on YARN-3814: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3873) pendingApplications in LeafQueue should also use OrderingPolicy

2015-08-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680860#comment-14680860 ] Hudson commented on YARN-3873: -- FAILURE: Integrated in Hadoop-trunk-Commit #8280 (See [https:

[jira] [Commented] (YARN-4043) Unnecessary warning message : "an attempt to override final parameter:"

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680861#comment-14680861 ] Hadoop QA commented on YARN-4043: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-2369) Environment variable handling assumes values should be appended

2015-08-10 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680872#comment-14680872 ] Jason Lowe commented on YARN-2369: -- Sorry for the long delay, and thanks for your patience

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680874#comment-14680874 ] Sangjin Lee commented on YARN-3045: --- Sounds good. Thanks. > [Event producers] Implement

[jira] [Updated] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3999: -- Attachment: YARN-3999.4.patch uploaded a new patch. > RM hangs on draing events > - > >

[jira] [Commented] (YARN-3999) RM hangs on draing events

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680891#comment-14680891 ] Jian He commented on YARN-3999: --- Thanks for reviewing the patch. Rohith. bq. For expire , the

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680904#comment-14680904 ] Jian He commented on YARN-4041: --- bq. I don't think the RM should blindly renew all tokens for

[jira] [Commented] (YARN-4041) Slow delegation token renewal can severely prolong RM recovery

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680907#comment-14680907 ] Jian He commented on YARN-4041: --- YARN-2010 was done to actually ignore the failure on token r

[jira] [Commented] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-10 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680916#comment-14680916 ] Hadoop QA commented on YARN-3975: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680920#comment-14680920 ] Li Lu commented on YARN-3906: - Latest patch LGTM. While it appears possible to remove some code

[jira] [Updated] (YARN-2922) ConcurrentModificationException in CapacityScheduler's LeafQueue

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2922: -- Labels: 2.6.1-candidate (was: ) > ConcurrentModificationException in CapacitySch

[jira] [Updated] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily when calling getQueue

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3487: -- Labels: 2.6.1-candidate (was: ) > CapacityScheduler scheduler lock obtained unne

[jira] [Updated] (YARN-3011) NM dies because of the failure of resource localization

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3011: -- Labels: 2.6.1-candidate (was: ) > NM dies because of the failure of resource loc

[jira] [Updated] (YARN-3832) Resource Localization fails on a cluster due to existing cache directories

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3832: -- Labels: 2.6.1-candidate (was: ) > Resource Localization fails on a cluster due t

[jira] [Updated] (YARN-3733) Fix DominantRC#compare() does not work as expected if cluster resource is empty

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3733: -- Labels: 2.6.1-candidate (was: ) > Fix DominantRC#compare() does not work as expe

[jira] [Updated] (YARN-3990) AsyncDispatcher may overloaded with RMAppNodeUpdateEvent when Node is connected/disconnected

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3990: -- Labels: 2.6.1-candidate (was: ) > AsyncDispatcher may overloaded with RMAppNodeU

[jira] [Updated] (YARN-2865) Application recovery continuously fails with "Application with id already present. Cannot duplicate"

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2865: -- Labels: 2.6.1-candidate (was: ) > Application recovery continuously fails with "

[jira] [Updated] (YARN-2894) When ACL's are enabled, if RM switches then application can not be viewed from web.

2015-08-10 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-2894: -- Labels: 2.6.1-candidate (was: ) > When ACL's are enabled, if RM switches then ap

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680931#comment-14680931 ] Sangjin Lee commented on YARN-3906: --- Thanks for the review. Yes, I tried to reduce the co

[jira] [Commented] (YARN-3887) Support for changing Application priority during runtime

2015-08-10 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680935#comment-14680935 ] Jian He commented on YARN-3887: --- +1, [~rohithsharma], do you have any other comments > Suppo

[jira] [Commented] (YARN-4035) Some tests in TestRMAdminService fails with NPE

2015-08-10 Thread Gabor Liptak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680939#comment-14680939 ] Gabor Liptak commented on YARN-4035: [~rohithsharma] That is my attempt to make this "s

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-10 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680942#comment-14680942 ] Naganarasimha G R commented on YARN-3045: - Hi [~djp] & [~sjlee0], I was in transit

[jira] [Commented] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-10 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680943#comment-14680943 ] Mit Desai commented on YARN-3975: - The test does not fail for me. {noformat} localhost:had

  1   2   >