[jira] [Commented] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585709#comment-14585709 ] Bibin A Chundatt commented on YARN-3789: [~devaraj.k] Thnks for review . Seems you

[jira] [Updated] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2015-06-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-1042: -- Attachment: YARN-1042.002.patch add ability to specify affinity/anti-affinity in container requests

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585660#comment-14585660 ] Bibin A Chundatt commented on YARN-3804: Can we check for AccessControlException

[jira] [Commented] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

2015-06-15 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585676#comment-14585676 ] Naganarasimha G R commented on YARN-3792: - * Test case reported is not due to this

[jira] [Commented] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-15 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585664#comment-14585664 ] Rohith commented on YARN-3789: -- +1(non-binding) Refactor logs for

[jira] [Created] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-15 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3804: -- Summary: Both RM are on standBy state when kerberos user not in yarn.admin.acl Key: YARN-3804 URL: https://issues.apache.org/jira/browse/YARN-3804 Project:

[jira] [Commented] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-15 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585735#comment-14585735 ] Devaraj K commented on YARN-3789: - I had a look into the 0003-YARN-3789.patch previously,

[jira] [Commented] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-15 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585685#comment-14585685 ] Devaraj K commented on YARN-3789: - Thanks [~bibinchundatt] for the patch. 1. {code:xml}

[jira] [Commented] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585855#comment-14585855 ] Tsuyoshi Ozawa commented on YARN-3798: -- Thanks [~zxu] for your explanation. I also

[jira] [Commented] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585897#comment-14585897 ] Tsuyoshi Ozawa commented on YARN-3798: -- 5. [ZKRMStateStore] ZKRMStateStore uses new

[jira] [Updated] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3789: --- Attachment: 0005-YARN-3789.patch [~devaraj.k] i have removed unused {{import

[jira] [Commented] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585891#comment-14585891 ] Tsuyoshi Ozawa commented on YARN-3798: -- {quote} while current code looks good to me.

[jira] [Commented] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586174#comment-14586174 ] Bibin A Chundatt commented on YARN-3789: Looked at the precommit build results.

[jira] [Commented] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586161#comment-14586161 ] Hadoop QA commented on YARN-3789: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586139#comment-14586139 ] MENG DING commented on YARN-1197: - Had a very good discussion with [~leftnoteasy] at the

[jira] [Commented] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

2015-06-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586128#comment-14586128 ] Junping Du commented on YARN-3792: -- Thanks [~Naganarasimha] for delivering the patch to

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2015-06-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585494#comment-14585494 ] Weiwei Yang commented on YARN-1042: --- Hi Steve From your comments, I think you want yarn

[jira] [Commented] (YARN-3711) Documentation of ResourceManager HA should explain configurations about listen addresses

2015-06-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587389#comment-14587389 ] Masatake Iwasaki commented on YARN-3711: Thanks, [~ozawa]! Documentation of

[jira] [Created] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-15 Thread Wei Shao (JIRA)
Wei Shao created YARN-3806: -- Summary: Proposal of Generic Scheduling Framework for YARN Key: YARN-3806 URL: https://issues.apache.org/jira/browse/YARN-3806 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

2015-06-15 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3808: --- Attachment: ProposalOfTimeBasedFairSchedulingForYARN-V1.0.pdf Proposal of Time Based Fair Scheduling for YARN

[jira] [Created] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-15 Thread Jun Gong (JIRA)
Jun Gong created YARN-3809: -- Summary: Failed to launch new attempts because ApplicationMasterLauncher's threads all hang Key: YARN-3809 URL: https://issues.apache.org/jira/browse/YARN-3809 Project: Hadoop

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-15 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3706-YARN-2928.013.patch Thanks for the review [~sjlee0], all your comments

[jira] [Commented] (YARN-3801) [JDK-8][YARN-2928] Exclude jdk.tools from hbase-client and hbase-testing-util

2015-06-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587233#comment-14587233 ] Sangjin Lee commented on YARN-3801: --- +1 from me. Although it's bit early for JDK 8, we

[jira] [Commented] (YARN-3711) Documentation of ResourceManager HA should explain about webapp address configuration

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587262#comment-14587262 ] Tsuyoshi Ozawa commented on YARN-3711: -- +1, commtting this shortly. Documentation of

[jira] [Updated] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3798: - Affects Version/s: 2.7.0 RM shutdown with NoNode exception while updating appAttempt on zk

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587275#comment-14587275 ] Bibin A Chundatt commented on YARN-3804: [~vinodkv] {quote}Allow the daemon user to

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-06-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587297#comment-14587297 ] Xuan Gong commented on YARN-433: remove LaunchedTransition from RMContainerImpl, and move to

[jira] [Commented] (YARN-3709) RM Web UI AM link shown before MRAppMaster launch

2015-06-15 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587391#comment-14587391 ] Weiwei Yang commented on YARN-3709: --- I don't think this is a bug. Once an application is

[jira] [Commented] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-15 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587402#comment-14587402 ] Devaraj K commented on YARN-3789: - Thanks [~bibinchundatt] for the updated patch. It looks

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

2015-06-15 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Description: This proposal talks about limitations of the YARN scheduling policies for SLA applications, and

[jira] [Updated] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

2015-06-15 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3806: --- Attachment: ProposalOfGenericSchedulingFrameworkForYARN-V1.0.pdf Proposal of Generic Scheduling Framework for

[jira] [Commented] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587465#comment-14587465 ] Tsuyoshi Ozawa commented on YARN-3798: -- Thanks! RM shutdown with NoNode exception

[jira] [Updated] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3798: - Priority: Blocker (was: Major) RM shutdown with NoNode exception while updating appAttempt on zk

[jira] [Updated] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3798: - Target Version/s: 2.7.1 RM shutdown with NoNode exception while updating appAttempt on zk

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

2015-06-15 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587370#comment-14587370 ] Chun Chen commented on YARN-1983: - [~vinodkv], according to your suggestion, I propose the

[jira] [Created] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

2015-06-15 Thread Wei Shao (JIRA)
Wei Shao created YARN-3807: -- Summary: Proposal of Guaranteed Capacity Scheduling for YARN Key: YARN-3807 URL: https://issues.apache.org/jira/browse/YARN-3807 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3711) Documentation of ResourceManager HA should explain configurations about listen addresses

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587346#comment-14587346 ] Tsuyoshi Ozawa commented on YARN-3711: -- Committed this to trunk, branch-2, and

[jira] [Commented] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-15 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587412#comment-14587412 ] Rohith commented on YARN-3789: -- Looks good to me too.. Refactor logs for

[jira] [Created] (YARN-3808) Proposal of Time Based Fair Scheduling for YARN

2015-06-15 Thread Wei Shao (JIRA)
Wei Shao created YARN-3808: -- Summary: Proposal of Time Based Fair Scheduling for YARN Key: YARN-3808 URL: https://issues.apache.org/jira/browse/YARN-3808 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587241#comment-14587241 ] Bibin A Chundatt commented on YARN-3798: [~ozawa] Hadoop version 2.7.0 and ZK 3.5.0

[jira] [Updated] (YARN-3711) Documentation of ResourceManager HA should explain configurations about listen addresses

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsuyoshi Ozawa updated YARN-3711: - Summary: Documentation of ResourceManager HA should explain configurations about listen addresses

[jira] [Commented] (YARN-3711) Documentation of ResourceManager HA should explain configurations about listen addresses

2015-06-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587292#comment-14587292 ] Hudson commented on YARN-3711: -- FAILURE: Integrated in Hadoop-trunk-Commit #8023 (See

[jira] [Updated] (YARN-3807) Proposal of Guaranteed Capacity Scheduling for YARN

2015-06-15 Thread Wei Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Shao updated YARN-3807: --- Attachment: ProposalOfGuaranteedCapacitySchedulingForYARN-V1.0.pdf Proposal of Guaranteed Capacity Scheduling

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586249#comment-14586249 ] Sandy Ryza commented on YARN-1197: -- Sorry, I've been quiet here for a while, but I'd be

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586455#comment-14586455 ] Vinod Kumar Vavilapalli commented on YARN-1197: --- bq. We all agreed that due

[jira] [Assigned] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3804: -- Assignee: Varun Saxena Both RM are on standBy state when kerberos user not in yarn.admin.acl

[jira] [Updated] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3804: -- Priority: Critical (was: Major) Target Version/s: 2.8.0, 2.7.1

[jira] [Commented] (YARN-1012) Report NM aggregated container resource utilization in heartbeat

2015-06-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586451#comment-14586451 ] Hadoop QA commented on YARN-1012: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3802) Two RMNodes for the same NodeId are used in RM sometimes after NM is reconnected.

2015-06-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586507#comment-14586507 ] Xuan Gong commented on YARN-3802: - [~zxu] The patch looks good overall. One nit: Could you

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-15 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586363#comment-14586363 ] Joep Rottinghuis commented on YARN-3706: This patch is ready for review.

[jira] [Commented] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586307#comment-14586307 ] Varun Saxena commented on YARN-3798: ZK version is {{3.5}} I think RM shutdown with

[jira] [Commented] (YARN-3714) AM proxy filter can not get proper default proxy address if RM-HA is enabled

2015-06-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586263#comment-14586263 ] Hadoop QA commented on YARN-3714: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586360#comment-14586360 ] Varun Saxena commented on YARN-3798: [~ozawa], thanks for your explanation. This

[jira] [Commented] (YARN-3714) AM proxy filter can not get proper default proxy address if RM-HA is enabled

2015-06-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586377#comment-14586377 ] Xuan Gong commented on YARN-3714: - bq. HAUtil.verifyAndSetConfiguration works only on the

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586281#comment-14586281 ] Wangda Tan commented on YARN-1197: -- [~sandyr], Thanks for coming back :). I'm not very

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586286#comment-14586286 ] Wangda Tan commented on YARN-1197: -- Sparking-Spark Support changing resources of an

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586285#comment-14586285 ] Wangda Tan commented on YARN-1197: -- Sparking-Spark Support changing resources of an

[jira] [Updated] (YARN-1012) Report NM aggregated container resource utilization in heartbeat

2015-06-15 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-1012: -- Attachment: YARN-1012-8.patch Report aggregated utilization. Report NM aggregated container resource

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586645#comment-14586645 ] Xuan Gong commented on YARN-3804: - I am OK with that. In transitionToActive(), we are

[jira] [Commented] (YARN-3803) Application hangs after more then one localization attempt fails on the same NM

2015-06-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586582#comment-14586582 ] Karthik Kambatla commented on YARN-3803: This seems like a serious issue. Any

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586610#comment-14586610 ] Jian He commented on YARN-3804: --- +1 for 2) Not too much point having RM to depend on the

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586676#comment-14586676 ] Wangda Tan commented on YARN-3804: -- There's a inconsistent check in current code path: -

[jira] [Commented] (YARN-3803) Application hangs after more then one localization attempt fails on the same NM

2015-06-15 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586675#comment-14586675 ] Yuliya Feldman commented on YARN-3803: -- [~kasha] It happens only if you have single

[jira] [Commented] (YARN-3469) ZKRMStateStore: Avoid setting watches that are not required

2015-06-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586586#comment-14586586 ] Karthik Kambatla commented on YARN-3469: 2.8 uses Curator and all watch handling is

[jira] [Commented] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587247#comment-14587247 ] Tsuyoshi Ozawa commented on YARN-3798: -- Thank you for the sharing, Bibin. Marking this

[jira] [Updated] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-06-15 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-433: --- Attachment: YARN-433.1.patch When RM is catching up with node updates then it should not expire acquired

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-06-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587425#comment-14587425 ] Hadoop QA commented on YARN-433: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-3801) [JDK-8][YARN-2928] Exclude jdk.tools from hbase-client and hbase-testing-util

2015-06-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587424#comment-14587424 ] Zhijie Shen commented on YARN-3801: --- +1, we'd better fix Java 8 issues before merging

[jira] [Commented] (YARN-3809) Failed to launch new attempts because ApplicationMasterLauncher's threads all hang

2015-06-15 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587474#comment-14587474 ] Jun Gong commented on YARN-3809: How about setting thread pool size in

[jira] [Commented] (YARN-3804) Both RM are on standBy state when kerberos user not in yarn.admin.acl

2015-06-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586694#comment-14586694 ] Karthik Kambatla commented on YARN-3804: On board with suggestions here. Both RM

[jira] [Commented] (YARN-3803) Application hangs after more then one localization attempt fails on the same NM

2015-06-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586731#comment-14586731 ] Karthik Kambatla commented on YARN-3803: We have this other issue because of which

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586999#comment-14586999 ] MENG DING commented on YARN-1197: - [~sandyr], Yes. The key assumption is that by the time

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586687#comment-14586687 ] Sandy Ryza commented on YARN-1197: -- bq. Going through RM directly is better as the RM will

[jira] [Commented] (YARN-2768) optimize FSAppAttempt.updateDemand by avoid clone of Resource which takes 85% of computing time of update thread

2015-06-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586733#comment-14586733 ] Karthik Kambatla commented on YARN-2768: Thanks for the clarification,

[jira] [Commented] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14586980#comment-14586980 ] Sangjin Lee commented on YARN-3706: --- I took a look at the latest patch, and it looks

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587098#comment-14587098 ] Wangda Tan commented on YARN-1197: -- [~sandyr], I think increasing via AM-NM and RM-NM are

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587127#comment-14587127 ] Sandy Ryza commented on YARN-1197: -- Option (a) can occur in the low hundreds of

[jira] [Resolved] (YARN-3803) Application hangs after more then one localization attempt fails on the same NM

2015-06-15 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuliya Feldman resolved YARN-3803. -- Resolution: Not A Problem I apologize for this one. It is not an issue in branches I mentioned,

[jira] [Commented] (YARN-3174) Consolidate the NodeManager documentation into one

2015-06-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587128#comment-14587128 ] Masatake Iwasaki commented on YARN-3174: NodeManager.md currently explains about

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587146#comment-14587146 ] Wangda Tan commented on YARN-1197: -- [~sandyr], Thanks for replying, bq. Why does the AM

[jira] [Updated] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in trunk for FS scheduler

2015-06-15 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3790: Component/s: fairscheduler TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in

[jira] [Updated] (YARN-3789) Refactor logs for LeafQueue#activateApplications() to remove duplicate logging

2015-06-15 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3789: --- Attachment: 0004-YARN-3789.patch Refactor logs for LeafQueue#activateApplications() to remove

[jira] [Commented] (YARN-3790) TestWorkPreservingRMRestart#testSchedulerRecovery fails intermittently in trunk for FS scheduler

2015-06-15 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14585471#comment-14585471 ] zhihai xu commented on YARN-3790: - [~rohithsharma] thanks for the review, yes, I just

[jira] [Updated] (YARN-3803) Application hangs after more then one localization attempt fails on the same NM

2015-06-15 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuliya Feldman updated YARN-3803: - Priority: Major (was: Minor) Application hangs after more then one localization attempt fails on

[jira] [Commented] (YARN-3803) Application hangs after more then one localization attempt fails on the same NM

2015-06-15 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587025#comment-14587025 ] Yuliya Feldman commented on YARN-3803: -- Changed to Major Application hangs after

[jira] [Commented] (YARN-3798) RM shutdown with NoNode exception while updating appAttempt on zk

2015-06-15 Thread Tsuyoshi Ozawa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587044#comment-14587044 ] Tsuyoshi Ozawa commented on YARN-3798: -- [~varun_saxena] Thanks for your help. In

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587063#comment-14587063 ] Vinod Kumar Vavilapalli commented on YARN-1197: --- The details looks good.

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587072#comment-14587072 ] Sandy Ryza commented on YARN-1197: -- bq. RM still needs to wait for an acknowledgement from

[jira] [Assigned] (YARN-3174) Consolidate the NodeManager documentation into one

2015-06-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki reassigned YARN-3174: -- Assignee: Masatake Iwasaki Consolidate the NodeManager documentation into one

[jira] [Updated] (YARN-3714) AM proxy filter can not get proper default proxy address if RM-HA is enabled

2015-06-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-3714: --- Attachment: YARN-3714.004.patch bq. We could check whether RM_WEBAPP_ADDRESS has been set with

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587067#comment-14587067 ] Sandy Ryza commented on YARN-1197: -- Is my understanding correct that the broader plan is

[jira] [Commented] (YARN-3174) Consolidate the NodeManager documentation into one

2015-06-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587094#comment-14587094 ] Masatake Iwasaki commented on YARN-3174: There are 4 files refering to NodeManager

[jira] [Commented] (YARN-3779) Aggregated Logs Deletion doesnt work after refreshing Log Retention Settings in secure cluster

2015-06-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587165#comment-14587165 ] Zhijie Shen commented on YARN-3779: --- [~varun_saxena], do you know why ugi is still the

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587168#comment-14587168 ] Sandy Ryza commented on YARN-1197: -- bq. If you consider all now/future optimizations, such

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587174#comment-14587174 ] Sandy Ryza commented on YARN-1197: -- Regarding complexity in the AM, the NMClient utility

[jira] [Commented] (YARN-3714) AM proxy filter can not get proper default proxy address if RM-HA is enabled

2015-06-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587181#comment-14587181 ] Hadoop QA commented on YARN-3714: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3792) Test case failures in TestDistributedShell and some issue fixes related to ATSV2

2015-06-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587183#comment-14587183 ] Sangjin Lee commented on YARN-3792: --- Thanks [~Naganarasimha] for identifying the issues

[jira] [Updated] (YARN-3714) AM proxy filter can not get RM webapp address from yarn.resourcemanager.hostname.rm-id

2015-06-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-3714: --- Summary: AM proxy filter can not get RM webapp address from

[jira] [Updated] (YARN-3174) Consolidate the NodeManager documentation into one

2015-06-15 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated YARN-3174: --- Attachment: YARN-3174.001.patch Consolidate the NodeManager documentation into one

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14587196#comment-14587196 ] Wangda Tan commented on YARN-1197: -- bq. To clarify: with proper tuning, we can currently

  1   2   >