[jira] [Updated] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2015-08-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2923: Attachment: YARN-2923.20150817-1.patch > Support configuration based NodeLabelsProvider Servi

[jira] [Commented] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2015-08-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699111#comment-14699111 ] Naganarasimha G R commented on YARN-2923: - Hi [~leftnoteasy], Thanks for the commen

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699244#comment-14699244 ] Hadoop QA commented on YARN-3980: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-17 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-4024: -- Attachment: YARN-4024-draft.patch Add an configuration option "yarn.resourcemanager.node-ip-cache.expiry

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-17 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699285#comment-14699285 ] Hong Zhiguo commented on YARN-4024: --- In this patch, both positive and negative lookup res

[jira] [Updated] (YARN-4057) If ContainersMonitor is not enabled, only print related log info one time

2015-08-17 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-4057: --- Attachment: YARN-4057.01.patch > If ContainersMonitor is not enabled, only print related log info one time > --

[jira] [Commented] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699328#comment-14699328 ] Hadoop QA commented on YARN-2923: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-4055) Report node resource utilization in heartbeat

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699361#comment-14699361 ] Hudson commented on YARN-4055: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1020 (See [https://

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699360#comment-14699360 ] Hudson commented on YARN-3534: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1020 (See [https://

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699363#comment-14699363 ] Hudson commented on YARN-3534: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #290 (See [htt

[jira] [Commented] (YARN-4055) Report node resource utilization in heartbeat

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699364#comment-14699364 ] Hudson commented on YARN-4055: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #290 (See [htt

[jira] [Commented] (YARN-4057) If ContainersMonitor is not enabled, only print related log info one time

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699375#comment-14699375 ] Hadoop QA commented on YARN-4057: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-4054) Fix findbugs warnings in YARN-2928 branch

2015-08-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699418#comment-14699418 ] Junping Du commented on YARN-4054: -- Hi [~varun_saxena], thanks for your comments! bq. We c

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699424#comment-14699424 ] Hadoop QA commented on YARN-4024: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699557#comment-14699557 ] Junping Du commented on YARN-3045: -- Latest patch LGTM. But will confirm YARN-2928 branch s

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699591#comment-14699591 ] Rohith Sharma K S commented on YARN-4014: - bq. we can make updateApplicationPriorit

[jira] [Updated] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4014: Attachment: 0002-YARN-4017.patch > Support user cli interface in for Application Priority > -

[jira] [Updated] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4014: Attachment: 0002-YARN-4014.patch > Support user cli interface in for Application Priority > -

[jira] [Updated] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4014: Attachment: (was: 0002-YARN-4017.patch) > Support user cli interface in for Application P

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699628#comment-14699628 ] Rohith Sharma K S commented on YARN-4014: - Updating the modified patch, kindly revi

[jira] [Commented] (YARN-4055) Report node resource utilization in heartbeat

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699641#comment-14699641 ] Hudson commented on YARN-4055: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2217 (See [https://

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699640#comment-14699640 ] Hudson commented on YARN-3534: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2217 (See [https://

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-17 Thread Allan Wilson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699645#comment-14699645 ] Allan Wilson commented on YARN-4024: When a nodemanager is decommissioned, is the IP ca

[jira] [Commented] (YARN-4055) Report node resource utilization in heartbeat

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699659#comment-14699659 ] Hudson commented on YARN-4055: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #287 (See

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699661#comment-14699661 ] Hudson commented on YARN-3534: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #279 (See [htt

[jira] [Commented] (YARN-4055) Report node resource utilization in heartbeat

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699662#comment-14699662 ] Hudson commented on YARN-4055: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #279 (See [htt

[jira] [Commented] (YARN-4055) Report node resource utilization in heartbeat

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699679#comment-14699679 ] Hudson commented on YARN-4055: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2236 (See [htt

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

2015-08-17 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699678#comment-14699678 ] Hudson commented on YARN-3534: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2236 (See [htt

[jira] [Updated] (YARN-4051) ContainerKillEvent is lost when container is In New State and is recovering

2015-08-17 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee updated YARN-4051: --- Attachment: YARN-4051.03.patch pending kill event while container is recovered. and just act like recoveredAsK

[jira] [Commented] (YARN-4051) ContainerKillEvent is lost when container is In New State and is recovering

2015-08-17 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699745#comment-14699745 ] sandflee commented on YARN-4051: if recovered as REQUESTED, try to cleanup container resour

[jira] [Updated] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-17 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-3975: Attachment: YARN-3975.5.patch Thanks for the review [~jlowe]. I have modified the patch based on your comment

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699795#comment-14699795 ] Joep Rottinghuis commented on YARN-3901: Starting to go through. Just as a note (no

[jira] [Commented] (YARN-3868) ContainerManager recovery for container resizing

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699797#comment-14699797 ] Hadoop QA commented on YARN-3868: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699804#comment-14699804 ] Joep Rottinghuis commented on YARN-3901: Presumably the storeWithTag method is just

[jira] [Commented] (YARN-4051) ContainerKillEvent is lost when container is In New State and is recovering

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699814#comment-14699814 ] Hadoop QA commented on YARN-4051: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699816#comment-14699816 ] Hadoop QA commented on YARN-3975: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699872#comment-14699872 ] Li Lu commented on YARN-4053: - Hi [~varun_saxena], thanks for the patch! With regard to the POC

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699883#comment-14699883 ] Varun Saxena commented on YARN-4053: bq. We may have something like TimelineData.FLOAT,

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699885#comment-14699885 ] Varun Saxena commented on YARN-4053: [~gtCarrera9], yes, will update a patch by tomorro

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699888#comment-14699888 ] Li Lu commented on YARN-4053: - Thanks! Tomorrow LGTM. > Change the way metric values are stor

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699907#comment-14699907 ] Varun Saxena commented on YARN-4053: Oh sorry in my original comment, I meant that we c

[jira] [Commented] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699908#comment-14699908 ] Wangda Tan commented on YARN-4024: -- Hi [~zhiguohong], Thanks for working on this, For you

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699918#comment-14699918 ] Jian He commented on YARN-4014: --- bq. I think we can throw YarnException with message "Applic

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699930#comment-14699930 ] Rohith Sharma K S commented on YARN-4014: - I did the above check leaving SUBMITTED,

[jira] [Updated] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-17 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-3975: Attachment: YARN-3975.6.patch Fixed Checkstyle issues > WebAppProxyServlet should not redirect to RM page if

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699934#comment-14699934 ] Sunil G commented on YARN-4014: --- IMHO, I feel we can change priority of an app at ACCEPTED st

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699937#comment-14699937 ] Joep Rottinghuis commented on YARN-3901: It seems that in general in order to get i

[jira] [Commented] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-08-17 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699939#comment-14699939 ] MENG DING commented on YARN-1644: - I had an offline discussion with [~jianhe] a while ago,

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699951#comment-14699951 ] Varun Saxena commented on YARN-4053: On second thoughts, all three types may make sense

[jira] [Commented] (YARN-3545) Investigate the concurrency issue with the map of timeline collector

2015-08-17 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699964#comment-14699964 ] Xuan Gong commented on YARN-3545: - [~gtCarrera9], Thanks for the patch. I have a question a

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699971#comment-14699971 ] Li Lu commented on YARN-4053: - bq. Oh sorry in my original comment, I meant that we can carry t

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699978#comment-14699978 ] Vrushali C commented on YARN-3901: -- Thanks [~jrottinghuis] for looking into my wip patch.

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1461#comment-1461 ] Rohith Sharma K S commented on YARN-4014: - If the application is in SUBMITTED state

[jira] [Updated] (YARN-679) add an entry point that can start any Yarn service

2015-08-17 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-679: Attachment: YARN-679-004.patch > add an entry point that can start any Yarn service >

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1472#comment-1472 ] Sangjin Lee commented on YARN-4025: --- That's a good point [~gtCarrera9]. Let me see if I c

[jira] [Updated] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4014: Attachment: 0003-YARN-4014.patch updating the patch that check only for ACCEPTED and RUNNING

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700041#comment-14700041 ] Hadoop QA commented on YARN-4014: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-4057) If ContainersMonitor is not enabled, only print related log info one time

2015-08-17 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700068#comment-14700068 ] zhihai xu commented on YARN-4057: - Thanks for reporting and working on the issue. It is a g

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700123#comment-14700123 ] Junping Du commented on YARN-3045: -- Get confirmed with Vinod that new YARN-2928 branch is

[jira] [Updated] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-4025: -- Attachment: YARN-4025-YARN-2928.003.patch v.3 patch posted. - added more javadoc to explain the format o

[jira] [Updated] (YARN-4051) ContainerKillEvent is lost when container is In New State and is recovering

2015-08-17 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4051: Component/s: nodemanager > ContainerKillEvent is lost when container is In New State and is recoveri

[jira] [Updated] (YARN-4033) In FairScheduler, parent queues should also display queue status

2015-08-17 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4033: Component/s: fairscheduler > In FairScheduler, parent queues should also display queue status >

[jira] [Commented] (YARN-3545) Investigate the concurrency issue with the map of timeline collector

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700222#comment-14700222 ] Hadoop QA commented on YARN-3545: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700236#comment-14700236 ] Sangjin Lee commented on YARN-3814: --- I have no other comments. Thanks! > REST API implem

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-08-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700247#comment-14700247 ] Sangjin Lee commented on YARN-3904: --- The latest patch (v.9) LGTM. Any other comments? >

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-08-17 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700250#comment-14700250 ] Vrushali C commented on YARN-3904: -- Thanks Li, latest patch looks good to me. > Refactor

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700252#comment-14700252 ] Jian He commented on YARN-4014: --- bq. handled null entry adding to SchedulableEntity. I think

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700255#comment-14700255 ] Joep Rottinghuis commented on YARN-3901: After discussing with [~vrushalic] we conc

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700264#comment-14700264 ] Joep Rottinghuis commented on YARN-3901: peekNext also has to deal with limit corre

[jira] [Commented] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700271#comment-14700271 ] Hadoop QA commented on YARN-3975: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-679) add an entry point that can start any Yarn service

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700290#comment-14700290 ] Hadoop QA commented on YARN-679: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-08-17 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700376#comment-14700376 ] zhihai xu commented on YARN-3857: - +1 for the latest patch, If no objection, I will commit

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700378#comment-14700378 ] Sangjin Lee commented on YARN-4053: --- Thanks [~varun_saxena] for pointing out an important

[jira] [Reopened] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-08-17 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu reopened YARN-3857: - > Memory leak in ResourceManager with SIMPLE mode > --- > >

[jira] [Updated] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-08-17 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3857: Hadoop Flags: Reviewed > Memory leak in ResourceManager with SIMPLE mode > --

[jira] [Updated] (YARN-3857) Memory leak in ResourceManager with SIMPLE mode

2015-08-17 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3857: Fix Version/s: (was: 2.7.2) > Memory leak in ResourceManager with SIMPLE mode > -

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700381#comment-14700381 ] Sangjin Lee commented on YARN-4053: --- And I do think that we need to support floating type

[jira] [Updated] (YARN-4057) If ContainersMonitor is not enabled, only print related log info one time

2015-08-17 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-4057: Hadoop Flags: Reviewed > If ContainersMonitor is not enabled, only print related log info one time >

[jira] [Commented] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-08-17 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700423#comment-14700423 ] Wangda Tan commented on YARN-1644: -- Discussed with [~jianhe], some thoughts: There're 3 c

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700524#comment-14700524 ] Li Lu commented on YARN-4025: - Latest patch LGTM. Thanks [~sjlee0]! > Deal with byte represent

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700532#comment-14700532 ] Hadoop QA commented on YARN-4014: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3545) Investigate the concurrency issue with the map of timeline collector

2015-08-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700542#comment-14700542 ] Li Lu commented on YARN-3545: - Hi [~xgong], you're right that right now this critical section c

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run table

2015-08-17 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700546#comment-14700546 ] Sangjin Lee commented on YARN-3901: --- This may be a good idea. The only thing I'd add to t

[jira] [Updated] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2015-08-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2923: Attachment: YARN-2923.20150818-1.patch Test cases are passing locally multiple times. Adding

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700628#comment-14700628 ] Hadoop QA commented on YARN-4025: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3942) Timeline store to read events from HDFS

2015-08-17 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700657#comment-14700657 ] Rajesh Balamohan commented on YARN-3942: Should this be resilient to cluster restar

[jira] [Updated] (YARN-4024) YARN RM should avoid unnecessary resolving IP when NMs doing heartbeat

2015-08-17 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-4024: -- Attachment: YARN-4024-draft-v2.patch updated the patch with flushing when node state is transiting betwee

[jira] [Commented] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-08-17 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700676#comment-14700676 ] Jian He commented on YARN-1644: --- After thinking more, we may not need a version Id. Below is

[jira] [Created] (YARN-4058) Miscellaneous issues in NodeManager project

2015-08-17 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-4058: --- Summary: Miscellaneous issues in NodeManager project Key: YARN-4058 URL: https://issues.apache.org/jira/browse/YARN-4058 Project: Hadoop YARN Issue Typ

[jira] [Commented] (YARN-4058) Miscellaneous issues in NodeManager project

2015-08-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700679#comment-14700679 ] Naganarasimha G R commented on YARN-4058: - Hi [~djp] & [~vinodkv], Have created thi

[jira] [Commented] (YARN-3880) Writing more RM side app-level metrics

2015-08-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700713#comment-14700713 ] Naganarasimha G R commented on YARN-3880: - Hi [~zjshen], Shall i handle this issue

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700717#comment-14700717 ] Naganarasimha G R commented on YARN-3045: - Thanks [~djp] for reviewing this jira. I

[jira] [Updated] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4014: Attachment: 0004-YARN-4014.patch > Support user cli interface in for Application Priority > -

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700753#comment-14700753 ] Rohith Sharma K S commented on YARN-4014: - bq. That means the updated priority is l

[jira] [Commented] (YARN-4014) Support user cli interface in for Application Priority

2015-08-17 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700755#comment-14700755 ] Rohith Sharma K S commented on YARN-4014: - Updated the patch fixing race condition

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700757#comment-14700757 ] Varun Saxena commented on YARN-4053: [~sjlee0], bq. I'm just curious (and perhaps this

[jira] [Commented] (YARN-4053) Change the way metric values are stored in HBase Storage

2015-08-17 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700759#comment-14700759 ] Naganarasimha G R commented on YARN-4053: - bq. place a restriction on client that i

[jira] [Updated] (YARN-2005) Blacklisting support for scheduling AMs

2015-08-17 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-2005: Attachment: YARN-2005.005.patch Added a patch that maintains a separate system blacklist for launchin

[jira] [Commented] (YARN-2923) Support configuration based NodeLabelsProvider Service in Distributed Node Label Configuration Setup

2015-08-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14700781#comment-14700781 ] Hadoop QA commented on YARN-2923: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo