[jira] [Commented] (YARN-3932) SchedulerApplicationAttempt#getResourceUsageReport should be based on NodeLabel

2015-07-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630877#comment-14630877 ] Bibin A Chundatt commented on YARN-3932: [~leftnoteasy] used {{attemptResourceUsage

[jira] [Updated] (YARN-3932) SchedulerApplicationAttempt#getResourceUsageReport should be based on NodeLabel

2015-07-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3932: --- Attachment: 0001-YARN-3932.patch > SchedulerApplicationAttempt#getResourceUsageReport should be

[jira] [Commented] (YARN-3845) [YARN] YARN status in web ui does not show correctly in IE 11

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630869#comment-14630869 ] Hadoop QA commented on YARN-3845: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630867#comment-14630867 ] Varun Saxena commented on YARN-3049: [~zjshen], should cluster ID be mandatory in REST

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630861#comment-14630861 ] Hadoop QA commented on YARN-3535: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3543) ApplicationReport should be able to tell whether the Application is AM managed or not.

2015-07-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630860#comment-14630860 ] Rohith Sharma K S commented on YARN-3543: - Discussed with [~xgong] offline, as per

[jira] [Created] (YARN-3936) Add metrics for RMStateStore

2015-07-16 Thread Ming Ma (JIRA)
Ming Ma created YARN-3936: - Summary: Add metrics for RMStateStore Key: YARN-3936 URL: https://issues.apache.org/jira/browse/YARN-3936 Project: Hadoop YARN Issue Type: Improvement Reporter

[jira] [Created] (YARN-3935) Support compression for RM HA ApplicationStateData

2015-07-16 Thread Ming Ma (JIRA)
Ming Ma created YARN-3935: - Summary: Support compression for RM HA ApplicationStateData Key: YARN-3935 URL: https://issues.apache.org/jira/browse/YARN-3935 Project: Hadoop YARN Issue Type: Improvemen

[jira] [Created] (YARN-3934) Application with large ApplicationSubmissionContext can cause RM to exit when ZK store is used

2015-07-16 Thread Ming Ma (JIRA)
Ming Ma created YARN-3934: - Summary: Application with large ApplicationSubmissionContext can cause RM to exit when ZK store is used Key: YARN-3934 URL: https://issues.apache.org/jira/browse/YARN-3934 Project:

[jira] [Updated] (YARN-3933) Resources(both core and memory) are being negative

2015-07-16 Thread Lavkesh Lahngir (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lavkesh Lahngir updated YARN-3933: -- Summary: Resources(both core and memory) are being negative (was: Resources(bothe core and memor

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630842#comment-14630842 ] Hadoop QA commented on YARN-2306: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (YARN-3933) Resources(bothe core and memory) are being negative

2015-07-16 Thread Lavkesh Lahngir (JIRA)
Lavkesh Lahngir created YARN-3933: - Summary: Resources(bothe core and memory) are being negative Key: YARN-3933 URL: https://issues.apache.org/jira/browse/YARN-3933 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-3784) Indicate preemption timout along with the list of containers to AM (preemption message)

2015-07-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630794#comment-14630794 ] Sunil G commented on YARN-3784: --- Yes [~leftnoteasy] Thank you for sharing your thoughts. I f

[jira] [Commented] (YARN-3736) Persist the Plan information, ie. accepted reservations to the RMStateStore for failover

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630793#comment-14630793 ] Hadoop QA commented on YARN-3736: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3928) launch application master on specific host

2015-07-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630781#comment-14630781 ] Rohith Sharma K S commented on YARN-3928: - bq. Is there a way to launch application

[jira] [Updated] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-07-16 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-3535: Attachment: 0006-YARN-3535.patch Updated patch fixing [~zxu] comment. > ResourceRequest sh

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630769#comment-14630769 ] Li Lu commented on YARN-3908: - Hi [~sjlee0], one nit: the name {{readTimeseriesResults}} looks

[jira] [Commented] (YARN-938) Hadoop 2 benchmarking

2015-07-16 Thread dhruv kapatel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630762#comment-14630762 ] dhruv kapatel commented on YARN-938: Great work! can any one help me how can i perform b

[jira] [Updated] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3049: -- Attachment: YARN-3049-WIP.2.patch [~sjlee0] and [~gtCarrera9], thanks for review the patch. I'm currently

[jira] [Commented] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630747#comment-14630747 ] Hadoop QA commented on YARN-3931: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Resolved] (YARN-1974) add args for DistributedShell to specify a set of nodes on which the tasks run

2015-07-16 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo resolved YARN-1974. --- Resolution: Not A Problem > add args for DistributedShell to specify a set of nodes on which the tasks

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

2015-07-16 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630742#comment-14630742 ] Hong Zhiguo commented on YARN-2306: --- Updated the patch. I ran testReservationMetrics seve

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

2015-07-16 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630741#comment-14630741 ] Hong Zhiguo commented on YARN-2306: --- I checked the code of tearDown and it shows someone

[jira] [Updated] (YARN-2306) leak of reservation metrics (fair scheduler)

2015-07-16 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-2306: -- Attachment: YARN-2306-3.patch > leak of reservation metrics (fair scheduler) > --

[jira] [Updated] (YARN-2306) leak of reservation metrics (fair scheduler)

2015-07-16 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-2306: -- Attachment: YARN-2306.patch-3 > leak of reservation metrics (fair scheduler) > --

[jira] [Updated] (YARN-2306) leak of reservation metrics (fair scheduler)

2015-07-16 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-2306: -- Attachment: (was: YARN-2306.patch-3) > leak of reservation metrics (fair scheduler) > ---

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

2015-07-16 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630733#comment-14630733 ] Ray Chiang commented on YARN-2306: -- Heh. That was two months ago. I believe I was referr

[jira] [Updated] (YARN-3845) [YARN] YARN status in web ui does not show correctly in IE 11

2015-07-16 Thread Mohammad Shahid Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad Shahid Khan updated YARN-3845: --- Attachment: YARN-3845.patch > [YARN] YARN status in web ui does not show correctly in I

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

2015-07-16 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630694#comment-14630694 ] Hong Zhiguo commented on YARN-2306: --- hi, [~rchiang], do you mean running the unit test in

[jira] [Commented] (YARN-2768) optimize FSAppAttempt.updateDemand by avoid clone of Resource which takes 85% of computing time of update thread

2015-07-16 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630688#comment-14630688 ] Hong Zhiguo commented on YARN-2768: --- [~kasha], could you please review the patch? > opti

[jira] [Updated] (YARN-3736) Persist the Plan information, ie. accepted reservations to the RMStateStore for failover

2015-07-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3736: Attachment: YARN-3736.001.patch > Persist the Plan information, ie. accepted reservations to the RMSt

[jira] [Updated] (YARN-3897) "Too many links" in NM log dir

2015-07-16 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hong Zhiguo updated YARN-3897: -- Description: Users need to left container logs more than one day. On some nodes of our busy cluster, the

[jira] [Updated] (YARN-3736) Persist the Plan information, ie. accepted reservations to the RMStateStore for failover

2015-07-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3736: Attachment: YARN-3736.001.patch Patch that adds implementation of ReservationSystem state to all the

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-16 Thread Ajith S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630669#comment-14630669 ] Ajith S commented on YARN-3885: --- Thanks [~leftnoteasy] , [~xinxianyin] and [~sunilg] :) > Pr

[jira] [Commented] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2015-07-16 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630659#comment-14630659 ] Xianyin Xin commented on YARN-3931: --- This reminds me an earlier trouble i have met. Hi [~

[jira] [Commented] (YARN-3900) Protobuf layout of yarn_security_token causes errors in other protos that include it

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630643#comment-14630643 ] Hadoop QA commented on YARN-3900: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2015-07-16 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-3931: --- Attachment: YARN-3931.001.patch I attached the patch. it work well in my cluster... :) > default-node-

[jira] [Commented] (YARN-3930) FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown

2015-07-16 Thread Dian Fu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630615#comment-14630615 ] Dian Fu commented on YARN-3930: --- Thanks [~leftnoteasy] for review and commit. > FileSystemNo

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630593#comment-14630593 ] Sangjin Lee commented on YARN-3906: --- The bulk of the work is done, but I'd like to wait u

[jira] [Updated] (YARN-3900) Protobuf layout of yarn_security_token causes errors in other protos that include it

2015-07-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3900: Attachment: YARN-3900.002.patch Updated patch for recent changes in ContainerTokenIdentifierProto >

[jira] [Commented] (YARN-2578) NM does not failover timely if RM node network connection fails

2015-07-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630535#comment-14630535 ] Masatake Iwasaki commented on YARN-2578: bq. 2. Would you tell me why Client.getRpc

[jira] [Updated] (YARN-3900) Protobuf layout of yarn_security_token causes errors in other protos that include it

2015-07-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3900: Description: Because of the subdirectory server used in {{hadoop-yarn-project/hadoop-yarn/hadoop-yar

[jira] [Commented] (YARN-2578) NM does not failover timely if RM node network connection fails

2015-07-16 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630532#comment-14630532 ] Masatake Iwasaki commented on YARN-2578: Yes, it is the same fix. I agree it should

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630509#comment-14630509 ] Hudson commented on YARN-3885: -- FAILURE: Integrated in Hadoop-trunk-Commit #8177 (See [https:

[jira] [Commented] (YARN-3930) FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630500#comment-14630500 ] Hudson commented on YARN-3930: -- FAILURE: Integrated in Hadoop-trunk-Commit #8176 (See [https:

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630479#comment-14630479 ] Hadoop QA commented on YARN-3908: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630473#comment-14630473 ] Hadoop QA commented on YARN-433: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-3905) Application History Server UI NPEs when accessing apps run after RM restart

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630472#comment-14630472 ] Hadoop QA commented on YARN-3905: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3905) Application History Server UI NPEs when accessing apps run after RM restart

2015-07-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3905: -- Target Version/s: 2.7.2 (was: 2.7.1) > Application History Server UI NPEs when accessing apps ru

[jira] [Commented] (YARN-3905) Application History Server UI NPEs when accessing apps run after RM restart

2015-07-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630452#comment-14630452 ] Jonathan Eagles commented on YARN-3905: --- +1. [~eepayne], retargetting for 2.7.2 since

[jira] [Updated] (YARN-3905) Application History Server UI NPEs when accessing apps run after RM restart

2015-07-16 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3905: -- Target Version/s: 2.7.1, (was: 2.7.1) > Application History Server UI NPEs when accessing apps

[jira] [Updated] (YARN-3905) Application History Server UI NPEs when accessing apps run after RM restart

2015-07-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-3905: - Attachment: YARN-3905.001.patch > Application History Server UI NPEs when accessing apps run after RM resta

[jira] [Updated] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3908: -- Attachment: YARN-3908-YARN-2928.004.patch Oops. Forgot ColumnPrefix. > Bugs in HBaseTimelineWriterImpl >

[jira] [Updated] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3908: -- Attachment: YARN-3908-YARN-2928.004.patch v.4 patch posted Thanks for your feedback [~jrottinghuis]! I

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630289#comment-14630289 ] Joep Rottinghuis commented on YARN-3908: Patch looks good with one comment. I compl

[jira] [Commented] (YARN-3932) SchedulerApplicationAttempt#getResourceUsageReport should be based on NodeLabel

2015-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630283#comment-14630283 ] Wangda Tan commented on YARN-3932: -- [~bibinchundatt], I think we can add a method such as

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630275#comment-14630275 ] Joep Rottinghuis commented on YARN-3908: bq. In fact, I'm wondering if we should bu

[jira] [Updated] (YARN-3868) ContainerManager recovery for container resizing

2015-07-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-3868: Attachment: YARN-3868-YARN-1197.3.patch Update patch as dependent patches have been updated. > ContainerMana

[jira] [Updated] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-07-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-433: --- Attachment: YARN-433.3.patch rebase the patch > When RM is catching up with node updates then it should not exp

[jira] [Commented] (YARN-3656) LowCost: A Cost-Based Placement Agent for YARN Reservations

2015-07-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630251#comment-14630251 ] Subru Krishnan commented on YARN-3656: -- Thanks [~asuresh] for reviewing the patch. We

[jira] [Commented] (YARN-3900) Protobuf layout of yarn_security_token causes errors in other protos that include it

2015-07-16 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630209#comment-14630209 ] Anubhav Dhoot commented on YARN-3900: - This is needed for YARN-3736. Without this the l

[jira] [Commented] (YARN-3784) Indicate preemption timout along with the list of containers to AM (preemption message)

2015-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630167#comment-14630167 ] Wangda Tan commented on YARN-3784: -- Beyond timeout, another thing we may need consider is:

[jira] [Commented] (YARN-433) When RM is catching up with node updates then it should not expire acquired containers

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630151#comment-14630151 ] Hadoop QA commented on YARN-433: \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Commented] (YARN-3635) Get-queue-mapping should be a common interface of YarnScheduler

2015-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630139#comment-14630139 ] Wangda Tan commented on YARN-3635: -- Hi [~sandyr], Thanks for your comments, actually I hav

[jira] [Commented] (YARN-3914) Entity created time should be part of the row key of entity table

2015-07-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630125#comment-14630125 ] Sangjin Lee commented on YARN-3914: --- [~zjshen], we have been discussing this. While addin

[jira] [Commented] (YARN-3932) SchedulerApplicationAttempt#getResourceUsageReport should be based on NodeLabel

2015-07-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630090#comment-14630090 ] Bibin A Chundatt commented on YARN-3932: Hi [~leftnoteasy] i think we should iterat

[jira] [Commented] (YARN-2003) Support for Application priority : Changes in RM and Capacity Scheduler

2015-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630042#comment-14630042 ] Wangda Tan commented on YARN-2003: -- Thanks [~sunilg] to update, few more comments regardin

[jira] [Commented] (YARN-3885) ProportionalCapacityPreemptionPolicy doesn't preempt if queue is more than 2 level

2015-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630022#comment-14630022 ] Wangda Tan commented on YARN-3885: -- Patch LGTM, +1, will commit soon. Thanks [~ajithshetty

[jira] [Commented] (YARN-3930) FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown

2015-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630017#comment-14630017 ] Wangda Tan commented on YARN-3930: -- [~dian.fu], Thanks for working on the JIRA. Patch look

[jira] [Commented] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2015-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630010#comment-14630010 ] Wangda Tan commented on YARN-3931: -- Thanks for raising the issue [~kyungwan nam], I just a

[jira] [Updated] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2015-07-16 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3931: - Assignee: kyungwan nam (was: Naganarasimha G R) > default-node-label-expression doesn’t apply when an appl

[jira] [Updated] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

2015-07-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-3893: Issue Type: Sub-task (was: Bug) Parent: YARN-149 > Both RM in active state when Admin#transitionToAc

[jira] [Commented] (YARN-3929) Uncleaning option for local app log files with log-aggregation feature

2015-07-16 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629998#comment-14629998 ] Xuan Gong commented on YARN-3929: - [~dongwook] Does this configuration: yarn.nodemanager.de

[jira] [Updated] (YARN-1644) RM-NM protocol changes and NodeStatusUpdater implementation to support container resizing

2015-07-16 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-1644: Attachment: YARN-1644-YARN-1197.4.patch Updated this patch as dependent patch has been updated. > RM-NM prot

[jira] [Updated] (YARN-3932) SchedulerApplicationAttempt#getResourceUsageReport should be based on NodeLabel

2015-07-16 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3932: --- Attachment: ApplicationReport.jpg > SchedulerApplicationAttempt#getResourceUsageReport should b

[jira] [Created] (YARN-3932) SchedulerApplicationAttempt#getResourceUsageReport should be based on NodeLabel

2015-07-16 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3932: -- Summary: SchedulerApplicationAttempt#getResourceUsageReport should be based on NodeLabel Key: YARN-3932 URL: https://issues.apache.org/jira/browse/YARN-3932 Proje

[jira] [Commented] (YARN-2578) NM does not failover timely if RM node network connection fails

2015-07-16 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629940#comment-14629940 ] Ming Ma commented on YARN-2578: --- Thanks [~iwasakims]. Is it similar to HADOOP-11252? Given yo

[jira] [Updated] (YARN-3784) Indicate preemption timout along with the list of containers to AM (preemption message)

2015-07-16 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3784: -- Attachment: 0002-YARN-3784.patch Uploading a new version of the patch. Initially RM was sending list of contain

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629811#comment-14629811 ] Hadoop QA commented on YARN-3877: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2015-07-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629790#comment-14629790 ] Naganarasimha G R commented on YARN-3931: - [~kyungwan nam], Good that you are tryin

[jira] [Commented] (YARN-3928) launch application master on specific host

2015-07-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629753#comment-14629753 ] Varun Saxena commented on YARN-3928: Oh, then it is not. Misread the JIRA title. Apolog

[jira] [Commented] (YARN-3928) launch application master on specific host

2015-07-16 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629750#comment-14629750 ] Lei Guo commented on YARN-3928: --- [~varun_saxena], I read this JIRA as a host preference requi

[jira] [Commented] (YARN-3174) Consolidate the NodeManager and NodeManagerRestart documentation into one

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629717#comment-14629717 ] Hudson commented on YARN-3174: -- ABORTED: Integrated in Hadoop-Hdfs-trunk #2185 (See [https://

[jira] [Commented] (YARN-3805) Update the documentation of Disk Checker based on YARN-90

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629718#comment-14629718 ] Hudson commented on YARN-3805: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #246 (See [htt

[jira] [Commented] (YARN-90) NodeManager should identify failed disks becoming good again

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629723#comment-14629723 ] Hudson commented on YARN-90: ABORTED: Integrated in Hadoop-Hdfs-trunk #2185 (See [https://builds

[jira] [Commented] (YARN-3174) Consolidate the NodeManager and NodeManagerRestart documentation into one

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629719#comment-14629719 ] Hudson commented on YARN-3174: -- ABORTED: Integrated in Hadoop-Mapreduce-trunk #2204 (See [htt

[jira] [Commented] (YARN-3805) Update the documentation of Disk Checker based on YARN-90

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629716#comment-14629716 ] Hudson commented on YARN-3805: -- ABORTED: Integrated in Hadoop-Mapreduce-trunk #2204 (See [htt

[jira] [Commented] (YARN-3805) Update the documentation of Disk Checker based on YARN-90

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629715#comment-14629715 ] Hudson commented on YARN-3805: -- ABORTED: Integrated in Hadoop-Hdfs-trunk #2185 (See [https://

[jira] [Commented] (YARN-90) NodeManager should identify failed disks becoming good again

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629724#comment-14629724 ] Hudson commented on YARN-90: ABORTED: Integrated in Hadoop-Mapreduce-trunk #2204 (See [https://b

[jira] [Commented] (YARN-90) NodeManager should identify failed disks becoming good again

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629728#comment-14629728 ] Hudson commented on YARN-90: ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #246 (See [https://b

[jira] [Commented] (YARN-3174) Consolidate the NodeManager and NodeManagerRestart documentation into one

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629722#comment-14629722 ] Hudson commented on YARN-3174: -- ABORTED: Integrated in Hadoop-Hdfs-trunk-Java8 #246 (See [htt

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2015-07-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629714#comment-14629714 ] Varun Saxena commented on YARN-3877: [~chris.douglas], updated a new patch. Kindly revi

[jira] [Updated] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2015-07-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3877: --- Attachment: YARN-3877.02.patch > YarnClientImpl.submitApplication swallows exceptions > ---

[jira] [Commented] (YARN-3931) default-node-label-expression doesn’t apply when an application is submitted by RM rest api

2015-07-16 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629701#comment-14629701 ] kyungwan nam commented on YARN-3931: hi, i couldn't reassign it to me. i think i don't

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

2015-07-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629660#comment-14629660 ] Varun Saxena commented on YARN-3877: [~chris.douglas], thanks for the review. Yes, you

[jira] [Commented] (YARN-3930) FileSystemNodeLabelsStore should make sure edit log file closed when exception is thrown

2015-07-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629646#comment-14629646 ] Hadoop QA commented on YARN-3930: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3805) Update the documentation of Disk Checker based on YARN-90

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629622#comment-14629622 ] Hudson commented on YARN-3805: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #988 (See [https://b

[jira] [Commented] (YARN-90) NodeManager should identify failed disks becoming good again

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629625#comment-14629625 ] Hudson commented on YARN-90: SUCCESS: Integrated in Hadoop-Yarn-trunk #988 (See [https://builds.

[jira] [Commented] (YARN-3174) Consolidate the NodeManager and NodeManagerRestart documentation into one

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629623#comment-14629623 ] Hudson commented on YARN-3174: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #988 (See [https://b

[jira] [Commented] (YARN-3805) Update the documentation of Disk Checker based on YARN-90

2015-07-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14629615#comment-14629615 ] Hudson commented on YARN-3805: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #258 (See [htt

  1   2   >