[jira] [Assigned] (YARN-3235) Support uniformed scheduler configuration in FairScheduler

2015-02-20 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-3235: --- Assignee: Naganarasimha G R Support uniformed scheduler configuration in

[jira] [Commented] (YARN-3235) Support uniformed scheduler configuration in FairScheduler

2015-02-20 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328829#comment-14328829 ] Naganarasimha G R commented on YARN-3235: - Hi [~wangda] [~kasha] I would like to

[jira] [Commented] (YARN-933) Potential InvalidStateTransitonException: Invalid event: LAUNCHED at FINAL_SAVING

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328848#comment-14328848 ] Hudson commented on YARN-933: - SUCCESS: Integrated in Hadoop-Yarn-trunk #844 (See

[jira] [Commented] (YARN-3076) Add API/Implementation to YarnClient to retrieve label-to-node mapping

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328827#comment-14328827 ] Hudson commented on YARN-3076: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #110 (See

[jira] [Commented] (YARN-933) Potential InvalidStateTransitonException: Invalid event: LAUNCHED at FINAL_SAVING

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328826#comment-14328826 ] Hudson commented on YARN-933: - FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #110 (See

[jira] [Commented] (YARN-3076) Add API/Implementation to YarnClient to retrieve label-to-node mapping

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328849#comment-14328849 ] Hudson commented on YARN-3076: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #844 (See

[jira] [Commented] (YARN-3226) UI changes for decommissioning node

2015-02-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328853#comment-14328853 ] Sunil G commented on YARN-3226: --- Yes. I also feel we could remove some dead tabs, and then

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-02-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328681#comment-14328681 ] Varun Saxena commented on YARN-3047: Thanks [~sjlee0] for the review. I guess you are

[jira] [Updated] (YARN-3195) Add -help to yarn logs and nodes CLI command

2015-02-20 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3195: Environment: (was: SUSE Linux SP3) Issue Type: Improvement (was: Bug) Add -help to yarn logs and

[jira] [Updated] (YARN-3195) Add -help to yarn logs and nodes CLI command

2015-02-20 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-3195: Summary: Add -help to yarn logs and nodes CLI command (was: [YARN]Missing uniformity In Yarn Queue CLI

[jira] [Commented] (YARN-3195) [YARN]Missing uniformity In Yarn Queue CLI command

2015-02-20 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328669#comment-14328669 ] Devaraj K commented on YARN-3195: - Thanks [~jagadesh.kiran] for your work, overall patch is

[jira] [Commented] (YARN-3197) Confusing log generated by CapacityScheduler

2015-02-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328675#comment-14328675 ] Varun Saxena commented on YARN-3197: [~devaraj.k] Agree that making only log associated

[jira] [Commented] (YARN-3197) Confusing log generated by CapacityScheduler

2015-02-20 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328691#comment-14328691 ] Devaraj K commented on YARN-3197: - I would be ok for anyone, better you can add both of

[jira] [Commented] (YARN-2820) Do retry in FileSystemRMStateStore for better error recovery when update/store failure due to IOException.

2015-02-20 Thread Tsuyoshi OZAWA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328862#comment-14328862 ] Tsuyoshi OZAWA commented on YARN-2820: -- [~zxu] Thank you for updating a patch. 1.

[jira] [Commented] (YARN-933) Potential InvalidStateTransitonException: Invalid event: LAUNCHED at FINAL_SAVING

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328948#comment-14328948 ] Hudson commented on YARN-933: - FAILURE: Integrated in Hadoop-Hdfs-trunk #2042 (See

[jira] [Commented] (YARN-3076) Add API/Implementation to YarnClient to retrieve label-to-node mapping

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328949#comment-14328949 ] Hudson commented on YARN-3076: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2042 (See

[jira] [Commented] (YARN-3076) Add API/Implementation to YarnClient to retrieve label-to-node mapping

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328955#comment-14328955 ] Hudson commented on YARN-3076: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #101 (See

[jira] [Commented] (YARN-933) Potential InvalidStateTransitonException: Invalid event: LAUNCHED at FINAL_SAVING

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328954#comment-14328954 ] Hudson commented on YARN-933: - FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #101 (See

[jira] [Commented] (YARN-3131) YarnClientImpl should check FAILED and KILLED state in submitApplication

2015-02-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329001#comment-14329001 ] Jason Lowe commented on YARN-3131: -- bq. I do not think that continuously polling until

[jira] [Commented] (YARN-3076) Add API/Implementation to YarnClient to retrieve label-to-node mapping

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329021#comment-14329021 ] Hudson commented on YARN-3076: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #111 (See

[jira] [Commented] (YARN-3237) AppLogAggregatorImpl fails to log error if it is unable to create LogWriter

2015-02-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329505#comment-14329505 ] Jason Lowe commented on YARN-3237: -- I would just add it to this patch since it's a similar

[jira] [Commented] (YARN-3237) AppLogAggregatorImpl fails to log error cause

2015-02-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329544#comment-14329544 ] Hadoop QA commented on YARN-3237: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3237) AppLogAggregatorImpl fails to log error cause

2015-02-20 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329643#comment-14329643 ] Xuan Gong commented on YARN-3237: - Committed into trunk/branch-2. Thanks, Rushabh

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS writer service discovery

2015-02-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329737#comment-14329737 ] Sangjin Lee commented on YARN-3039: --- Thanks [~djp] for the doc! Some high level

[jira] [Created] (YARN-3239) WebAppProxy does not support a final tracking url which has query fragments and params

2015-02-20 Thread Hitesh Shah (JIRA)
Hitesh Shah created YARN-3239: - Summary: WebAppProxy does not support a final tracking url which has query fragments and params Key: YARN-3239 URL: https://issues.apache.org/jira/browse/YARN-3239

[jira] [Commented] (YARN-3239) WebAppProxy does not support a final tracking url which has query fragments and params

2015-02-20 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329741#comment-14329741 ] Hitesh Shah commented on YARN-3239: --- [~jlowe] [~jeagles] Have you come across any cases

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329744#comment-14329744 ] Sangjin Lee commented on YARN-3166: --- {quote} 1. In TimelineClient, we keep the existing

[jira] [Commented] (YARN-3237) AppLogAggregatorImpl fails to log error cause

2015-02-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329646#comment-14329646 ] Rushabh S Shah commented on YARN-3237: -- Thanks Xuan for committing.

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-02-20 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329708#comment-14329708 ] Robert Kanter commented on YARN-2423: - [~vinodkv], as [~zjshen] pointed out earlier,

[jira] [Updated] (YARN-3238) Connection timeouts to nodemanagers are retried at multiple levels

2015-02-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3238: - Attachment: YARN-3238.001.patch Since the IPC layer is already retrying it doesn't make sense to also

[jira] [Updated] (YARN-3237) AppLogAggregatorImpl fails to log error cause

2015-02-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated YARN-3237: - Attachment: YARN-3237-v2.patch Attaching a new patch to add error cause to

[jira] [Commented] (YARN-3237) AppLogAggregatorImpl fails to log error cause

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329655#comment-14329655 ] Hudson commented on YARN-3237: -- FAILURE: Integrated in Hadoop-trunk-Commit #7169 (See

[jira] [Commented] (YARN-3033) [Aggregator wireup] Implement NM starting the ATS writer companion

2015-02-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329671#comment-14329671 ] Li Lu commented on YARN-3033: - Hi [~sjlee0], thanks for the comments! I thing I used the wrong

[jira] [Updated] (YARN-3237) AppLogAggregatorImpl fails to log error cause

2015-02-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rushabh S Shah updated YARN-3237: - Summary: AppLogAggregatorImpl fails to log error cause (was: AppLogAggregatorImpl fails to log

[jira] [Commented] (YARN-3237) AppLogAggregatorImpl fails to log error cause

2015-02-20 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329636#comment-14329636 ] Xuan Gong commented on YARN-3237: - +1 LGTM. Will commit AppLogAggregatorImpl fails to log

[jira] [Commented] (YARN-3237) AppLogAggregatorImpl fails to log error if it is unable to create LogWriter

2015-02-20 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329492#comment-14329492 ] Rushabh S Shah commented on YARN-3237: -- There is 1 more method in

[jira] [Commented] (YARN-3237) AppLogAggregatorImpl fails to log error cause

2015-02-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329570#comment-14329570 ] Hadoop QA commented on YARN-3237: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3238) Connection timeouts to nodemanagers are retried at multiple levels

2015-02-20 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-3238: Summary: Connection timeouts to nodemanagers are retried at multiple levels Key: YARN-3238 URL: https://issues.apache.org/jira/browse/YARN-3238 Project: Hadoop YARN

[jira] [Commented] (YARN-3033) [Aggregator wireup] Implement NM starting the ATS writer companion

2015-02-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329748#comment-14329748 ] Sangjin Lee commented on YARN-3033: --- Agreed. Thanks for the clarification. In summary, I

[jira] [Commented] (YARN-2986) (Umbrella) Support hierarchical and unified scheduler configuration

2015-02-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329949#comment-14329949 ] Sunil G commented on YARN-2986: --- Thank you [~leftnoteasy], this is much awaited ticket :) I

[jira] [Created] (YARN-3241) Leading space, trailing space and empty sub queue name may cause MetricsException for fair scheduler

2015-02-20 Thread zhihai xu (JIRA)
zhihai xu created YARN-3241: --- Summary: Leading space, trailing space and empty sub queue name may cause MetricsException for fair scheduler Key: YARN-3241 URL: https://issues.apache.org/jira/browse/YARN-3241

[jira] [Created] (YARN-3240) [Data Mode] Implement client API to put generic entities

2015-02-20 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3240: - Summary: [Data Mode] Implement client API to put generic entities Key: YARN-3240 URL: https://issues.apache.org/jira/browse/YARN-3240 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-3233) Implement scheduler common configuration parser and create an abstraction CapacityScheduler configuration layer to support plain/hierarchy configuration.

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3233: - Attachment: YARN-3233.1.patch Attached ver.1 patch, please share your thoughts, example please refer to

[jira] [Commented] (YARN-3233) Implement scheduler common configuration parser and create an abstraction CapacityScheduler configuration layer to support plain/hierarchy configuration.

2015-02-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329967#comment-14329967 ] Hadoop QA commented on YARN-3233: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329848#comment-14329848 ] Zhijie Shen commented on YARN-3166: --- bq. But as a general rule, I think there could be

[jira] [Commented] (YARN-3238) Connection timeouts to nodemanagers are retried at multiple levels

2015-02-20 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329998#comment-14329998 ] Mit Desai commented on YARN-3238: - +1 (non binding) Looks good to me Connection timeouts

[jira] [Commented] (YARN-3238) Connection timeouts to nodemanagers are retried at multiple levels

2015-02-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329818#comment-14329818 ] Hadoop QA commented on YARN-3238: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3240) [Data Mode] Implement client API to put generic entities

2015-02-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3240: -- Attachment: YARN-3240.1.patch In this Jira, I aim to make the basic client write APIs ready. Later on,

[jira] [Commented] (YARN-2799) cleanup TestLogAggregationService based on the change in YARN-90

2015-02-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329958#comment-14329958 ] zhihai xu commented on YARN-2799: - Thanks [~djp] for valuable feedback and committing the

[jira] [Assigned] (YARN-3239) WebAppProxy does not support a final tracking url which has query fragments and params

2015-02-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-3239: - Assignee: Jian He WebAppProxy does not support a final tracking url which has query fragments and

[jira] [Commented] (YARN-2986) (Umbrella) Support hierarchical and unified scheduler configuration

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329917#comment-14329917 ] Wangda Tan commented on YARN-2986: -- An update: After an offline discussion with

[jira] [Updated] (YARN-3194) RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node

2015-02-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3194: - Summary: RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node

[jira] [Commented] (YARN-933) Potential InvalidStateTransitonException: Invalid event: LAUNCHED at FINAL_SAVING

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329020#comment-14329020 ] Hudson commented on YARN-933: - FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #111 (See

[jira] [Commented] (YARN-3131) YarnClientImpl should check FAILED and KILLED state in submitApplication

2015-02-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329012#comment-14329012 ] Jason Lowe commented on YARN-3131: -- Actually just saw YARN-3232 was filed which proposes

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS writer service discovery

2015-02-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329084#comment-14329084 ] Junping Du commented on YARN-3039: -- Hi [~rkanter], thanks for sharing your thoughts here.

[jira] [Commented] (YARN-933) Potential InvalidStateTransitonException: Invalid event: LAUNCHED at FINAL_SAVING

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329050#comment-14329050 ] Hudson commented on YARN-933: - FAILURE: Integrated in Hadoop-Mapreduce-trunk #2061 (See

[jira] [Updated] (YARN-3039) [Aggregator wireup] Implement ATS writer service discovery

2015-02-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3039: - Attachment: Service Binding for applicationaggregator of ATS (draft).pdf I put some thoughts into a draft

[jira] [Commented] (YARN-3076) Add API/Implementation to YarnClient to retrieve label-to-node mapping

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329051#comment-14329051 ] Hudson commented on YARN-3076: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2061 (See

[jira] [Commented] (YARN-3194) RM should handle NMContainerStatuses sent by NM while registering if NM is Reconnected node

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329048#comment-14329048 ] Hudson commented on YARN-3194: -- FAILURE: Integrated in Hadoop-trunk-Commit #7162 (See

[jira] [Commented] (YARN-3115) [Aggregator wireup] Work-preserving restarting of per-node aggregator

2015-02-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329103#comment-14329103 ] Junping Du commented on YARN-3115: -- Hi [~zjshen], do you already start the work on this?

[jira] [Updated] (YARN-3241) Leading space, trailing space and empty sub queue name may cause MetricsException for fair scheduler

2015-02-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3241: Description: Leading space, trailing space and empty sub queue name may cause MetricsException(Metrics

[jira] [Updated] (YARN-3241) Leading space, trailing space and empty sub queue name may cause MetricsException for fair scheduler

2015-02-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3241: Description: Leading space, trailing space and empty sub queue name may cause MetricsException(Metrics

[jira] [Commented] (YARN-3222) RMNodeImpl#ReconnectNodeTransition should send scheduler events in sequential order

2015-02-20 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329136#comment-14329136 ] Rohith commented on YARN-3222: -- I see there are 2 ways of fixing the issue. # Always send

[jira] [Commented] (YARN-2799) cleanup TestLogAggregationService based on the change in YARN-90

2015-02-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329209#comment-14329209 ] Junping Du commented on YARN-2799: -- +1. Committing it now. cleanup

[jira] [Commented] (YARN-2083) In fair scheduler, Queue should not been assigned more containers when its usedResource had reach the maxResource limit

2015-02-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329194#comment-14329194 ] Hadoop QA commented on YARN-2083: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3131) YarnClientImpl should check FAILED and KILLED state in submitApplication

2015-02-20 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-3131: --- Attachment: yarn_3131_v2.patch YarnClientImpl should check FAILED and KILLED state in submitApplication

[jira] [Commented] (YARN-3235) Support uniformed scheduler configuration in FairScheduler

2015-02-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329179#comment-14329179 ] Karthik Kambatla commented on YARN-3235: It is all yours, [~Naganarasimha]. Thanks

[jira] [Commented] (YARN-2799) cleanup TestLogAggregationService based on the change in YARN-90

2015-02-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329187#comment-14329187 ] Hadoop QA commented on YARN-2799: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2799) cleanup TestLogAggregationService based on the change in YARN-90

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329224#comment-14329224 ] Hudson commented on YARN-2799: -- FAILURE: Integrated in Hadoop-trunk-Commit #7163 (See

[jira] [Updated] (YARN-2083) In fair scheduler, Queue should not been assigned more containers when its usedResource had reach the maxResource limit

2015-02-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-2083: --- Labels: fairscheduler (was: assignContainer fair scheduler) In fair scheduler, Queue should

[jira] [Commented] (YARN-90) NodeManager should identify failed disks becoming good again

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329225#comment-14329225 ] Hudson commented on YARN-90: FAILURE: Integrated in Hadoop-trunk-Commit #7163 (See

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329598#comment-14329598 ] Zhijie Shen commented on YARN-3166: --- bq. In such a scenario if we try to Reuse REST then

[jira] [Commented] (YARN-3223) Resource update during NM graceful decommission

2015-02-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329275#comment-14329275 ] Junping Du commented on YARN-3223: -- Hi [~varun_saxena], I am glad if you can work on this

[jira] [Commented] (YARN-3230) Clarify application states on the web UI

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329324#comment-14329324 ] Wangda Tan commented on YARN-3230: -- Committing.. Clarify application states on the web

[jira] [Commented] (YARN-3230) Clarify application states on the web UI

2015-02-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329334#comment-14329334 ] Hudson commented on YARN-3230: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7164 (See

[jira] [Updated] (YARN-3197) Confusing log generated by CapacityScheduler

2015-02-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3197: --- Attachment: YARN-3197.002.patch Confusing log generated by CapacityScheduler

[jira] [Commented] (YARN-3115) [Aggregator wireup] Work-preserving restarting of per-node aggregator

2015-02-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329299#comment-14329299 ] Zhijie Shen commented on YARN-3115: --- Please feel free to take it over. [Aggregator

[jira] [Commented] (YARN-3131) YarnClientImpl should check FAILED and KILLED state in submitApplication

2015-02-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329308#comment-14329308 ] Hadoop QA commented on YARN-3131: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-02-20 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329356#comment-14329356 ] Vinod Kumar Vavilapalli commented on YARN-2423: --- Apologies for coming in

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329358#comment-14329358 ] Wangda Tan commented on YARN-1963: -- That's great! Thanks. Support priorities across

[jira] [Commented] (YARN-3031) [Storage abstraction] Create backing storage write interface for ATS writers

2015-02-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329368#comment-14329368 ] Zhijie Shen commented on YARN-3031: --- [~vrushalic], YARN-3041 is committed, would you mind

[jira] [Commented] (YARN-3031) [Storage abstraction] Create backing storage write interface for ATS writers

2015-02-20 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329375#comment-14329375 ] Vrushali C commented on YARN-3031: -- Yes, I will.. [Storage abstraction] Create backing

[jira] [Updated] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2495: - Target Version/s: 2.8.0 (was: 2.6.0) Allow admin specify labels from each NM (Distributed configuration)

[jira] [Commented] (YARN-3131) YarnClientImpl should check FAILED and KILLED state in submitApplication

2015-02-20 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329380#comment-14329380 ] Chang Li commented on YARN-3131: Updated patch, fixed unit test and improved the code

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-20 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329393#comment-14329393 ] Naganarasimha G R commented on YARN-3166: - Hi [~zjshen] [~sjlee0] bq. I'm not

[jira] [Commented] (YARN-3197) Confusing log generated by CapacityScheduler

2015-02-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329410#comment-14329410 ] Hadoop QA commented on YARN-3197: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329359#comment-14329359 ] Wangda Tan commented on YARN-1963: -- That's great! Thanks. Support priorities across

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329357#comment-14329357 ] Wangda Tan commented on YARN-1963: -- That's great! Thanks. Support priorities across

[jira] [Resolved] (YARN-3003) Provide API for client to retrieve label to node mapping

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-3003. -- Resolution: Duplicate [~varun_saxena], Thanks for reminding, I just reopen and then resolved as

[jira] [Reopened] (YARN-3003) Provide API for client to retrieve label to node mapping

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-3003: -- Provide API for client to retrieve label to node mapping

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-02-20 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329376#comment-14329376 ] Naganarasimha G R commented on YARN-2495: - Hi [~wangda], Thanks for discussing and

[jira] [Commented] (YARN-2495) Allow admin specify labels from each NM (Distributed configuration)

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329399#comment-14329399 ] Wangda Tan commented on YARN-2495: -- For your questions: 1. It's not first priority, let's

[jira] [Commented] (YARN-3197) Confusing log generated by CapacityScheduler

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329425#comment-14329425 ] Wangda Tan commented on YARN-3197: -- I think non-alive container is not correct, since all

[jira] [Commented] (YARN-3131) YarnClientImpl should check FAILED and KILLED state in submitApplication

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329856#comment-14329856 ] Wangda Tan commented on YARN-3131: -- Hi [~lichangleo], Thanks for working on this, some

[jira] [Commented] (YARN-2986) (Umbrella) Support hierarchical and unified scheduler configuration

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329921#comment-14329921 ] Wangda Tan commented on YARN-2986: -- Ver.1 patch uploaded to YARN-3233 (Umbrella) Support

[jira] [Commented] (YARN-2854) The document about timeline service and generic service needs to be updated

2015-02-20 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329431#comment-14329431 ] Naganarasimha G R commented on YARN-2854: - Hi [~zjshen], Based on earlier

[jira] [Commented] (YARN-3197) Confusing log generated by CapacityScheduler

2015-02-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329435#comment-14329435 ] Varun Saxena commented on YARN-3197: Hmm...Non-alive was to indicate that its not found

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-02-20 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329436#comment-14329436 ] Marcelo Vanzin commented on YARN-2423: -- Hey everybody, Just wanted to point out that

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329442#comment-14329442 ] Li Lu commented on YARN-3166: - Hello guys, sorry for the late reply... bq. RM and NM modules

[jira] [Commented] (YARN-3197) Confusing log generated by CapacityScheduler

2015-02-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329441#comment-14329441 ] Wangda Tan commented on YARN-3197: -- If so, you should indicate this container cannot be

  1   2   >