[jira] [Updated] (YARN-2295) Update Client of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Summary: Update Client of YARN distributed shell with existing public stable API (was: Updating Client of YARN

[jira] [Updated] (YARN-2295) Updating Client of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: YARN-2295-071514.patch Replacing the unstable privately visible Records.newRecord method with the

[jira] [Created] (YARN-2296) Update Application Master of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
Li Lu created YARN-2296: --- Summary: Update Application Master of YARN distributed shell with existing public stable API Key: YARN-2296 URL: https://issues.apache.org/jira/browse/YARN-2296 Project: Hadoop YARN

[jira] [Updated] (YARN-2295) Update Client of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: YARN-2295-071514-1.patch Updated patch with refactoring in both AM and Client Update Client of YARN

[jira] [Updated] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Description: Some API calls in YARN distributed shell have been marked as unstable and private. Use existing public

[jira] [Resolved] (YARN-2296) Update Application Master of YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu resolved YARN-2296. - Resolution: Duplicate Merged into YARN-2295 Update Application Master of YARN distributed shell with existing

[jira] [Updated] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: YARN-2295-071514-1.patch Could not reappear the UT failure locally. Resubmitting this patch to see if

[jira] [Updated] (YARN-2295) Refactor YARN distributed shell with existing public stable API

2014-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2295: Attachment: (was: YARN-2295-071514-1.patch) Refactor YARN distributed shell with existing public stable API

[jira] [Commented] (YARN-2785) TestContainerResourceUsage fails intermittently

2014-10-31 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192630#comment-14192630 ] Li Lu commented on YARN-2785: - Hi [~vvasudev]! This patch looks good to me. Thanks!

[jira] [Commented] (YARN-2819) NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

2014-11-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14202573#comment-14202573 ] Li Lu commented on YARN-2819: - Hi [~zjshen]! I reviewed this patch, and it looks good to me.

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-11-25 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14225490#comment-14225490 ] Li Lu commented on YARN-2837: - Hi [~zjshen], I reviewed your patch. Generally it looks good. I

[jira] [Updated] (YARN-2032) Implement a scalable, available TimelineStore using HBase

2014-12-01 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2032: Target Version/s: 2.7.0 (was: 2.6.0) Implement a scalable, available TimelineStore using HBase

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14232210#comment-14232210 ] Li Lu commented on YARN-2837: - Hi [~zjshen], this version looks good to me (disabling the

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-03 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14233294#comment-14233294 ] Li Lu commented on YARN-2837: - Agree to [~zjshen]'s suggestion. Let's do that in a separate

[jira] [Commented] (YARN-2837) Timeline server needs to recover the timeline DT when restarting

2014-12-04 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14234844#comment-14234844 ] Li Lu commented on YARN-2837: - {quote} Logic in Version loadedVersion = loadVersion(); Consider

[jira] [Updated] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2939: Attachment: YARN-2939-120914.patch In this patch I fixed findbugs 3 warnings in hadoop-yarn-common. I added

[jira] [Updated] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2939: Attachment: (was: YARN-2939-120914.patch) Fix new findbugs warnings in hadoop-yarn-common

[jira] [Updated] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2939: Attachment: YARN-2939-120914.patch Jenkins result looks weird. Kick it again. Fix new findbugs warnings in

[jira] [Commented] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14240450#comment-14240450 ] Li Lu commented on YARN-2939: - I could not reproduce the test failures locally. For the results

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: YARN-2940-121014.patch I this patch I fixed warnings from findbugs 3. Most of them are related to

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: (was: YARN-2940-121014.patch) Fix new findbugs warnings in rest of the hadoop-yarn components

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: YARN-2940-121014.patch Kick Jenkins Fix new findbugs warnings in rest of the hadoop-yarn components

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: YARN-2940-121014-1.patch Rebuild the patch to see if there's something wrong in the patch itself. Fix

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-11 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14242890#comment-14242890 ] Li Lu commented on YARN-2940: - Similar to the patch of YARN-2939, I could not reproduce the

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: findbugs_report_yarn.zip I'm attaching the findbugs reports for the related components. Fix new

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14248931#comment-14248931 ] Li Lu commented on YARN-2940: - Hi [~varun_saxena], you can firstly run {{mvn

[jira] [Updated] (YARN-2939) Fix new findbugs warnings in hadoop-yarn-common

2014-12-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2939: Attachment: YARN-2939-121614.patch Hi [~djp], thanks for your review! I've addressed your comments in this new

[jira] [Updated] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-2940: Attachment: YARN-2940-122314.patch Thanks [~djp] for the review! I updated the patch according to you suggestions.

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257759#comment-14257759 ] Li Lu commented on YARN-2940: - Similar to last time, the two UT failures are irrelevant to the

[jira] [Commented] (YARN-2940) Fix new findbugs warnings in rest of the hadoop-yarn components

2014-12-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257776#comment-14257776 ] Li Lu commented on YARN-2940: - Thanks [~djp]. I agree that this looks very weird because we're

[jira] [Created] (YARN-3155) Refactor the exception handling code for TimelineClientImpl's retryOn method

2015-02-06 Thread Li Lu (JIRA)
Li Lu created YARN-3155: --- Summary: Refactor the exception handling code for TimelineClientImpl's retryOn method Key: YARN-3155 URL: https://issues.apache.org/jira/browse/YARN-3155 Project: Hadoop YARN

[jira] [Updated] (YARN-3155) Refactor the exception handling code for TimelineClientImpl's retryOn method

2015-02-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3155: Attachment: YARN-3155-020615.patch In this patch I refactored the catch blocks in TimelineClientConnectionRetry's

[jira] [Commented] (YARN-3037) create HBase cluster backing storage implementation for ATS writes

2015-01-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282094#comment-14282094 ] Li Lu commented on YARN-3037: - Thanks [~zjshen] for pointing me to this. I agree that the

[jira] [Commented] (YARN-3091) [Umbrella] Improve locks of RM scheduler

2015-01-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288633#comment-14288633 ] Li Lu commented on YARN-3091: - Maybe we want to tweak the wording/organization of this JIRA a

[jira] [Commented] (YARN-3091) [Umbrella] Improve locks of RM scheduler

2015-01-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3091?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288755#comment-14288755 ] Li Lu commented on YARN-3091: - I agree we should review the exclude list for potential

[jira] [Commented] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325288#comment-14325288 ] Li Lu commented on YARN-3041: - Looked at the patch briefly and in general it LGTM. I would

[jira] [Created] (YARN-3210) Refactor timeline aggregator according to new code organization

2015-02-17 Thread Li Lu (JIRA)
Li Lu created YARN-3210: --- Summary: Refactor timeline aggregator according to new code organization Key: YARN-3210 URL: https://issues.apache.org/jira/browse/YARN-3210 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-3210) [Code organization] Refactor timeline aggregator according to new code organization

2015-02-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3210: Summary: [Code organization] Refactor timeline aggregator according to new code organization (was: Refactor

[jira] [Updated] (YARN-3210) [Source organization] Refactor timeline aggregator according to new code organization

2015-02-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3210: Summary: [Source organization] Refactor timeline aggregator according to new code organization (was: [Code

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325231#comment-14325231 ] Li Lu commented on YARN-3166: - Some notes about the current code organization arrangements: #

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325243#comment-14325243 ] Li Lu commented on YARN-3166: - Comments are more than welcome. Specifically, we may want to

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14325229#comment-14325229 ] Li Lu commented on YARN-3166: - I've updated the proposed package/module structures. We may want

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326538#comment-14326538 ] Li Lu commented on YARN-3166: - Hi [~sjlee0], [~rkanter], [~zjshen] and [~vinodkv], would

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-02-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326630#comment-14326630 ] Li Lu commented on YARN-3034: - Hi [~Naganarasimha], thanks for the patch! I briefly looked at

[jira] [Commented] (YARN-3033) [Aggregator wireup] Implement NM starting the ATS writer companion

2015-02-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318833#comment-14318833 ] Li Lu commented on YARN-3033: - Hi [~sjlee0] and [~devaraj.k], I've already started thinking on

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-02-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328346#comment-14328346 ] Li Lu commented on YARN-3034: - I agree that the RM may have a derived type of aggregator.

[jira] [Assigned] (YARN-3033) [Aggregator wireup] Implement NM starting the ATS writer companion

2015-02-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-3033: --- Assignee: Li Lu (was: Devaraj K) [Aggregator wireup] Implement NM starting the ATS writer companion

[jira] [Commented] (YARN-3033) [Aggregator wireup] Implement NM starting the ATS writer companion

2015-02-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320469#comment-14320469 ] Li Lu commented on YARN-3033: - OK, thanks! [Aggregator wireup] Implement NM starting the ATS

[jira] [Assigned] (YARN-3166) Decide detailed package structures for timeline service v2 components

2015-02-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-3166: --- Assignee: Li Lu Decide detailed package structures for timeline service v2 components

[jira] [Updated] (YARN-3166) Decide detailed package structures for timeline service v2 components

2015-02-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3166: Issue Type: Sub-task (was: Task) Parent: YARN-2928 Decide detailed package structures for timeline service

[jira] [Created] (YARN-3166) Decide detailed package structures for timeline service v2 components

2015-02-10 Thread Li Lu (JIRA)
Li Lu created YARN-3166: --- Summary: Decide detailed package structures for timeline service v2 components Key: YARN-3166 URL: https://issues.apache.org/jira/browse/YARN-3166 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-3166) Decide detailed package structures for timeline service v2 components

2015-02-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3166: Description: Open this JIRA to track all discussions on detailed package structures for timeline services v2. This

[jira] [Commented] (YARN-3166) Decide detailed package structures for timeline service v2 components

2015-02-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14315089#comment-14315089 ] Li Lu commented on YARN-3166: - Thanks [~zjshen]! I think this can be a good starting point, and

[jira] [Updated] (YARN-3155) Refactor the exception handling code for TimelineClientImpl's retryOn method

2015-02-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3155: Attachment: YARN-3155-020915.patch Refreshed the patch to remove the unnecessary comments. Refactor the exception

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321090#comment-14321090 ] Li Lu commented on YARN-3166: - Sent the message by mistake before I finish. Here's the rest

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321082#comment-14321082 ] Li Lu commented on YARN-3166: - Discussed with [~vinodkv], [~zjshen] and [~djp] offline, and

[jira] [Commented] (YARN-3087) [Aggregator implementation] the REST server (web server) for per-node aggregator does not work if it runs inside node manager

2015-02-18 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14326830#comment-14326830 ] Li Lu commented on YARN-3087: - I found this issue (#635 of Guice,

[jira] [Commented] (YARN-3033) [Aggregator wireup] Implement NM starting the ATS writer companion

2015-02-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14329671#comment-14329671 ] Li Lu commented on YARN-3033: - Hi [~sjlee0], thanks for the comments! I thing I used the wrong

[jira] [Updated] (YARN-3033) [Aggregator wireup] Implement NM starting the ATS writer companion

2015-02-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3033: Attachment: MappingandlaunchingApplevelTimelineaggregators.pdf Since there are some confusions on our current design

[jira] [Commented] (YARN-3033) [Aggregator wireup] Implement NM starting the ATS writer companion

2015-02-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14328375#comment-14328375 ] Li Lu commented on YARN-3033: - Thanks [~djp]! Some quick comments: bq. I think we should

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-03-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363899#comment-14363899 ] Li Lu commented on YARN-3034: - bq. For the DistributedShell from Junping Du's comment, i

[jira] [Commented] (YARN-3040) [Data Model] Implement client-side API for handling flows

2015-03-17 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14366614#comment-14366614 ] Li Lu commented on YARN-3040: - Quick comment: In my understanding the flow based API is used in

[jira] [Commented] (YARN-3352) [Event producers] Change distributed shell to use TIMELINE_SERVICE_VERSION

2015-03-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363902#comment-14363902 ] Li Lu commented on YARN-3352: - Some quick descriptions moved from YARN-3034: bq. my problem is

[jira] [Created] (YARN-3380) Add protobuf compatibility checker to jenkins test runs

2015-03-19 Thread Li Lu (JIRA)
Li Lu created YARN-3380: --- Summary: Add protobuf compatibility checker to jenkins test runs Key: YARN-3380 URL: https://issues.apache.org/jira/browse/YARN-3380 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-3378) a load test client that can replay a volume of history files

2015-03-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14370784#comment-14370784 ] Li Lu commented on YARN-3378: - Hi [~Naganarasimha], YARN-2556 was mainly opened for measuring

[jira] [Commented] (YARN-3334) [Event Producers] NM start to posting some app related metrics in early POC stage of phase 2.

2015-03-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372329#comment-14372329 ] Li Lu commented on YARN-3334: - Hi [~djp], thanks for the patch! I'd like to review it later,

[jira] [Updated] (YARN-3383) AdminService should use warn instead of info to log exception when operation fails

2015-03-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3383: Attachment: YARN-3383-032015.patch Agree. Upload a simple patch to quickly fix this problem. AdminService should

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-03-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372277#comment-14372277 ] Li Lu commented on YARN-3047: - Hi [~varun_saxena]! Thanks for the patch. Here are some of my

[jira] [Assigned] (YARN-3383) AdminService should use warn instead of info to log exception when operation fails

2015-03-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-3383: --- Assignee: Li Lu AdminService should use warn instead of info to log exception when operation fails

[jira] [Updated] (YARN-3383) AdminService should use warn instead of info to log exception when operation fails

2015-03-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3383: Priority: Minor (was: Major) AdminService should use warn instead of info to log exception when operation fails

[jira] [Updated] (YARN-3383) AdminService should use warn instead of info to log exception when operation fails

2015-03-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3383: Priority: Major (was: Minor) AdminService should use warn instead of info to log exception when operation fails

[jira] [Commented] (YARN-3040) [Data Model] Make putEntities operation be aware of the app's context

2015-03-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14372384#comment-14372384 ] Li Lu commented on YARN-3040: - Hi [~zjshen], some quick thoughts... bq. It sounds like each NM

[jira] [Assigned] (YARN-3378) a load test client that can replay a volume of history files

2015-03-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-3378: --- Assignee: Li Lu a load test client that can replay a volume of history files

[jira] [Commented] (YARN-3033) [Aggregator wireup] Implement NM starting the standalone ATS writer companion

2015-03-19 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14369697#comment-14369697 ] Li Lu commented on YARN-3033: - As the discussed functions of aggregator collections, we may

[jira] [Commented] (YARN-3378) a load test client that can replay a volume of history files

2015-03-20 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14371626#comment-14371626 ] Li Lu commented on YARN-3378: - Thanks [~Naganarasimha] for reminding me YARN-2556. I looked at

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-03-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14363691#comment-14363691 ] Li Lu commented on YARN-3034: - I've looked at the latest patch. Applied it on my local machine

[jira] [Updated] (YARN-3352) [Event producers] Change distributed shell to use TIMELINE_SERVICE_VERSION

2015-03-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3352: Summary: [Event producers] Change distributed shell to use TIMELINE_SERVICE_VERSION (was: Change distributed shell

[jira] [Created] (YARN-3352) Change distributed shell to use TIMELINE_SERVICE_VERSION

2015-03-16 Thread Li Lu (JIRA)
Li Lu created YARN-3352: --- Summary: Change distributed shell to use TIMELINE_SERVICE_VERSION Key: YARN-3352 URL: https://issues.apache.org/jira/browse/YARN-3352 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3087) [Aggregator implementation] the REST server (web server) for per-node aggregator does not work if it runs inside node manager

2015-03-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351137#comment-14351137 ] Li Lu commented on YARN-3087: - Hi [~sjlee0]! Sorry I didn't notice the standalone process for

[jira] [Commented] (YARN-3087) [Aggregator implementation] the REST server (web server) for per-node aggregator does not work if it runs inside node manager

2015-03-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351196#comment-14351196 ] Li Lu commented on YARN-3087: - Yes. Worked on my machine, too. Let's separate the two modes in

[jira] [Commented] (YARN-3087) [Aggregator implementation] the REST server (web server) for per-node aggregator does not work if it runs inside node manager

2015-03-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14351162#comment-14351162 ] Li Lu commented on YARN-3087: - Hi [~sjlee0]. Thanks for reminding me this. I just double

[jira] [Commented] (YARN-3047) [Data Serving] Set up ATS reader with basic request serving structure and lifecycle

2015-03-11 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14357618#comment-14357618 ] Li Lu commented on YARN-3047: - Hi [~varun_saxena], thanks for updating this patch! I have a

[jira] [Commented] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14349352#comment-14349352 ] Li Lu commented on YARN-3264: - Thanks [~vrushalic]! Applied the v6 patch and tested locally,

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-03-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14360823#comment-14360823 ] Li Lu commented on YARN-3034: - Hi [~Naganarasimha], thanks for the clarification. I think this

[jira] [Created] (YARN-3330) Implement a protobuf compatibility checker to check if a patch breaks the compatibility with existing client and internal protocols

2015-03-10 Thread Li Lu (JIRA)
Li Lu created YARN-3330: --- Summary: Implement a protobuf compatibility checker to check if a patch breaks the compatibility with existing client and internal protocols Key: YARN-3330 URL:

[jira] [Updated] (YARN-3330) Implement a protobuf compatibility checker to check if a patch breaks the compatibility with existing client and internal protocols

2015-03-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3330: Attachment: pdiff_patch.py Attach a very simple python tool to check if there are any incompatible changes in

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-03-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356263#comment-14356263 ] Li Lu commented on YARN-2928: - bq. can we defer the renaming work until that patch get in? I'm

[jira] [Commented] (YARN-3034) [Aggregator wireup] Implement RM starting its ATS writer

2015-03-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359364#comment-14359364 ] Li Lu commented on YARN-3034: - Hi [~Naganarasimha], thanks for updating the patch! Just a quick

[jira] [Commented] (YARN-3330) Implement a protobuf compatibility checker to check if a patch breaks the compatibility with existing client and internal protocols

2015-03-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14359254#comment-14359254 ] Li Lu commented on YARN-3330: - Hi [~aw], thanks for the suggestion! I will definitely bump this

[jira] [Commented] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node

2015-03-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355901#comment-14355901 ] Li Lu commented on YARN-3332: - Hi [~grey], I think it's a nice idea. I think after YARN-2928,

[jira] [Updated] (YARN-3330) Implement a protobuf compatibility checker to check if a patch breaks the compatibility with existing client and internal protocols

2015-03-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3330: Attachment: pdiff_patch.py Update the script to handle the case on file creation and removals. Reorganize the code

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14385577#comment-14385577 ] Li Lu commented on YARN-3334: - Hi [~djp], thanks for working on this! I checked the patch and

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-03-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386057#comment-14386057 ] Li Lu commented on YARN-3051: - I think for reader APIs,we need to support use cases both with

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387552#comment-14387552 ] Li Lu commented on YARN-3334: - OK, that solution LGTM. I'd like to double check if there are

[jira] [Commented] (YARN-3334) [Event Producers] NM TimelineClient life cycle handling and container metrics posting to new timeline service.

2015-03-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14387498#comment-14387498 ] Li Lu commented on YARN-3334: - Hi [~sjlee0], I have some quick questions about

[jira] [Created] (YARN-3426) Add jdiff support to YARN

2015-03-31 Thread Li Lu (JIRA)
Li Lu created YARN-3426: --- Summary: Add jdiff support to YARN Key: YARN-3426 URL: https://issues.apache.org/jira/browse/YARN-3426 Project: Hadoop YARN Issue Type: Sub-task Reporter: Li Lu

[jira] [Commented] (YARN-3276) Fix NPE and refactor in some map cast for TimelineEntity

2015-02-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14341185#comment-14341185 ] Li Lu commented on YARN-3276: - Hi [~djp], I totally agree that we should fix this. Patch LGTM.

[jira] [Updated] (YARN-3210) [Source organization] Refactor timeline aggregator according to new code organization

2015-03-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3210: Attachment: YARN-3210-030215.patch Thanks [~zjshen] and [~vinodkv] for the review! I've attached a new patch

[jira] [Commented] (YARN-3210) [Source organization] Refactor timeline aggregator according to new code organization

2015-03-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14343794#comment-14343794 ] Li Lu commented on YARN-3210: - The patch would not apply to normal Jenkins run since Jenkins is

[jira] [Updated] (YARN-3210) [Source organization] Refactor timeline aggregator according to new code organization

2015-03-02 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3210: Attachment: YARN-3210-030215_1.patch Thanks [~zjshen]! I've updated my patch according to your review. Specifically,

<    1   2   3   4   5   6   7   8   9   10   >