[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696271#comment-14696271 ] Li Lu commented on YARN-4025: - Oh and, BTW, why are we changing Separator.VALUES? > Deal with

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696268#comment-14696268 ] Li Lu commented on YARN-4025: - Hi [~sjlee0], thanks for the work! The patch overall LGTM. One s

[jira] [Commented] (YARN-3862) Decide which contents to retrieve and send back in response in TimelineReader

2015-08-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14696131#comment-14696131 ] Li Lu commented on YARN-3862: - Hi [~varun_saxena], thanks for working on this! After looking at

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681312#comment-14681312 ] Li Lu commented on YARN-3814: - Thank [~varun_saxena]! bq. So if GenericObjectMapper cannot co

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681029#comment-14681029 ] Li Lu commented on YARN-3814: - Hi [~varun_saxena], thanks for the work. I've gone through the l

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680920#comment-14680920 ] Li Lu commented on YARN-3906: - Latest patch LGTM. While it appears possible to remove some code

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680778#comment-14680778 ] Li Lu commented on YARN-3814: - bq. We have a JIRA for aggregation implementation for reader sid

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680396#comment-14680396 ] Li Lu commented on YARN-3814: - HI [~varun_saxena], any updates on this JIRA? Thanks! > REST A

[jira] [Commented] (YARN-4025) Deal with byte representations of Longs in writer code

2015-08-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14680393#comment-14680393 ] Li Lu commented on YARN-4025: - Hi [~sjlee0][~vrushalic], I slightly prefer to firstly move with

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662678#comment-14662678 ] Li Lu commented on YARN-3814: - Oh and one more thing, {{parseKeyStrValuesStr}} and {{parseKeySt

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-08-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662672#comment-14662672 ] Li Lu commented on YARN-3814: - Thanks [~varun_saxena] for working on this JIRA! I looked at the

[jira] [Commented] (YARN-3368) Improve YARN web UI

2015-08-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662545#comment-14662545 ] Li Lu commented on YARN-3368: - Hi [~jianhe] thanks for opening this JIRA. Right now on the YARN

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14662245#comment-14662245 ] Li Lu commented on YARN-3906: - I looked at the dependency relations among our current outgoing

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14661007#comment-14661007 ] Li Lu commented on YARN-3049: - I checked EntityRowKey.java and seems like we never convert flow

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660935#comment-14660935 ] Li Lu commented on YARN-3049: - bq. Also, to Li Lu's point, we should provide an additional api

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660902#comment-14660902 ] Li Lu commented on YARN-3049: - A little bit more investigation shows that we're using Strings f

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660877#comment-14660877 ] Li Lu commented on YARN-3049: - Hi [~vrushalic], I think the conversion to string happens on the

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14660826#comment-14660826 ] Li Lu commented on YARN-3906: - Hi [~sjlee0], sorry about the delay. The latest patch LGTM, howe

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-08-06 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.008.patch v008 patch, rebase to latest YARN-2928 branch. > Refactor timelineservice

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

2015-08-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659121#comment-14659121 ] Li Lu commented on YARN-3045: - bq. To speed up this JIRA's progress, I am fine with keep ignori

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-08-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659016#comment-14659016 ] Li Lu commented on YARN-3904: - Thanks [~sjlee0]! Any other comments from anyone? This JIRA is c

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14659012#comment-14659012 ] Li Lu commented on YARN-3049: - Hi [~zjshen], letting HBase implementation locally looks good to

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-08-03 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652850#comment-14652850 ] Li Lu commented on YARN-3049: - bq. What we discussed so far implies that we cannot only treat t

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-08-03 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.007.patch Thanks [~zjshen] and [~sjlee0]! I've uploaded v007 patch to address your c

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-31 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14650014#comment-14650014 ] Li Lu commented on YARN-3984: - Hi [~vrushalic], thanks for the patch. The current patch LGTM (p

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-31 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.006.patch Upload the 006 version of the patch. In this patch I addressed most of [~z

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648530#comment-14648530 ] Li Lu commented on YARN-3906: - Thanks [~sjlee0] for the clarification! Yes, that's a pretty pai

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648521#comment-14648521 ] Li Lu commented on YARN-3984: - Thanks! I think I'm leaning towards to eventid#inverse_event_tim

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648499#comment-14648499 ] Li Lu commented on YARN-3984: - Hi [~vrushalic], one quick question. I'm a little bit confused b

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648363#comment-14648363 ] Li Lu commented on YARN-3906: - ...fixing formatting problems... bq. Hi Sangjin Lee, I looked a

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648359#comment-14648359 ] Li Lu commented on YARN-3906: - Hi [~sjlee0], I looked at the patch, and have one general questi

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648243#comment-14648243 ] Li Lu commented on YARN-3049: - Hi [~zjshen]! Some of my comments: bq. As I see a lot of argume

[jira] [Commented] (YARN-3906) split the application table from the entity table

2015-07-30 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14648125#comment-14648125 ] Li Lu commented on YARN-3906: - Thanks for the patch [~sjlee0]! I'll take a look at it this afte

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647132#comment-14647132 ] Li Lu commented on YARN-3904: - The two failed tests passed on my local machine, and the failure

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.005.patch Refreshed my patch according to [~sjlee0]'s comments. Specifically, I set u

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646942#comment-14646942 ] Li Lu commented on YARN-3984: - See [~zjshen]'s comments as well as the discussions in YARN-3049

[jira] [Commented] (YARN-3984) Rethink event column key issue

2015-07-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646940#comment-14646940 ] Li Lu commented on YARN-3984: - Yes. This defect is blocking YARN-3049. Linking the two JIRAs to

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646893#comment-14646893 ] Li Lu commented on YARN-3049: - Hi [~zjshen], some of my comments: - The addition on {{newApp}}

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646465#comment-14646465 ] Li Lu commented on YARN-3049: - Thanks [~zjshen]! For now I think it's fine to include the chang

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645348#comment-14645348 ] Li Lu commented on YARN-3904: - Hi [~sjlee0], thanks so much for the review! Some quick comments

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645196#comment-14645196 ] Li Lu commented on YARN-3049: - Given the progress on YARN-3949, shall we focus back onto this J

[jira] [Updated] (YARN-3817) [Aggregation] Flow and User level aggregation on Application States table

2015-07-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3817: Description: We need time-based flow/user level aggregation to present flow/user related states to end users. Flow l

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644998#comment-14644998 ] Li Lu commented on YARN-3904: - Could anyone please review this patch? Thanks! > Refactor time

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643842#comment-14643842 ] Li Lu commented on YARN-3904: - Thanks for the info! I'll keep the aggregate method intact. We c

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.004.patch Update the 004 version of the patch. This patch addresses the following two

[jira] [Commented] (YARN-3816) [Aggregation] App-level Aggregation for YARN system metrics

2015-07-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643504#comment-14643504 ] Li Lu commented on YARN-3816: - Thanks for the clarification [~vrushalic]! Yes the problem is wi

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643421#comment-14643421 ] Li Lu commented on YARN-3908: - Just a quick check about the current status of this JIRA. Are we

[jira] [Commented] (YARN-3816) [Aggregation] App-level Aggregation for YARN system metrics

2015-07-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643388#comment-14643388 ] Li Lu commented on YARN-3816: - bq. I'm still very confused by the usage of the word "aggregate"

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-27 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643048#comment-14643048 ] Li Lu commented on YARN-3908: - Hi [~sjlee0], I'm OK with checking this in and address the event

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641180#comment-14641180 ] Li Lu commented on YARN-3904: - One question about our current writer design is, do we have a de

[jira] [Commented] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641139#comment-14641139 ] Li Lu commented on YARN-3904: - Will finish the refactoring work after the bug fix patch is in.

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14641136#comment-14641136 ] Li Lu commented on YARN-3908: - bq. It would be good to get the patch for YARN-3908 checked in (

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Description: After we finished the design for time-based aggregation, we can adopt our existing Phoenix storage into

[jira] [Updated] (YARN-3904) Refactor timelineservice.storage to add support to online and offline aggregation writers

2015-07-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Summary: Refactor timelineservice.storage to add support to online and offline aggregation writers (was: Adopt Phoen

[jira] [Commented] (YARN-3949) ensure timely flush of timeline writes

2015-07-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14640935#comment-14640935 ] Li Lu commented on YARN-3949: - bq. The current approach seems to be good now, I propose to go w

[jira] [Commented] (YARN-3949) ensure timely flush of timeline writes

2015-07-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14640784#comment-14640784 ] Li Lu commented on YARN-3949: - On top of the current patch, how about have two simple write API

[jira] [Commented] (YARN-3949) ensure timely flush of timeline writes

2015-07-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639289#comment-14639289 ] Li Lu commented on YARN-3949: - I checked AbstractService and seems like it's not possible for a

[jira] [Commented] (YARN-3949) ensure timely flush of timeline writes

2015-07-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639264#comment-14639264 ] Li Lu commented on YARN-3949: - Hi [~sjlee0], thanks for the patch! I think the patch LGTM in ge

[jira] [Commented] (YARN-3904) Adopt PhoenixTimelineWriter into time-based aggregation storage

2015-07-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637359#comment-14637359 ] Li Lu commented on YARN-3904: - I'm canceling the current patch since I'm planning to post a mor

[jira] [Assigned] (YARN-3817) [Aggregation] Flow and User level aggregation on Application States table

2015-07-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-3817: --- Assignee: Li Lu (was: Junping Du) > [Aggregation] Flow and User level aggregation on Application States table

[jira] [Resolved] (YARN-3595) Performance optimization using connection cache of Phoenix timeline writer

2015-07-22 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu resolved YARN-3595. - Resolution: Later Since we're moving phoenix storage to aggregation side, we need to fix this after we have a full

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636058#comment-14636058 ] Li Lu commented on YARN-3908: - Hi [~sjlee0], I think the code you posted here belongs to timeli

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-21 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14636009#comment-14636009 ] Li Lu commented on YARN-3908: - Hi [~sjlee0], I don't think we're still using event type in new

[jira] [Commented] (YARN-3908) Bugs in HBaseTimelineWriterImpl

2015-07-16 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14630769#comment-14630769 ] Li Lu commented on YARN-3908: - Hi [~sjlee0], one nit: the name {{readTimeseriesResults}} looks

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628713#comment-14628713 ] Li Lu commented on YARN-3814: - Oops sorry I was replying a wrong message... > REST API implem

[jira] [Commented] (YARN-3814) REST API implementation for getting raw entities in TimelineReader

2015-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628711#comment-14628711 ] Li Lu commented on YARN-3814: - OK, thanks [~zjshen]! > REST API implementation for getting ra

[jira] [Commented] (YARN-3914) Entity created time should be part of the row key of entity table

2015-07-15 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14628681#comment-14628681 ] Li Lu commented on YARN-3914: - Hi [~zjshen], do you think this will affect the data schema desi

[jira] [Commented] (YARN-3049) [Storage Implementation] Implement storage reader interface to fetch raw data from HBase backend

2015-07-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14627349#comment-14627349 ] Li Lu commented on YARN-3049: - Hi [~zjshen], I have a concern similar to [~sjlee0]'s, on readin

[jira] [Updated] (YARN-3904) Adopt PhoenixTimelineWriter into time-based aggregation storage

2015-07-13 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.003.patch Fix findbugs warnings and some code formatting. > Adopt PhoenixTimelineWr

[jira] [Updated] (YARN-3904) Adopt PhoenixTimelineWriter into time-based aggregation storage

2015-07-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.002.patch Oops, forgot to add ASF licensing info for one file... > Adopt PhoenixTime

[jira] [Updated] (YARN-3904) Adopt PhoenixTimelineWriter into time-based aggregation storage

2015-07-10 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3904: Attachment: YARN-3904-YARN-2928.001.patch I moved the Phoenix writer to the time based aggregation package, and rebui

[jira] [Updated] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3836: Attachment: YARN-3836-YARN-2928.004.patch Fixed. Thanks for the catch [~sjlee0]! > add equals and hashCode to Timel

[jira] [Updated] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3836: Attachment: YARN-3836-YARN-2928.003.patch Thanks [~sjlee0] for the review! I addressed your comments in the v3 patch,

[jira] [Created] (YARN-3904) Adopt PhoenixTimelineWriter into time-based aggregation storage

2015-07-09 Thread Li Lu (JIRA)
Li Lu created YARN-3904: --- Summary: Adopt PhoenixTimelineWriter into time-based aggregation storage Key: YARN-3904 URL: https://issues.apache.org/jira/browse/YARN-3904 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-09 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14620861#comment-14620861 ] Li Lu commented on YARN-3836: - bq. Regarding metric, can't id uniquely identify a metric ? Do w

[jira] [Updated] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3836: Attachment: YARN-3836-YARN-2928.002.patch Hi [~sjlee0], thanks for the prompt feedback! I updated the patch according

[jira] [Updated] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3836: Attachment: YARN-3836-YARN-2928.001.patch In this patch I added equals and hashCode methods to timeline entity and r

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619245#comment-14619245 ] Li Lu commented on YARN-3836: - Thanks [~vrushalic]! > add equals and hashCode to TimelineEntit

[jira] [Resolved] (YARN-3899) Add equals and hashCode to TimelineEntity

2015-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu resolved YARN-3899. - Resolution: Duplicate Duplicate to YARN-3836. > Add equals and hashCode to TimelineEntity > -

[jira] [Commented] (YARN-3836) add equals and hashCode to TimelineEntity and other classes in the data model

2015-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14619140#comment-14619140 ] Li Lu commented on YARN-3836: - Hi [~vrushalic], I'd like to check the progress of this JIRA. Cu

[jira] [Updated] (YARN-3899) Add equals and hashCode to TimelineEntity

2015-07-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3899: Issue Type: Sub-task (was: Improvement) Parent: YARN-2928 > Add equals and hashCode to TimelineEntity >

[jira] [Created] (YARN-3899) Add equals and hashCode to TimelineEntity

2015-07-08 Thread Li Lu (JIRA)
Li Lu created YARN-3899: --- Summary: Add equals and hashCode to TimelineEntity Key: YARN-3899 URL: https://issues.apache.org/jira/browse/YARN-3899 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-3817) [Aggregation] Flow and User level aggregation on Application States table

2015-07-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14617537#comment-14617537 ] Li Lu commented on YARN-3817: - I did some rough estimation on the resource consumption for the

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606510#comment-14606510 ] Li Lu commented on YARN-3051: - OK, linked all related JIRAs to this one. Feel free to add more.

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-29 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606458#comment-14606458 ] Li Lu commented on YARN-3051: - Hi [~varun_saxena], thanks for the patch! I think this version i

[jira] [Updated] (YARN-3858) Distributed shell app master becomes unresponsive sometimes even when there hasn't been an AM restart

2015-06-26 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3858: Assignee: Varun Vasudev > Distributed shell app master becomes unresponsive sometimes even when there > hasn't been

[jira] [Updated] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

2015-06-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3815: Assignee: Junping Du (was: Li Lu) > [Aggregation] Application/Flow/User/Queue Level Aggregations > -

[jira] [Commented] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

2015-06-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600411#comment-14600411 ] Li Lu commented on YARN-3815: - Sorry I mistakenly assigned this JIRA to myself. I've assigned b

[jira] [Assigned] (YARN-3815) [Aggregation] Application/Flow/User/Queue Level Aggregations

2015-06-24 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-3815: --- Assignee: Li Lu (was: Junping Du) > [Aggregation] Application/Flow/User/Queue Level Aggregations > --

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14584197#comment-14584197 ] Li Lu commented on YARN-3051: - bq. APIs' for querying individual entity/flow/flow run/user and

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583878#comment-14583878 ] Li Lu commented on YARN-3051: - I verified locally that the pre-patch findbugs warnings no longe

[jira] [Commented] (YARN-3051) [Storage abstraction] Create backing storage read interface for ATS readers

2015-06-12 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14583839#comment-14583839 ] Li Lu commented on YARN-3051: - Hi [~varun_saxena], thanks for the update! Some of my quick thou

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

2015-06-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14577891#comment-14577891 ] Li Lu commented on YARN-2928: - Oh one more thing [~jamestaylor], are there any plans to make th

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

2015-06-08 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14577885#comment-14577885 ] Li Lu commented on YARN-2928: - Hi [~jamestaylor], thank you very much for your great help! Some

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

2015-06-05 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14575358#comment-14575358 ] Li Lu commented on YARN-2928: - Hi [~jamestaylor] Thank you very much for your suggestions and

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

2015-06-03 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571765#comment-14571765 ] Li Lu commented on YARN-2928: - Thanks [~sjlee0], [~jrottinghuis], and [~vrushalic] for hosting

[jira] [Updated] (YARN-3765) Fix findbugs the warning in YARN-2928 branch, TimelineMetric

2015-06-03 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3765: Description: There is one warning about reversing the return value of comparisons in YARN-2928 branch. This is a val

[jira] [Updated] (YARN-3765) Fix findbugs the warning in YARN-2928 branch, TimelineMetric

2015-06-03 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3765: Attachment: YARN-3765-YARN-2928.001.patch I looked into the warning message, and now I believe it's not a false alarm

[jira] [Created] (YARN-3765) Fix findbugs the warning in YARN-2928 branch, TimelineMetric

2015-06-03 Thread Li Lu (JIRA)
Li Lu created YARN-3765: --- Summary: Fix findbugs the warning in YARN-2928 branch, TimelineMetric Key: YARN-3765 URL: https://issues.apache.org/jira/browse/YARN-3765 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3276) Refactor and fix null casting in some map cast for TimelineEntity (old and new) and fix findbug warnings

2015-06-03 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571610#comment-14571610 ] Li Lu commented on YARN-3276: - The -1 appears to be irrelevant to the fix in this patch. I can

<    4   5   6   7   8   9   10   11   12   13   >