[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351247#comment-14351247 ] Zhijie Shen commented on YARN-3287: --- Thanks for updating the patch. I'll check it out. BT

[jira] [Updated] (YARN-1817) Synchronize RM and Generic History Service RESTful Web Services

2015-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1817: -- Component/s: webapp timelineserver resourcemanager > Synchronize RM and

[jira] [Commented] (YARN-3227) Timeline renew delegation token fails when RM user's TGT is expired

2015-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351064#comment-14351064 ] Zhijie Shen commented on YARN-3227: --- Yup, I didn't figure out a quick way to simulate the

[jira] [Commented] (YARN-3227) Timeline renew delegation token fails when RM user's TGT is expired

2015-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14351011#comment-14351011 ] Zhijie Shen commented on YARN-3227: --- Hi Jon, sorry for being hurry about this bug as it's

[jira] [Updated] (YARN-3227) Timeline renew delegation token fails when RM user's TGT is expired

2015-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3227: -- Attachment: YARN-3227.1.patch YARN-3227.test.patch The fix for this problem is straightfo

[jira] [Commented] (YARN-3227) Timeline renew delegation token fails when RM user's TGT is expired

2015-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350847#comment-14350847 ] Zhijie Shen commented on YARN-3227: --- We have encountered the issue too. In addition to re

[jira] [Assigned] (YARN-3299) Synchronize RM and Generic History Service Web-UIs

2015-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-3299: - Assignee: Zhijie Shen (was: Xuan Gong) > Synchronize RM and Generic History Service Web-UIs > ---

[jira] [Updated] (YARN-3299) Synchronize RM and Generic History Service Web-UIs

2015-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3299: -- Assignee: Xuan Gong (was: Zhijie Shen) > Synchronize RM and Generic History Service Web-UIs > --

[jira] [Updated] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1884: -- Target Version/s: 2.7.0 > ContainerReport should have nodeHttpAddress > -

[jira] [Updated] (YARN-1884) ContainerReport should have nodeHttpAddress

2015-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1884: -- Assignee: Xuan Gong (was: Zhijie Shen) > ContainerReport should have nodeHttpAddress > -

[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349705#comment-14349705 ] Zhijie Shen commented on YARN-3287: --- Btw, {{getAuthenticationMethod() == UserGroupInform

[jira] [Comment Edited] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349674#comment-14349674 ] Zhijie Shen edited comment on YARN-3287 at 3/6/15 12:27 AM: One

[jira] [Commented] (YARN-3287) TimelineClient kerberos authentication failure uses wrong login context.

2015-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349674#comment-14349674 ] Zhijie Shen commented on YARN-3287: --- One concern: moving ugi computation into init will m

[jira] [Assigned] (YARN-3227) Timeline renew delegation token fails when RM user's TGT is expired

2015-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-3227: - Assignee: Zhijie Shen > Timeline renew delegation token fails when RM user's TGT is expired >

[jira] [Commented] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14349578#comment-14349578 ] Zhijie Shen commented on YARN-3264: --- +1 LGTM, will commit the patch > [Storage implement

[jira] [Commented] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14348052#comment-14348052 ] Zhijie Shen commented on YARN-3264: --- The patch looks almost good. Two minor issue: 1. Sh

[jira] [Updated] (YARN-3264) [Storage implementation] Create backing storage write interface and a POC only file based storage implementation

2015-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3264: -- Summary: [Storage implementation] Create backing storage write interface and a POC only file based stora

[jira] [Resolved] (YARN-3031) [Storage abstraction] Create backing storage write interface for ATS writers

2015-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-3031. --- Resolution: Duplicate Since the patch there covers the code of the writer interface. Let's resolve thi

[jira] [Commented] (YARN-3264) [Storage implementation] Create a POC only file based storage implementation for ATS writes

2015-03-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14346355#comment-14346355 ] Zhijie Shen commented on YARN-3264: --- Overall, I think the patch should work. Some more de

[jira] [Commented] (YARN-3264) [Storage implementation] Create a POC only file based storage implementation for ATS writes

2015-03-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14346295#comment-14346295 ] Zhijie Shen commented on YARN-3264: --- Thanks for the patch, Vrushali! I'll review it. The

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-03-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14345828#comment-14345828 ] Zhijie Shen commented on YARN-2423: --- It seems that Spark wants the stable APIs. But we kn

[jira] [Resolved] (YARN-3210) [Source organization] Refactor timeline aggregator according to new code organization

2015-03-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-3210. --- Resolution: Fixed Fix Version/s: YARN-2928 Hadoop Flags: Reviewed Committed the patch to br

[jira] [Commented] (YARN-3210) [Source organization] Refactor timeline aggregator according to new code organization

2015-03-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14344096#comment-14344096 ] Zhijie Shen commented on YARN-3210: --- +1, LGTM > [Source organization] Refactor timeline

[jira] [Commented] (YARN-3276) Fix NPE and refactor in some map cast for TimelineEntity

2015-03-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14343832#comment-14343832 ] Zhijie Shen commented on YARN-3276: --- One nit: there's an existing TimelineUtils. > Fix N

[jira] [Commented] (YARN-3210) [Source organization] Refactor timeline aggregator according to new code organization

2015-03-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14343801#comment-14343801 ] Zhijie Shen commented on YARN-3210: --- Thanks Li! Some additional comments 1. Can we renam

[jira] [Commented] (YARN-3210) [Source organization] Refactor timeline aggregator according to new code organization

2015-03-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14343429#comment-14343429 ] Zhijie Shen commented on YARN-3210: --- Thanks for the patch. Two quick comments: 1. Can we

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341110#comment-14341110 ] Zhijie Shen commented on YARN-1809: --- Sigh, it conflicts with YARN-3262. We need to rebase

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341020#comment-14341020 ] Zhijie Shen commented on YARN-1809: --- +1. Will commit the patch once Jenkins comes back.

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340894#comment-14340894 ] Zhijie Shen commented on YARN-1809: --- Xuan, thanks for updating the patch. It looks good t

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1809: -- Target Version/s: 2.7.0 (was: 2.6.0) > Synchronize RM and Generic History Service Web-UIs >

[jira] [Commented] (YARN-3167) [Aggregator implementation] Implement the core functionality of the base aggregator service

2015-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340448#comment-14340448 ] Zhijie Shen commented on YARN-3167: --- Hi Vrushali, FYI, we have an integration test inside

[jira] [Resolved] (YARN-3125) [Event producers] Change distributed shell to use new timeline service

2015-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-3125. --- Resolution: Fixed Fix Version/s: YARN-2928 Hadoop Flags: Reviewed Committed to branch YARN-

[jira] [Commented] (YARN-3125) [Event producers] Change distributed shell to use new timeline service

2015-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340354#comment-14340354 ] Zhijie Shen commented on YARN-3125: --- +1 for the new UT patch. Will commit the DS and the

[jira] [Commented] (YARN-3125) [Event producers] Change distributed shell to use new timeline service

2015-02-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339715#comment-14339715 ] Zhijie Shen commented on YARN-3125: --- Li, thanks for working on the patch. Looking at the

[jira] [Commented] (YARN-3087) [Aggregator implementation] the REST server (web server) for per-node aggregator does not work if it runs inside node manager

2015-02-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339382#comment-14339382 ] Zhijie Shen commented on YARN-3087: --- +1. the last patch looks good to me. Will commit >

[jira] [Commented] (YARN-3125) [Event producers] Change distributed shell to use new timeline service

2015-02-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339246#comment-14339246 ] Zhijie Shen commented on YARN-3125: --- Thanks for the patch, Junping! It looks good to me.

[jira] [Commented] (YARN-3087) [Aggregator implementation] the REST server (web server) for per-node aggregator does not work if it runs inside node manager

2015-02-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339060#comment-14339060 ] Zhijie Shen commented on YARN-3087: --- Thanks for the patch, Li! Some detailed comments abo

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-02-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14337672#comment-14337672 ] Zhijie Shen commented on YARN-1809: --- [~xgong], thanks for moving this work forward. I've

[jira] [Commented] (YARN-3125) [Event producers] Change distributed shell to use new timeline service

2015-02-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14337459#comment-14337459 ] Zhijie Shen commented on YARN-3125: --- Hi Junping, thanks for updating the patch. Some more

[jira] [Commented] (YARN-3240) [Data Mode] Implement client API to put generic entities

2015-02-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14336811#comment-14336811 ] Zhijie Shen commented on YARN-3240: --- Thanks for committing the patch. PS: ".keep" seems

[jira] [Commented] (YARN-3031) [Storage abstraction] Create backing storage write interface for ATS writers

2015-02-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14336001#comment-14336001 ] Zhijie Shen commented on YARN-3031: --- [~vrushalic], thanks for updating the patch! Some co

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2015-02-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1809: -- Assignee: Xuan Gong (was: Zhijie Shen) > Synchronize RM and Generic History Service Web-UIs > --

[jira] [Commented] (YARN-3125) [Event producers] Change distributed shell to use new timeline service

2015-02-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335798#comment-14335798 ] Zhijie Shen commented on YARN-3125: --- My two cents: let's use {{createTimelineClient(Appli

[jira] [Updated] (YARN-3240) [Data Mode] Implement client API to put generic entities

2015-02-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3240: -- Attachment: YARN-3240.3.patch Create the new patch: 1. Fix some minor bugs. 2. Per offline discussion, l

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS writer service discovery

2015-02-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334206#comment-14334206 ] Zhijie Shen commented on YARN-3039: --- One addition issue related the rm state store: calli

[jira] [Commented] (YARN-3087) [Aggregator implementation] the REST server (web server) for per-node aggregator does not work if it runs inside node manager

2015-02-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334179#comment-14334179 ] Zhijie Shen commented on YARN-3087: --- Thanks for the patch. It seems to be a promising app

[jira] [Commented] (YARN-3039) [Aggregator wireup] Implement ATS writer service discovery

2015-02-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334159#comment-14334159 ] Zhijie Shen commented on YARN-3039: --- bq. The RM will likely not use the service discovery

[jira] [Updated] (YARN-3240) [Data Mode] Implement client API to put generic entities

2015-02-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3240: -- Attachment: YARN-3240.2.patch Made a new patch: 1. Fix the bugs in the previous one. 2. Add an integrati

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329848#comment-14329848 ] Zhijie Shen commented on YARN-3166: --- bq. But as a general rule, I think there could be i

[jira] [Updated] (YARN-3240) [Data Mode] Implement client API to put generic entities

2015-02-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3240: -- Attachment: YARN-3240.1.patch In this Jira, I aim to make the basic client write APIs ready. Later on, we

[jira] [Created] (YARN-3240) [Data Mode] Implement client API to put generic entities

2015-02-20 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3240: - Summary: [Data Mode] Implement client API to put generic entities Key: YARN-3240 URL: https://issues.apache.org/jira/browse/YARN-3240 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329598#comment-14329598 ] Zhijie Shen commented on YARN-3166: --- bq. In such a scenario if we try to Reuse REST then

[jira] [Commented] (YARN-3031) [Storage abstraction] Create backing storage write interface for ATS writers

2015-02-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329368#comment-14329368 ] Zhijie Shen commented on YARN-3031: --- [~vrushalic], YARN-3041 is committed, would you mind

[jira] [Commented] (YARN-3115) [Aggregator wireup] Work-preserving restarting of per-node aggregator

2015-02-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329299#comment-14329299 ] Zhijie Shen commented on YARN-3115: --- Please feel free to take it over. > [Aggregator wir

[jira] [Commented] (YARN-2423) TimelineClient should wrap all GET APIs to facilitate Java users

2015-02-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328388#comment-14328388 ] Zhijie Shen commented on YARN-2423: --- Sure, I'll review the last patch. No matter the java

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328344#comment-14328344 ] Zhijie Shen commented on YARN-3166: --- 1. If YARN-3087 can be resolved, we can probably mak

[jira] [Commented] (YARN-3227) Timeline renew delegation token fails when RM user's TGT is expired

2015-02-19 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328043#comment-14328043 ] Zhijie Shen commented on YARN-3227: --- Does HDFS token renew requires the kerberos authenti

[jira] [Commented] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14327028#comment-14327028 ] Zhijie Shen commented on YARN-3041: --- Cool! Thanks for your review, Sangjin! I'll go ahead

[jira] [Updated] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3041: -- Attachment: YARN-3041.5.patch Thanks for the feedback, Sangjin, Vrushali and Joep! We had an offline dis

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326987#comment-14326987 ] Zhijie Shen commented on YARN-3166: --- bq. I assume they will post data through our clients

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326812#comment-14326812 ] Zhijie Shen commented on YARN-3166: --- Thanks for raising the package structure definition.

[jira] [Commented] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325477#comment-14325477 ] Zhijie Shen commented on YARN-3041: --- Another issue about having run id as the attribute o

[jira] [Comment Edited] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325467#comment-14325467 ] Zhijie Shen edited comment on YARN-3041 at 2/18/15 6:10 AM: bq.

[jira] [Commented] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325467#comment-14325467 ] Zhijie Shen commented on YARN-3041: --- bq. I think the run id of a flow is an attribute of

[jira] [Updated] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3041: -- Attachment: YARN-3041.4.patch > [Data Model] create overall data objects of TS next gen > ---

[jira] [Updated] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3041: -- Attachment: (was: YARN-3041.4.patch) > [Data Model] create overall data objects of TS next gen >

[jira] [Commented] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325431#comment-14325431 ] Zhijie Shen commented on YARN-3041: --- Thanks for the feedback, Sangjin! See my response be

[jira] [Updated] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3041: -- Attachment: YARN-3041.4.patch > [Data Model] create overall data objects of TS next gen > ---

[jira] [Commented] (YARN-3207) secondary filter matches entites which do not have the key being filtered for.

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325382#comment-14325382 ] Zhijie Shen commented on YARN-3207: --- bq. was just thinking in terms of any scenario to st

[jira] [Updated] (YARN-3207) secondary filter matches entites which do not have the key being filtered for.

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3207: -- Attachment: YARN-3207.1.patch Create the patch to fix the issue. > secondary filter matches entites whic

[jira] [Commented] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325178#comment-14325178 ] Zhijie Shen commented on YARN-3041: --- bq. Is it up to the calling code to make sure that i

[jira] [Commented] (YARN-3207) secondary filter matches entites which do not have the key being filtered for.

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325139#comment-14325139 ] Zhijie Shen commented on YARN-3207: --- Varun, thanks for reassign it back to me. I'm curren

[jira] [Commented] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325074#comment-14325074 ] Zhijie Shen commented on YARN-3041: --- I'd like to propose the scope of this Jira: let's tr

[jira] [Updated] (YARN-3041) [Data Model] create the ATS entity/event API

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3041: -- Attachment: YARN-3041.3.patch Make a new patch: 1. Address some comments above. 2. Make annotations that

[jira] [Updated] (YARN-3041) [Data Model] create overall data objects of TS next gen

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3041: -- Summary: [Data Model] create overall data objects of TS next gen (was: [Data Model] create the ATS entit

[jira] [Commented] (YARN-3041) [Data Model] create the ATS entity/event API

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325042#comment-14325042 ] Zhijie Shen commented on YARN-3041: --- bq. How stringent do we want to be on allowed parent

[jira] [Commented] (YARN-3207) secondary filter matches entites which do not have the key being filtered for.

2015-02-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324658#comment-14324658 ] Zhijie Shen commented on YARN-3207: --- [~pramachandran], thanks for reporting the issue. I

[jira] [Commented] (YARN-3166) [Source organization] Decide detailed package structures for timeline service v2 components

2015-02-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14323697#comment-14323697 ] Zhijie Shen commented on YARN-3166: --- Records is better to be in {{org.apache.hadoop.yarn

[jira] [Updated] (YARN-3196) [Compatibility] Make TS next gen be compatible with the current TS

2015-02-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3196: -- Issue Type: Sub-task (was: Bug) Parent: YARN-2928 > [Compatibility] Make TS next gen be compatib

[jira] [Created] (YARN-3196) [Compatibility] Make TS next gen be compatible with the current TS

2015-02-13 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3196: - Summary: [Compatibility] Make TS next gen be compatible with the current TS Key: YARN-3196 URL: https://issues.apache.org/jira/browse/YARN-3196 Project: Hadoop YARN

[jira] [Resolved] (YARN-3043) [Data Model] Create ATS configuration, metadata, etc. as part of entities

2015-02-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-3043. --- Resolution: Duplicate Let's make the all-inclusive data model definition in YARN-3041. > [Data Model]

[jira] [Resolved] (YARN-3042) [Data Model] Create ATS metrics API

2015-02-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-3042. --- Resolution: Duplicate Let's make the all-inclusive data model definition in YARN-3041. > [Data Model]

[jira] [Updated] (YARN-3041) [Data Model] create the ATS entity/event API

2015-02-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3041: -- Attachment: YARN-3041.2.patch Data_model_proposal_v2.pdf Based on the online/offline disc

[jira] [Commented] (YARN-3041) [Data Model] create the ATS entity/event API

2015-02-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14319230#comment-14319230 ] Zhijie Shen commented on YARN-3041: --- Take it over, Thanks! - Zhijie > [Data Model] creat

[jira] [Assigned] (YARN-3041) [Data Model] create the ATS entity/event API

2015-02-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-3041: - Assignee: Zhijie Shen (was: Robert Kanter) > [Data Model] create the ATS entity/event API > -

[jira] [Commented] (YARN-3171) Sort by application id doesn't work in ATS web ui

2015-02-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14317252#comment-14317252 ] Zhijie Shen commented on YARN-3171: --- Does YARN-2766 not fix the problem? > Sort by appli

[jira] [Commented] (YARN-2928) Application Timeline Server (ATS) next gen: phase 1

2015-02-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315665#comment-14315665 ] Zhijie Shen commented on YARN-2928: --- bq. I am assuming you are already aware of YARN-2423

[jira] [Commented] (YARN-3034) implement RM starting its ATS writer

2015-02-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315265#comment-14315265 ] Zhijie Shen commented on YARN-3034: --- bq. Whether we require Multithreaded Dispatcher as w

[jira] [Commented] (YARN-2246) Job History Link in RM UI is redirecting to the URL which contains Job Id twice

2015-02-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315053#comment-14315053 ] Zhijie Shen commented on YARN-2246: --- Thanks for the confirmation, Jonathan! I'll commit t

[jira] [Commented] (YARN-3166) Decide detailed package structures for timeline service v2 components

2015-02-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14315046#comment-14315046 ] Zhijie Shen commented on YARN-3166: --- There'is some related discussion on YARN-2928: http

[jira] [Commented] (YARN-2246) Job History Link in RM UI is redirecting to the URL which contains Job Id twice

2015-02-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14314624#comment-14314624 ] Zhijie Shen commented on YARN-2246: --- bq. Correct, but that's MapReduce's fault and not YA

[jira] [Commented] (YARN-2246) Job History Link in RM UI is redirecting to the URL which contains Job Id twice

2015-02-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313277#comment-14313277 ] Zhijie Shen commented on YARN-2246: --- It aims to solve the non-root path. Root path works

[jira] [Updated] (YARN-2246) Job History Link in RM UI is redirecting to the URL which contains Job Id twice

2015-02-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2246: -- Attachment: YARN-2246.2.patch In fact, it seems we don't need to fix RMAppAttemptImpl#generateProxyUriWi

[jira] [Comment Edited] (YARN-2246) Job History Link in RM UI is redirecting to the URL which contains Job Id twice

2015-02-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313217#comment-14313217 ] Zhijie Shen edited comment on YARN-2246 at 2/10/15 12:11 AM: - I

[jira] [Commented] (YARN-2246) Job History Link in RM UI is redirecting to the URL which contains Job Id twice

2015-02-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313178#comment-14313178 ] Zhijie Shen commented on YARN-2246: --- [~jlowe], I think we're on the same page about what'

[jira] [Commented] (YARN-2246) Job History Link in RM UI is redirecting to the URL which contains Job Id twice

2015-02-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312963#comment-14312963 ] Zhijie Shen commented on YARN-2246: --- bq. With this patch, it looks like it's going to sen

[jira] [Comment Edited] (YARN-2246) Job History Link in RM UI is redirecting to the URL which contains Job Id twice

2015-02-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312927#comment-14312927 ] Zhijie Shen edited comment on YARN-2246 at 2/9/15 9:39 PM: --- Dever

[jira] [Commented] (YARN-2246) Job History Link in RM UI is redirecting to the URL which contains Job Id twice

2015-02-09 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312927#comment-14312927 ] Zhijie Shen commented on YARN-2246: --- Deverej, thanks for the explanation! It makes sense

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310315#comment-14310315 ] Zhijie Shen commented on YARN-3100: --- Thanks for the last patch. It looks good to me. Pend

[jira] [Commented] (YARN-2246) Job History Link in RM UI is redirecting to the URL which contains Job Id twice

2015-02-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310260#comment-14310260 ] Zhijie Shen commented on YARN-2246: --- bq. For running applications 'res' needs to be appen

<    2   3   4   5   6   7   8   9   10   11   >