[jira] [Resolved] (YARN-2294) Update sample program and documentations for writing YARN Application

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2294. --- Resolution: Fixed Fix Version/s: 2.6.0 > Update sample program and documentations for writing YA

[jira] [Resolved] (YARN-2309) NPE during RM-Restart test scenario

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2309. --- Resolution: Duplicate > NPE during RM-Restart test scenario > --- > >

[jira] [Resolved] (YARN-2307) Capacity scheduler user only ADMINISTER_QUEUE also can submit app

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2307. --- Resolution: Invalid You probably miss setting {{yarn.acl.enable=true}} in yarn-site.xml. Close if for

[jira] [Resolved] (YARN-2311) Revisit RM web pages where user information may make difference.

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2311. --- Resolution: Invalid YARN-1809 make the webui to do as the request user and reuse clientRM service to d

[jira] [Commented] (YARN-2318) hadoop configuraion checker

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524286#comment-14524286 ] Zhijie Shen commented on YARN-2318: --- Do we still need this feature? Or we can close the j

[jira] [Resolved] (YARN-2289) ApplicationHistoryStore should be versioned

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2289. --- Resolution: Won't Fix We won't do improvement for GHS > ApplicationHistoryStore should be versioned >

[jira] [Resolved] (YARN-2278) YARN RPC should support Protocol Version in client/server

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2278. --- Resolution: Won't Fix We decide not to have version. > YARN RPC should support Protocol Version in cli

[jira] [Commented] (YARN-3422) relatedentities always return empty list when primary filter is set

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14524330#comment-14524330 ] Zhijie Shen commented on YARN-3422: --- I think it a valid bug. I took a look at the patch,

[jira] [Updated] (YARN-3422) relatedentities always return empty list when primary filter is set

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3422: -- Fix Version/s: (was: 2.6.1) > relatedentities always return empty list when primary filter is set > -

[jira] [Updated] (YARN-3422) relatedentities always return empty list when primary filter is set

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3422: -- Labels: (was: newbie) > relatedentities always return empty list when primary filter is set > -

[jira] [Updated] (YARN-3422) relatedentities always return empty list when primary filter is set

2015-05-01 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3422: -- Component/s: timelineserver Target Version/s: 2.7.1 > relatedentities always return empty list w

[jira] [Commented] (YARN-1564) add some basic workflow YARN services

2015-05-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526963#comment-14526963 ] Zhijie Shen commented on YARN-1564: --- YARN-2928 is going to support flow as the first clas

[jira] [Commented] (YARN-3422) relatedentities always return empty list when primary filter is set

2015-05-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527012#comment-14527012 ] Zhijie Shen commented on YARN-3422: --- [~billie.rina...@gmail.com], thanks for explaining t

[jira] [Commented] (YARN-2267) Auxiliary Service support in RM

2015-05-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527084#comment-14527084 ] Zhijie Shen commented on YARN-2267: --- Sunil, my 2 cents: if you can have some detailed pro

[jira] [Updated] (YARN-3551) Consolidate data model change according to the backend implementation

2015-05-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3551: -- Attachment: YARN-3551-YARN-2928.5.patch Upload a new patch to address Sangjin's comment. I took a look

[jira] [Commented] (YARN-3538) TimelineServer doesn't catch/translate all exceptions raised

2015-05-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527475#comment-14527475 ] Zhijie Shen commented on YARN-3538: --- Only RuntimeException will not be caught, and Generi

[jira] [Commented] (YARN-2513) Host framework UIs in YARN for use with the ATS

2014-09-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14133096#comment-14133096 ] Zhijie Shen commented on YARN-2513: --- [~jeagles], thanks for working on this feature, whic

[jira] [Updated] (YARN-1250) Generic history service should support application-acls

2014-09-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1250: -- Attachment: YARN-1250.4.patch Upload a new patch to fix the problem of publishing the app's ACLs informat

[jira] [Updated] (YARN-2102) More generalized timeline ACLs

2014-09-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2102: -- Attachment: YARN-2102.6.patch > More generalized timeline ACLs > -- > >

[jira] [Commented] (YARN-2102) More generalized timeline ACLs

2014-09-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14134820#comment-14134820 ] Zhijie Shen commented on YARN-2102: --- bq. From your design doc, I think what we're proposi

[jira] [Commented] (YARN-2446) Using TimelineNamespace to shield the entities of a user

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135184#comment-14135184 ] Zhijie Shen commented on YARN-2446: --- bq. It seems like the recommended approach is for us

[jira] [Updated] (YARN-2446) Using TimelineNamespace to shield the entities of a user

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2446: -- Attachment: YARN-2446.2.patch > Using TimelineNamespace to shield the entities of a user > --

[jira] [Updated] (YARN-2559) ResourceManager sometime become un-responsive due to NPE in SystemMetricsPublisher

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2559: -- Assignee: Zhijie Shen > ResourceManager sometime become un-responsive due to NPE in > SystemMetricsPubli

[jira] [Updated] (YARN-1250) Generic history service should support application-acls

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1250: -- Attachment: YARN-1250.5.patch > Generic history service should support application-acls > ---

[jira] [Commented] (YARN-1250) Generic history service should support application-acls

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14135871#comment-14135871 ] Zhijie Shen commented on YARN-1250: --- Thanks for review, Junping! I uploaded a new patch.

[jira] [Updated] (YARN-2559) ResourceManager sometime become un-responsive due to NPE in SystemMetricsPublisher

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2559: -- Attachment: YARN-2559.1.patch NPE happens because some attempts may not have the finalStatus. Upload a pa

[jira] [Commented] (YARN-1250) Generic history service should support application-acls

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14136427#comment-14136427 ] Zhijie Shen commented on YARN-1250: --- bq. If we do think the call can be reasonably negle

[jira] [Updated] (YARN-1250) Generic history service should support application-acls

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1250: -- Attachment: YARN-1250.6.patch > Generic history service should support application-acls > ---

[jira] [Commented] (YARN-1250) Generic history service should support application-acls

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14136608#comment-14136608 ] Zhijie Shen commented on YARN-1250: --- Test failure is not related:YARN-2550 > Generic his

[jira] [Created] (YARN-2564) TestFairScheduler failures on trunk

2014-09-16 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2564: - Summary: TestFairScheduler failures on trunk Key: YARN-2564 URL: https://issues.apache.org/jira/browse/YARN-2564 Project: Hadoop YARN Issue Type: Test Co

[jira] [Commented] (YARN-2559) ResourceManager sometime become un-responsive due to NPE in SystemMetricsPublisher

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14136622#comment-14136622 ] Zhijie Shen commented on YARN-2559: --- The test failure is not related. File a ticket for i

[jira] [Resolved] (YARN-2564) TestFairScheduler failures on trunk

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2564. --- Resolution: Duplicate [~ywskycn], thanks for pointing it out. Close it as duplicate > TestFairSchedule

[jira] [Commented] (YARN-2468) Log handling for LRS

2014-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14136869#comment-14136869 ] Zhijie Shen commented on YARN-2468: --- [~xgong], thanks for the patch. I agree with the sol

[jira] [Assigned] (YARN-2565) ResourceManager is fails to start when GenericHistoryService is enabled in secure mode without doing manual kinit as yarn

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2565: - Assignee: Zhijie Shen > ResourceManager is fails to start when GenericHistoryService is enabled in

[jira] [Assigned] (YARN-2563) On secure clusters call to timeline server fails with authentication errors when running a job via oozie

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2563: - Assignee: Zhijie Shen > On secure clusters call to timeline server fails with authentication error

[jira] [Updated] (YARN-2559) ResourceManager sometime become un-responsive due to NPE in SystemMetricsPublisher

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2559: -- Attachment: YARN-2559.2.patch bq. To be consistent with the FinalApplicationStatus exposed on RM web UI a

[jira] [Commented] (YARN-2563) On secure clusters call to timeline server fails with authentication errors when running a job via oozie

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138107#comment-14138107 ] Zhijie Shen commented on YARN-2563: --- When submitting an app in a secure mode, YarnClient

[jira] [Updated] (YARN-2563) On secure clusters call to timeline server fails with authentication errors when running a job via oozie

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2563: -- Attachment: YARN-2563.1.patch Create a patch to fix the aforementioned bug. > On secure clusters call to

[jira] [Commented] (YARN-2565) ResourceManager is fails to start when GenericHistoryService is enabled in secure mode without doing manual kinit as yarn

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138184#comment-14138184 ] Zhijie Shen commented on YARN-2565: --- [~karams], I think you've neglected mentioning the c

[jira] [Updated] (YARN-2565) RM shouldn't use the old RMApplicationHistoryWriter unless explicitly setting FileSystemApplicationHistoryStore

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2565: -- Summary: RM shouldn't use the old RMApplicationHistoryWriter unless explicitly setting FileSystemApplicat

[jira] [Updated] (YARN-2565) RM shouldn't use the old RMApplicationHistoryWriter unless explicitly setting FileSystemApplicationHistoryStore

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2565: -- Attachment: YARN-2565.1.patch Create a patch to make the configurations for ApplicationHistoryServer usin

[jira] [Updated] (YARN-2559) ResourceManager sometime become un-responsive due to NPE in SystemMetricsPublisher

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2559: -- Attachment: YARN-2559.3.patch Update the patch accordingly > ResourceManager sometime become un-responsi

[jira] [Updated] (YARN-2565) RM shouldn't use the old RMApplicationHistoryWriter unless explicitly setting FileSystemApplicationHistoryStore

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2565: -- Attachment: YARN-2565.2.patch Fix the compilation error > RM shouldn't use the old RMApplicationHistoryW

[jira] [Updated] (YARN-2559) ResourceManager sometime become un-responsive due to NPE in SystemMetricsPublisher

2014-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2559: -- Attachment: YARN-2559.4.patch Simplify the patch a bit. > ResourceManager sometime become un-responsive

[jira] [Commented] (YARN-2468) Log handling for LRS

2014-09-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14138647#comment-14138647 ] Zhijie Shen commented on YARN-2468: --- 1. Shall we say "if the log file name matches both t

[jira] [Updated] (YARN-2563) On secure clusters call to timeline server fails with authentication errors when running a job via oozie

2014-09-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2563: -- Attachment: YARN-2563.2.patch Upload a new patch to simplify the way to check the existence of timeline D

[jira] [Updated] (YARN-2565) RM shouldn't use the old RMApplicationHistoryWriter unless explicitly setting FileSystemApplicationHistoryStore

2014-09-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2565: -- Attachment: YARN-2565.3.patch Fix the patch according to Jian's comments > RM shouldn't use the old RMAp

[jira] [Commented] (YARN-2568) TestAMRMClientOnRMRestart test fails

2014-09-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14139811#comment-14139811 ] Zhijie Shen commented on YARN-2568: --- +1, pending on jenkins > TestAMRMClientOnRMRestart

[jira] [Commented] (YARN-1530) [Umbrella] Store, manage and serve per-framework application-timeline data

2014-09-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143034#comment-14143034 ] Zhijie Shen commented on YARN-1530: --- bq. Scenario 1. ATS service goes down bq. Scenario 2

[jira] [Commented] (YARN-2556) Tool to measure the performance of the timeline server

2014-09-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143039#comment-14143039 ] Zhijie Shen commented on YARN-2556: --- [~jeagles], it sounds an interesting work. Is it pos

[jira] [Commented] (YARN-1530) [Umbrella] Store, manage and serve per-framework application-timeline data

2014-09-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143594#comment-14143594 ] Zhijie Shen commented on YARN-1530: --- Hi, [~bcwalrus]. Thanks for your further comments.

[jira] [Updated] (YARN-2320) Removing old application history store after we store the history data to timeline store

2014-09-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2320: -- Attachment: YARN-2320.1.patch > Removing old application history store after we store the history data to

[jira] [Commented] (YARN-2320) Removing old application history store after we store the history data to timeline store

2014-09-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14143783#comment-14143783 ] Zhijie Shen commented on YARN-2320: --- Upload a huge patch, but it doesn't have complex log

[jira] [Updated] (YARN-2320) Removing old application history store after we store the history data to timeline store

2014-09-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2320: -- Attachment: YARN-2320.2.patch Remove the unnecessary proto file as well > Removing old application histo

[jira] [Commented] (YARN-2569) Log Handling for LRS API Changes

2014-09-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144268#comment-14144268 ] Zhijie Shen commented on YARN-2569: --- LGTM in general. Some comments about the patch. 1.

[jira] [Created] (YARN-2584) TestContainerManagerSecurity fails on trunk

2014-09-22 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2584: - Summary: TestContainerManagerSecurity fails on trunk Key: YARN-2584 URL: https://issues.apache.org/jira/browse/YARN-2584 Project: Hadoop YARN Issue Type: Test

[jira] [Commented] (YARN-2320) Removing old application history store after we store the history data to timeline store

2014-09-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144301#comment-14144301 ] Zhijie Shen commented on YARN-2320: --- The console log only shows TestContainerManagerSecur

[jira] [Commented] (YARN-2569) Log Handling for LRS API Changes

2014-09-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14144381#comment-14144381 ] Zhijie Shen commented on YARN-2569: --- +1 for the latest patch. Leave it tomorrow in case V

[jira] [Updated] (YARN-2102) More generalized timeline ACLs

2014-09-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2102: -- Attachment: YARN-2102.7.patch > More generalized timeline ACLs > -- > >

[jira] [Commented] (YARN-2102) More generalized timeline ACLs

2014-09-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145390#comment-14145390 ] Zhijie Shen commented on YARN-2102: --- [~vinodkv], thanks for the comments. I've addressed

[jira] [Commented] (YARN-2581) NMs need to find a way to get LogAggregationContext

2014-09-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14145460#comment-14145460 ] Zhijie Shen commented on YARN-2581: --- Basically the approach in this patch is to embed Log

[jira] [Updated] (YARN-2102) More generalized timeline ACLs

2014-09-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2102: -- Attachment: YARN-2102.8.patch Fix findbug > More generalized timeline ACLs > ---

[jira] [Updated] (YARN-2591) AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data

2014-09-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2591: -- Affects Version/s: 2.6.0 > AHSWebServices should return FORBIDDEN(403) if the request user doesn't have

[jira] [Created] (YARN-2591) AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data

2014-09-23 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2591: - Summary: AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data Key: YARN-2591 URL: https://issues.apache.org/jira/browse/YARN-2591

[jira] [Updated] (YARN-2591) AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data

2014-09-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2591: -- Affects Version/s: 3.0.0 > AHSWebServices should return FORBIDDEN(403) if the request user doesn't have

[jira] [Commented] (YARN-2581) NMs need to find a way to get LogAggregationContext

2014-09-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146742#comment-14146742 ] Zhijie Shen commented on YARN-2581: --- It looks good to me overall. Just some nits. 1. Ca

[jira] [Commented] (YARN-2546) REST API for application creation/submission is using strings for numeric & boolean values

2014-09-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146900#comment-14146900 ] Zhijie Shen commented on YARN-2546: --- [~vvasudev], LGTM overall. Some minor comments: 1.

[jira] [Created] (YARN-2598) GHS should show N/A instead of null for the inaccessible information

2014-09-24 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2598: - Summary: GHS should show N/A instead of null for the inaccessible information Key: YARN-2598 URL: https://issues.apache.org/jira/browse/YARN-2598 Project: Hadoop YARN

[jira] [Updated] (YARN-2598) GHS should show N/A instead of null for the inaccessible information

2014-09-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2598: -- Issue Type: Sub-task (was: Bug) Parent: YARN-321 > GHS should show N/A instead of null for the i

[jira] [Assigned] (YARN-2598) GHS should show N/A instead of null for the inaccessible information

2014-09-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2598: - Assignee: Zhijie Shen > GHS should show N/A instead of null for the inaccessible information > ---

[jira] [Updated] (YARN-2598) GHS should show N/A instead of null for the inaccessible information

2014-09-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2598: -- Attachment: YARN-2598.1.patch Make a patch to fix the issue. > GHS should show N/A instead of null for t

[jira] [Updated] (YARN-2598) GHS should show N/A instead of null for the inaccessible information

2014-09-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2598: -- Target Version/s: 2.6.0 > GHS should show N/A instead of null for the inaccessible information >

[jira] [Commented] (YARN-2546) REST API for application creation/submission is using strings for numeric & boolean values

2014-09-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147121#comment-14147121 ] Zhijie Shen commented on YARN-2546: --- +1, pending on Jenkins > REST API for application c

[jira] [Commented] (YARN-2581) NMs need to find a way to get LogAggregationContext

2014-09-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147184#comment-14147184 ] Zhijie Shen commented on YARN-2581: --- +1 for the last patch. will commit it > NMs need to

[jira] [Commented] (YARN-2546) REST API for application creation/submission is using strings for numeric & boolean values

2014-09-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147202#comment-14147202 ] Zhijie Shen commented on YARN-2546: --- Committed to trunk and branch-2. Thanks, Varun! > R

[jira] [Assigned] (YARN-2602) Generic History Service of TimelineServer sometimes not able to handle NPE

2014-09-24 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2602: - Assignee: Zhijie Shen > Generic History Service of TimelineServer sometimes not able to handle NPE

[jira] [Commented] (YARN-2606) Application History Server tries to access hdfs before doing secure login

2014-09-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14148255#comment-14148255 ] Zhijie Shen commented on YARN-2606: --- The right fix may be moving the FS operations to ser

[jira] [Commented] (YARN-2606) Application History Server tries to access hdfs before doing secure login

2014-09-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14148278#comment-14148278 ] Zhijie Shen commented on YARN-2606: --- [~jeagles], I saw doSecureLogin is invoked at start

[jira] [Commented] (YARN-2602) Generic History Service of TimelineServer sometimes not able to handle NPE

2014-09-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14148348#comment-14148348 ] Zhijie Shen commented on YARN-2602: --- The problem is that YARN_APPLICATION_VIEW_ACLS field

[jira] [Updated] (YARN-2602) Generic History Service of TimelineServer sometimes not able to handle NPE

2014-09-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2602: -- Attachment: YARN-2602.1.patch Create a patch to fix the problem > Generic History Service of TimelineSer

[jira] [Updated] (YARN-2320) Removing old application history store after we store the history data to timeline store

2014-09-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2320: -- Target Version/s: 2.6.0 > Removing old application history store after we store the history data to > ti

[jira] [Updated] (YARN-2320) Removing old application history store after we store the history data to timeline store

2014-09-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2320: -- Component/s: timelineserver > Removing old application history store after we store the history data to

[jira] [Commented] (YARN-2468) Log handling for LRS

2014-09-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14148834#comment-14148834 ] Zhijie Shen commented on YARN-2468: --- The patch is generally good. Some minor comments, an

[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager

2014-09-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14149814#comment-14149814 ] Zhijie Shen commented on YARN-2527: --- This is the code in ContainerLaunchContextPBImpl. It

[jira] [Commented] (YARN-2606) Application History Server tries to access hdfs before doing secure login

2014-09-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14149891#comment-14149891 ] Zhijie Shen commented on YARN-2606: --- Talk to vinod offline shortly. It seems that the YAR

[jira] [Assigned] (YARN-2591) AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data

2014-09-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2591: - Assignee: Zhijie Shen > AHSWebServices should return FORBIDDEN(403) if the request user doesn't ha

[jira] [Updated] (YARN-2591) AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data

2014-09-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2591: -- Target Version/s: 2.6.0 > AHSWebServices should return FORBIDDEN(403) if the request user doesn't have >

[jira] [Updated] (YARN-2591) AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data

2014-09-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2591: -- Attachment: YARN-2591.1.patch Create a patch to throw ForbiddenException if the access is denied by Appl

[jira] [Commented] (YARN-2468) Log handling for LRS

2014-09-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150221#comment-14150221 ] Zhijie Shen commented on YARN-2468: --- +1 for the latest patch > Log handling for LRS > --

[jira] [Commented] (YARN-2468) Log handling for LRS

2014-09-26 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150266#comment-14150266 ] Zhijie Shen commented on YARN-2468: --- The test failures seems to be related to addressing

[jira] [Commented] (YARN-2446) Using TimelineNamespace to shield the entities of a user

2014-09-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152313#comment-14152313 ] Zhijie Shen commented on YARN-2446: --- bq. Get domains API: "If callerUGI is not the owner

[jira] [Updated] (YARN-2446) Using TimelineNamespace to shield the entities of a user

2014-09-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2446: -- Attachment: YARN-2446.3.patch > Using TimelineNamespace to shield the entities of a user > --

[jira] [Created] (YARN-2621) Simplify the output when the user doesn't have the access for getDomain(s)

2014-09-29 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2621: - Summary: Simplify the output when the user doesn't have the access for getDomain(s) Key: YARN-2621 URL: https://issues.apache.org/jira/browse/YARN-2621 Project: Hadoop YAR

[jira] [Updated] (YARN-2622) RM should put the application related timeline data into a secured domain

2014-09-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2622: -- Component/s: timelineserver > RM should put the application related timeline data into a secured domain >

[jira] [Created] (YARN-2622) RM should put the application related timeline data into a secured domain

2014-09-29 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2622: - Summary: RM should put the application related timeline data into a secured domain Key: YARN-2622 URL: https://issues.apache.org/jira/browse/YARN-2622 Project: Hadoop YARN

[jira] [Updated] (YARN-2622) RM should put the application related timeline data into a secured domain

2014-09-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2622: -- Affects Version/s: 2.6.0 > RM should put the application related timeline data into a secured domain > --

[jira] [Updated] (YARN-2622) RM should put the application related timeline data into a secured domain

2014-09-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2622: -- Target Version/s: 2.6.0 > RM should put the application related timeline data into a secured domain > ---

[jira] [Commented] (YARN-2527) NPE in ApplicationACLsManager

2014-09-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152486#comment-14152486 ] Zhijie Shen commented on YARN-2527: --- The patch almost looks good to me, in particular the

[jira] [Commented] (YARN-2583) Modify the LogDeletionService to support Log aggregation for LRS

2014-09-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14152532#comment-14152532 ] Zhijie Shen commented on YARN-2583: --- Some thoughts about the log deletion service of LRS:

[jira] [Updated] (YARN-2621) Simplify the output when the user doesn't have the access for getDomain(s)

2014-09-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2621: -- Attachment: YARN-2621.1.patch Create a patch to fix the problem > Simplify the output when the user does

<    2   3   4   5   6   7   8   9   10   11   >