[jira] [Assigned] (YARN-2819) NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

[ https://issues.apache.org/jira/browse/YARN-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2819: - Assignee: Zhijie Shen NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

[jira] [Updated] (YARN-2819) NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

[ https://issues.apache.org/jira/browse/YARN-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2819: -- Priority: Critical (was: Major) NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

[jira] [Commented] (YARN-2819) NPE in ATS Timeline Domains when upgrading from 2.4 to 2.6

[ https://issues.apache.org/jira/browse/YARN-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201602#comment-14201602 ] Zhijie Shen commented on YARN-2819: --- I've done the following experiments locally: 1. Run

[jira] [Commented] (YARN-2767) RM web services - add test case to ensure the http static user cannot kill or submit apps in secure mode

[ https://issues.apache.org/jira/browse/YARN-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198846#comment-14198846 ] Zhijie Shen commented on YARN-2767: --- +1 will commit the patch. RM web services - add

[jira] [Created] (YARN-2812) TestApplicationHistoryServer is likely to fail on less powerful machine

Zhijie Shen created YARN-2812: - Summary: TestApplicationHistoryServer is likely to fail on less powerful machine Key: YARN-2812 URL: https://issues.apache.org/jira/browse/YARN-2812 Project: Hadoop YARN

[jira] [Commented] (YARN-2812) TestApplicationHistoryServer is likely to fail on less powerful machine

[ https://issues.apache.org/jira/browse/YARN-2812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199075#comment-14199075 ] Zhijie Shen commented on YARN-2812: --- The root causes of the test failures are: 1.

[jira] [Updated] (YARN-2812) TestApplicationHistoryServer is likely to fail on less powerful machine

[ https://issues.apache.org/jira/browse/YARN-2812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2812: -- Attachment: YARN-2812.1.patch Upload a patch to fix the issue. TestApplicationHistoryServer is likely

[jira] [Created] (YARN-2813) NPE from MemoryTimelineStore.getDomains

Zhijie Shen created YARN-2813: - Summary: NPE from MemoryTimelineStore.getDomains Key: YARN-2813 URL: https://issues.apache.org/jira/browse/YARN-2813 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-2813) NPE from MemoryTimelineStore.getDomains

[ https://issues.apache.org/jira/browse/YARN-2813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2813: -- Attachment: YARN-2813.1.patch Upload a patch to fix the npe NPE from MemoryTimelineStore.getDomains

[jira] [Created] (YARN-2818) Remove the logic to inject entity owner as the primary filter

Zhijie Shen created YARN-2818: - Summary: Remove the logic to inject entity owner as the primary filter Key: YARN-2818 URL: https://issues.apache.org/jira/browse/YARN-2818 Project: Hadoop YARN

[jira] [Updated] (YARN-2818) Remove the logic to inject entity owner as the primary filter

[ https://issues.apache.org/jira/browse/YARN-2818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2818: -- Attachment: YARN-2818.1.patch Put a patch to remove this logic. The change should be mostly compatible.

[jira] [Commented] (YARN-2767) RM web services - add test case to ensure the http static user cannot kill or submit apps in secure mode

[ https://issues.apache.org/jira/browse/YARN-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14196717#comment-14196717 ] Zhijie Shen commented on YARN-2767: --- Sorry for not raising it early, but just notice a

[jira] [Updated] (YARN-2804) Timeline server .out log have JAXB binding exceptions and warnings.

[ https://issues.apache.org/jira/browse/YARN-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2804: -- Attachment: YARN-2804.2.patch Thanks for the comments. I've moved the logic to setters, and validated it

[jira] [Commented] (YARN-2804) Timeline server .out log have JAXB binding exceptions and warnings.

[ https://issues.apache.org/jira/browse/YARN-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14197087#comment-14197087 ] Zhijie Shen commented on YARN-2804: --- In case folks want to know the .out output

[jira] [Commented] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

[ https://issues.apache.org/jira/browse/YARN-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14197143#comment-14197143 ] Zhijie Shen commented on YARN-2752: --- +1. The jenkins doesn't work because the patch only

[jira] [Updated] (YARN-2752) ContainerExecutor always append nice -n in command on branch-2

[ https://issues.apache.org/jira/browse/YARN-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2752: -- Summary: ContainerExecutor always append nice -n in command on branch-2 (was:

[jira] [Commented] (YARN-2506) TimelineClient should NOT be in yarn-common project

[ https://issues.apache.org/jira/browse/YARN-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14197442#comment-14197442 ] Zhijie Shen commented on YARN-2506: --- Sure, I can take care of it. TimelineClient should

[jira] [Commented] (YARN-2798) YarnClient doesn't need to translate Kerberos name of timeline DT renewer

[ https://issues.apache.org/jira/browse/YARN-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194982#comment-14194982 ] Zhijie Shen commented on YARN-2798: --- I don't have a quick setup for RM HA and secure

[jira] [Comment Edited] (YARN-2798) YarnClient doesn't need to translate Kerberos name of timeline DT renewer

[ https://issues.apache.org/jira/browse/YARN-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194982#comment-14194982 ] Zhijie Shen edited comment on YARN-2798 at 11/3/14 8:03 PM: I

[jira] [Created] (YARN-2804) Timeline server .out log have JAXB binding exceptions and warnings.

Zhijie Shen created YARN-2804: - Summary: Timeline server .out log have JAXB binding exceptions and warnings. Key: YARN-2804 URL: https://issues.apache.org/jira/browse/YARN-2804 Project: Hadoop YARN

[jira] [Commented] (YARN-2804) Timeline server .out log have JAXB binding exceptions and warnings.

[ https://issues.apache.org/jira/browse/YARN-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195475#comment-14195475 ] Zhijie Shen commented on YARN-2804: --- If the map interface issue is resolved, another

[jira] [Updated] (YARN-2804) Timeline server .out log have JAXB binding exceptions and warnings.

[ https://issues.apache.org/jira/browse/YARN-2804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2804: -- Attachment: YARN-2804.1.patch In the patch, I made a compromise when changing TimelineEntity and

[jira] [Created] (YARN-2798) YarnClient doesn't need to translate Kerberos name of timeline DT renewer

Zhijie Shen created YARN-2798: - Summary: YarnClient doesn't need to translate Kerberos name of timeline DT renewer Key: YARN-2798 URL: https://issues.apache.org/jira/browse/YARN-2798 Project: Hadoop YARN

[jira] [Updated] (YARN-2798) YarnClient doesn't need to translate Kerberos name of timeline DT renewer

[ https://issues.apache.org/jira/browse/YARN-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2798: -- Component/s: timelineserver YarnClient doesn't need to translate Kerberos name of timeline DT renewer

[jira] [Updated] (YARN-2798) YarnClient doesn't need to translate Kerberos name of timeline DT renewer

[ https://issues.apache.org/jira/browse/YARN-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2798: -- Reporter: Arpit Gupta (was: Zhijie Shen) YarnClient doesn't need to translate Kerberos name of

[jira] [Commented] (YARN-2798) YarnClient doesn't need to translate Kerberos name of timeline DT renewer

[ https://issues.apache.org/jira/browse/YARN-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193993#comment-14193993 ] Zhijie Shen commented on YARN-2798: --- Report the issue on behalf of [~arpitgupta]

[jira] [Commented] (YARN-2785) TestContainerResourceUsage fails intermittently

[ https://issues.apache.org/jira/browse/YARN-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194074#comment-14194074 ] Zhijie Shen commented on YARN-2785: --- +1 will commit the patch

[jira] [Comment Edited] (YARN-2798) YarnClient doesn't need to translate Kerberos name of timeline DT renewer

[ https://issues.apache.org/jira/browse/YARN-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194071#comment-14194071 ] Zhijie Shen edited comment on YARN-2798 at 11/2/14 11:50 PM: -

[jira] [Updated] (YARN-2798) YarnClient doesn't need to translate Kerberos name of timeline DT renewer

[ https://issues.apache.org/jira/browse/YARN-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2798: -- Attachment: YARN-2798.2.patch bq. I don't understand why you are using timelineHost to resolve the

[jira] [Commented] (YARN-2798) YarnClient doesn't need to translate Kerberos name of timeline DT renewer

[ https://issues.apache.org/jira/browse/YARN-2798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194225#comment-14194225 ] Zhijie Shen commented on YARN-2798: --- Test failures are not related. YarnClient doesn't

[jira] [Updated] (YARN-2783) TestApplicationClientProtocolOnHA fails on trunk intermittently

[ https://issues.apache.org/jira/browse/YARN-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2783: -- Summary: TestApplicationClientProtocolOnHA fails on trunk intermittently (was:

[jira] [Commented] (YARN-2785) TestContainerResourceUsage fails intermittently

[ https://issues.apache.org/jira/browse/YARN-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193449#comment-14193449 ] Zhijie Shen commented on YARN-2785: --- Why don't we need to prolong timeout for

[jira] [Commented] (YARN-2752) TestContainerExecutor.testRunCommandNoPriority fails in branch-2

[ https://issues.apache.org/jira/browse/YARN-2752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193494#comment-14193494 ] Zhijie Shen commented on YARN-2752: --- The fix makes sense. Currently the branch-2 code

[jira] [Commented] (YARN-2767) RM web services - add test case to ensure the http static user can kill or submit apps in secure mode

[ https://issues.apache.org/jira/browse/YARN-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192761#comment-14192761 ] Zhijie Shen commented on YARN-2767: --- [~vvasudev], thanks for the patch. The test cases

[jira] [Commented] (YARN-2711) TestDefaultContainerExecutor#testContainerLaunchError fails on Windows

[ https://issues.apache.org/jira/browse/YARN-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192829#comment-14192829 ] Zhijie Shen commented on YARN-2711: --- Junping is offline and has network issue with git

[jira] [Updated] (YARN-2711) TestDefaultContainerExecutor#testContainerLaunchError fails on Windows

[ https://issues.apache.org/jira/browse/YARN-2711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2711: -- Issue Type: Test (was: Bug) TestDefaultContainerExecutor#testContainerLaunchError fails on Windows

[jira] [Commented] (YARN-2785) TestContainerResourceUsage fails intermittently

[ https://issues.apache.org/jira/browse/YARN-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14192892#comment-14192892 ] Zhijie Shen commented on YARN-2785: --- Add more time should a solution for slow computers.

[jira] [Commented] (YARN-2771) DistributedShell's DSConstants are badly named

[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190430#comment-14190430 ] Zhijie Shen commented on YARN-2771: --- Constant name changes. No need for test case.

[jira] [Updated] (YARN-2772) DistributedShell's timeline related options are not clear

[ https://issues.apache.org/jira/browse/YARN-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2772: -- Attachment: YARN-2772.2.patch Make one improvement. If failure happens when creating a domain, the

[jira] [Updated] (YARN-2771) DistributedShell's DSConstants are badly named

[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2771: -- Attachment: YARN-2771.2.patch Just realized I've missed one suggestion from Vinod in the description. I

[jira] [Created] (YARN-2779) SystemMetricsPublisher needs to renew and cancel timeline DT too

Zhijie Shen created YARN-2779: - Summary: SystemMetricsPublisher needs to renew and cancel timeline DT too Key: YARN-2779 URL: https://issues.apache.org/jira/browse/YARN-2779 Project: Hadoop YARN

[jira] [Reopened] (YARN-2779) SystemMetricsPublisher needs to renew and cancel timeline DT too

[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reopened YARN-2779: --- SystemMetricsPublisher needs to renew and cancel timeline DT too

[jira] [Commented] (YARN-2779) SystemMetricsPublisher needs to renew and cancel timeline DT too

[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14190955#comment-14190955 ] Zhijie Shen commented on YARN-2779: --- [~vinodkv], in the current code base, we're

[jira] [Updated] (YARN-2779) SystemMetricsPublisher can use Kerberos directly instead of timeline DT

[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2779: -- Summary: SystemMetricsPublisher can use Kerberos directly instead of timeline DT (was:

[jira] [Updated] (YARN-2771) DistributedShell's DSConstants are badly named

[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2771: -- Attachment: YARN-2771.3.patch Fix the test failure DistributedShell's DSConstants are badly named

[jira] [Updated] (YARN-2779) SystemMetricsPublisher can use Kerberos directly instead of timeline DT

[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2779: -- Attachment: YARN-2779.1.patch Upload a patch to remove the code of getting the timeline DT in the

[jira] [Commented] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191174#comment-14191174 ] Zhijie Shen commented on YARN-2770: --- bq. SecurityUtil#getServerPrincipal may be useful.

[jira] [Updated] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2770: -- Attachment: YARN-2770.2.patch Timeline delegation tokens need to be automatically renewed by the RM

[jira] [Commented] (YARN-2779) SystemMetricsPublisher can use Kerberos directly instead of timeline DT

[ https://issues.apache.org/jira/browse/YARN-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191177#comment-14191177 ] Zhijie Shen commented on YARN-2779: --- I've verified it in a secure cluster, and

[jira] [Created] (YARN-2782) TestResourceTrackerOnHA fails on trunk

Zhijie Shen created YARN-2782: - Summary: TestResourceTrackerOnHA fails on trunk Key: YARN-2782 URL: https://issues.apache.org/jira/browse/YARN-2782 Project: Hadoop YARN Issue Type: Test

[jira] [Created] (YARN-2783) TestApplicationClientProtocolOnHA

Zhijie Shen created YARN-2783: - Summary: TestApplicationClientProtocolOnHA Key: YARN-2783 URL: https://issues.apache.org/jira/browse/YARN-2783 Project: Hadoop YARN Issue Type: Test

[jira] [Commented] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14191308#comment-14191308 ] Zhijie Shen commented on YARN-2770: --- The two test failures are not related, and happen on

[jira] [Commented] (YARN-2765) Add leveldb-based implementation for RMStateStore

[ https://issues.apache.org/jira/browse/YARN-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188595#comment-14188595 ] Zhijie Shen commented on YARN-2765: --- bq. This should work if the leveldb database is on a

[jira] [Created] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

Zhijie Shen created YARN-2770: - Summary: Timeline delegation tokens need to be automatically renewed by the RM Key: YARN-2770 URL: https://issues.apache.org/jira/browse/YARN-2770 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-2765) Add leveldb-based implementation for RMStateStore

[ https://issues.apache.org/jira/browse/YARN-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188595#comment-14188595 ] Zhijie Shen edited comment on YARN-2765 at 10/29/14 5:22 PM: -

[jira] [Commented] (YARN-2769) Timeline server domain not set correctly when using shell_command on Windows

[ https://issues.apache.org/jira/browse/YARN-2769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188796#comment-14188796 ] Zhijie Shen commented on YARN-2769: --- +1. The fix makes sense, and we have the test to

[jira] [Updated] (YARN-2770) Timeline delegation tokens need to be automatically renewed by the RM

[ https://issues.apache.org/jira/browse/YARN-2770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2770: -- Attachment: YARN-2770.1.patch Created a patch: * Add two timeline client APIs - renew/cancel delegation

[jira] [Commented] (YARN-2766) [JDK 8] TestApplicationHistoryClientService fails

[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189194#comment-14189194 ] Zhijie Shen commented on YARN-2766: --- I think we need to change ApplicationContext -

[jira] [Updated] (YARN-2766) [JDK 8] TestApplicationHistoryClientService fails

[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2766: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1530) [JDK 8]

[jira] [Updated] (YARN-2766) [JDK 8] TestApplicationHistoryClientService fails

[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2766: -- Issue Type: Sub-task (was: Bug) Parent: YARN-321 [JDK 8] TestApplicationHistoryClientService

[jira] [Updated] (YARN-2766) ApplicationHistoryManager is expected to return a sorted list of apps/attempts/containers

[ https://issues.apache.org/jira/browse/YARN-2766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2766: -- Summary: ApplicationHistoryManager is expected to return a sorted list of apps/attempts/containers

[jira] [Updated] (YARN-2771) DistributedShell's DSConstants are badly named

[ https://issues.apache.org/jira/browse/YARN-2771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2771: -- Attachment: YARN-2771.1.patch While I was aware of the bad naming, I decided to follow the pattern of

[jira] [Commented] (YARN-2772) DistributedShell's timeline related options are not clear

[ https://issues.apache.org/jira/browse/YARN-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189384#comment-14189384 ] Zhijie Shen commented on YARN-2772: --- [~vinodkv], thanks for your proposal. 1. I prefer

[jira] [Updated] (YARN-2772) DistributedShell's timeline related options are not clear

[ https://issues.apache.org/jira/browse/YARN-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2772: -- Attachment: YARN-2772.1.patch DistributedShell's timeline related options are not clear

[jira] [Commented] (YARN-2741) Windows: Node manager cannot serve up log files via the web user interface when yarn.nodemanager.log-dirs to any drive letter other than C: (or, the drive that nodemanag

[ https://issues.apache.org/jira/browse/YARN-2741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187455#comment-14187455 ] Zhijie Shen commented on YARN-2741: --- +1 LGTM. The test case will verify the drive letter

[jira] [Commented] (YARN-2765) Add leveldb-based implementation for RMStateStore

[ https://issues.apache.org/jira/browse/YARN-2765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14187987#comment-14187987 ] Zhijie Shen commented on YARN-2765: --- [~jlowe], the leveldb should be a good choice over

[jira] [Commented] (YARN-2747) TestAggregatedLogFormat fails in trunk

[ https://issues.apache.org/jira/browse/YARN-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188030#comment-14188030 ] Zhijie Shen commented on YARN-2747: --- +1. The reason makes sense, and I've verified the

[jira] [Created] (YARN-2758) Update TestApplicationHistoryClientService to use the new generic history store

Zhijie Shen created YARN-2758: - Summary: Update TestApplicationHistoryClientService to use the new generic history store Key: YARN-2758 URL: https://issues.apache.org/jira/browse/YARN-2758 Project:

[jira] [Updated] (YARN-2758) Update TestApplicationHistoryClientService to use the new generic history store

[ https://issues.apache.org/jira/browse/YARN-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2758: -- Attachment: YARN-2758.1.patch Hook the test cases to the new generic history store on top of the

[jira] [Commented] (YARN-2760) Completely remove word 'experimental' from FairScheduler docs

[ https://issues.apache.org/jira/browse/YARN-2760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186328#comment-14186328 ] Zhijie Shen commented on YARN-2760: --- We should have run into the same issue: HADOOP-11240

[jira] [Commented] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file

[ https://issues.apache.org/jira/browse/YARN-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14184604#comment-14184604 ] Zhijie Shen commented on YARN-2734: --- LGTM overall, one nit: Can we not say Log file:

[jira] [Commented] (YARN-2734) If a sub-folder is encountered by log aggregator it results in invalid aggregated file

[ https://issues.apache.org/jira/browse/YARN-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14184646#comment-14184646 ] Zhijie Shen commented on YARN-2734: --- +1. Will commit the patch If a sub-folder is

[jira] [Created] (YARN-2748) Upload logs in the sub-folders under the local log dir when aggregating logs

Zhijie Shen created YARN-2748: - Summary: Upload logs in the sub-folders under the local log dir when aggregating logs Key: YARN-2748 URL: https://issues.apache.org/jira/browse/YARN-2748 Project: Hadoop

[jira] [Commented] (YARN-2747) TestAggregatedLogFormat fails in trunk

[ https://issues.apache.org/jira/browse/YARN-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14184673#comment-14184673 ] Zhijie Shen commented on YARN-2747: --- Can you check whether TestLogAggregationService is

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183167#comment-14183167 ] Zhijie Shen commented on YARN-2724: --- No worry. Thanks for review, Mit! I'll go ahead to

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183207#comment-14183207 ] Zhijie Shen commented on YARN-2703: --- The latest patch needs to be rebased after

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183489#comment-14183489 ] Zhijie Shen commented on YARN-2703: --- Will commit the patch. Add logUploadedTime into

[jira] [Updated] (YARN-2591) AHSWebServices should return FORBIDDEN(403) if the request user doesn't have access to the history data

[ https://issues.apache.org/jira/browse/YARN-2591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2591: -- Attachment: YARN-2591.2.patch Throw authorization exception instead. And change the test cases

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181665#comment-14181665 ] Zhijie Shen commented on YARN-2724: --- +1 for the latest patch. Will commit it later today

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181791#comment-14181791 ] Zhijie Shen commented on YARN-2703: --- [~xgong], thanks for the patch. Some comments about

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182133#comment-14182133 ] Zhijie Shen commented on YARN-2724: --- [~mitdesai], any comments so far? If an unreadable

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182438#comment-14182438 ] Zhijie Shen commented on YARN-2209: --- +1 tor the last patch. Will commit it. Replace AM

[jira] [Commented] (YARN-2703) Add logUploadedTime into LogValue for better display

[ https://issues.apache.org/jira/browse/YARN-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14182474#comment-14182474 ] Zhijie Shen commented on YARN-2703: --- +1 for the patch. Kick jenkins again Add

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14180868#comment-14180868 ] Zhijie Shen commented on YARN-2209: --- bq. Given that we already broken compatibility for

[jira] [Commented] (YARN-2732) Fix syntax error in SecureContainer.apt.vm

[ https://issues.apache.org/jira/browse/YARN-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14180882#comment-14180882 ] Zhijie Shen commented on YARN-2732: --- Straightforward apt syntax fix. I've verified it

[jira] [Commented] (YARN-2724) If an unreadable file is encountered during log aggregation then aggregated file in HDFS badly formed

[ https://issues.apache.org/jira/browse/YARN-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181028#comment-14181028 ] Zhijie Shen commented on YARN-2724: --- [~xgong], w.r.t to the fix, I think we shouldn't put

[jira] [Assigned] (YARN-2279) Add UTs to cover timeline server authentication

[ https://issues.apache.org/jira/browse/YARN-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-2279: - Assignee: Zhijie Shen Add UTs to cover timeline server authentication

[jira] [Updated] (YARN-2279) Add UTs to cover timeline server authentication

[ https://issues.apache.org/jira/browse/YARN-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2279: -- Attachment: YARN-2279.1.patch After refactoring the authentication code. The end-to-end test has already

[jira] [Commented] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14178992#comment-14178992 ] Zhijie Shen commented on YARN-2715: --- Vinod, thanks for the comments. Agree with them, and

[jira] [Updated] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2715: -- Attachment: YARN-2715.3.patch Proxy user is problem for RPC interface if

[jira] [Commented] (YARN-2709) Add retry for timeline client getDelegationToken method

[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179107#comment-14179107 ] Zhijie Shen commented on YARN-2709: --- Almost good to me. Some nits: 1. Can you add a

[jira] [Comment Edited] (YARN-2709) Add retry for timeline client getDelegationToken method

[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179107#comment-14179107 ] Zhijie Shen edited comment on YARN-2709 at 10/21/14 9:10 PM: -

[jira] [Commented] (YARN-2709) Add retry for timeline client getDelegationToken method

[ https://issues.apache.org/jira/browse/YARN-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179281#comment-14179281 ] Zhijie Shen commented on YARN-2709: --- +1 for the last patch. Will commit it. Add retry

[jira] [Updated] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2715: -- Attachment: YARN-2715.4.patch Thanks for the comments. I uploaded a new patch which address the two

[jira] [Commented] (YARN-2721) Race condition: ZKRMStateStore retry logic may throw NodeExist exception

[ https://issues.apache.org/jira/browse/YARN-2721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14179563#comment-14179563 ] Zhijie Shen commented on YARN-2721: --- +1 straightforward change. Let's make the complete

[jira] [Commented] (YARN-2582) Log related CLI and Web UI changes for Aggregated Logs in LRS

[ https://issues.apache.org/jira/browse/YARN-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177274#comment-14177274 ] Zhijie Shen commented on YARN-2582: --- Looks good to me overall. Just one nit Make the

[jira] [Commented] (YARN-2673) Add retry for timeline client put APIs

[ https://issues.apache.org/jira/browse/YARN-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177326#comment-14177326 ] Zhijie Shen commented on YARN-2673: --- +1 will commit the patch Add retry for timeline

[jira] [Commented] (YARN-2582) Log related CLI and Web UI changes for Aggregated Logs in LRS

[ https://issues.apache.org/jira/browse/YARN-2582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177392#comment-14177392 ] Zhijie Shen commented on YARN-2582: --- +1 for the last patch. Will commit it. Log related

[jira] [Created] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

Zhijie Shen created YARN-2715: - Summary: Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set. Key: YARN-2715 URL: https://issues.apache.org/jira/browse/YARN-2715

[jira] [Commented] (YARN-2715) Proxy user is problem for RPC interface if yarn.resourcemanager.webapp.proxyuser is not set.

[ https://issues.apache.org/jira/browse/YARN-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14177631#comment-14177631 ] Zhijie Shen commented on YARN-2715: --- Vinod, thanks for the comments. It makes sense to

<    5   6   7   8   9   10   11   12   13   14   >