[jira] [Commented] (YARN-979) [YARN-321] Adding application attempt and container to ApplicationHistoryProtocol

2013-08-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13752669#comment-13752669 ] Zhijie Shen commented on YARN-979: -- Take it over. Thanks! [YARN-321]

[jira] [Commented] (YARN-962) Update application_history_service.proto

2013-08-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13752833#comment-13752833 ] Zhijie Shen commented on YARN-962: -- [~vinodkv], modifications on

[jira] [Commented] (YARN-696) Enable multiple states to to be specified in Resource Manager apps REST call

2013-08-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13753829#comment-13753829 ] Zhijie Shen commented on YARN-696: -- [~trevlo78], one suggestion: please do not remove the

[jira] [Updated] (YARN-979) [YARN-321] Add more APIs related to ApplicationAttempt and Container in ApplicationHistoryProtocol

2013-08-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-979: - Description: ApplicationHistoryProtocol should have the following APIs as well: *

[jira] [Updated] (YARN-979) [YARN-321] Add more APIs related to ApplicationAttempt and Container in ApplicationHistoryProtocol

2013-08-29 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-979: - Attachment: YARN-979.2.patch Based on [~mayank_bansal]'s initial patch, I addressed my previous comments

[jira] [Created] (YARN-1123) [YARN-321] Adding ContainerReport and Protobuf implementation

2013-08-29 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1123: - Summary: [YARN-321] Adding ContainerReport and Protobuf implementation Key: YARN-1123 URL: https://issues.apache.org/jira/browse/YARN-1123 Project: Hadoop YARN

[jira] [Updated] (YARN-1129) Job hungs when any node is blacklisted after RMrestart

2013-08-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1129: -- Assignee: Zhijie Shen Job hungs when any node is blacklisted after RMrestart

[jira] [Created] (YARN-1133) AMRMClient should be able to blacklist nodes, and specify them in AllocateRequest

2013-08-30 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1133: - Summary: AMRMClient should be able to blacklist nodes, and specify them in AllocateRequest Key: YARN-1133 URL: https://issues.apache.org/jira/browse/YARN-1133 Project:

[jira] [Resolved] (YARN-1133) AMRMClient should be able to blacklist nodes, and specify them in AllocateRequest

2013-08-30 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-1133. --- Resolution: Duplicate AMRMClient should be able to blacklist nodes, and specify them in

[jira] [Created] (YARN-1141) Updating resource requests should be decoupled with updating blacklist

2013-09-03 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1141: - Summary: Updating resource requests should be decoupled with updating blacklist Key: YARN-1141 URL: https://issues.apache.org/jira/browse/YARN-1141 Project: Hadoop YARN

[jira] [Updated] (YARN-1141) Updating resource requests should be decoupled with updating blacklist

2013-09-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1141: -- Attachment: YARN-1141.1.patch Created a patch to decouple the updateResourceRequests method.

[jira] [Commented] (YARN-696) Enable multiple states to to be specified in Resource Manager apps REST call

2013-09-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757484#comment-13757484 ] Zhijie Shen commented on YARN-696: -- Hi Trevor, the patch is almost good except: 1. {code}

[jira] [Commented] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757973#comment-13757973 ] Zhijie Shen commented on YARN-1001: --- [~srimanth.gunturi], for /ws/v1/cluster/appscount,

[jira] [Commented] (YARN-696) Enable multiple states to to be specified in Resource Manager apps REST call

2013-09-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13757991#comment-13757991 ] Zhijie Shen commented on YARN-696: -- Thanks, Trevor. +1, the patch looks good to me.

[jira] [Updated] (YARN-1070) ContainerImpl State Machine: Invalid event: CONTAINER_KILLED_ON_REQUEST at CONTAINER_CLEANEDUP_AFTER_KILL

2013-09-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1070: -- Attachment: YARN-1070.3.patch Thanks Vinod for your review. I've updated the patch accordingly. The

[jira] [Updated] (YARN-292) ResourceManager throws ArrayIndexOutOfBoundsException while handling CONTAINER_ALLOCATED for application attempt

2013-09-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-292: - Attachment: YARN-292.4.patch A new patch against the latest trunk is uploaded. I added the test cases in

[jira] [Updated] (YARN-1070) ContainerImpl State Machine: Invalid event: CONTAINER_KILLED_ON_REQUEST at CONTAINER_CLEANEDUP_AFTER_KILL

2013-09-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1070: -- Attachment: YARN-1070.4.patch Update the patch against the latest trunk. bq. Taking a step back, this

[jira] [Updated] (YARN-1070) ContainerImpl State Machine: Invalid event: CONTAINER_KILLED_ON_REQUEST at CONTAINER_CLEANEDUP_AFTER_KILL

2013-09-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1070: -- Attachment: YARN-1070.5.patch Fix the findbugs warning. ContainerImpl State Machine:

[jira] [Resolved] (YARN-489) Setter of xxxxPBImpl doesn't really set the collection, but append its items to an existing collection

2013-09-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-489. -- Resolution: Duplicate The problem should be fixed together with YARN-609. Setter of

[jira] [Resolved] (YARN-1159) NodeManager reports Invalid event: CONTAINER_KILLED_ON_REQUEST at CONTAINER_CLEANEDUP_AFTER_KILL

2013-09-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-1159. --- Resolution: Duplicate It's a bug, and was reported before: YARN-1070. Will fix there.

[jira] [Updated] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1001: -- Attachment: YARN-1001.2.patch Updated the patch against the latest trunk. In addition, polish the code,

[jira] [Commented] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13760460#comment-13760460 ] Zhijie Shen commented on YARN-1001: --- bq. we are expecting /ws/v1/cluster/appscount to

[jira] [Resolved] (YARN-1059) '\n' or ' ' or '\t' should be ignored for some configuration parameters

2013-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-1059. --- Resolution: Duplicate The bug will be fixed there '\n' or ' ' or '\t' should be

[jira] [Commented] (YARN-609) Fix synchronization issues in APIs which take in lists

2013-09-08 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13761554#comment-13761554 ] Zhijie Shen commented on YARN-609: -- The patch looks good to me, but would you please

[jira] [Commented] (YARN-609) Fix synchronization issues in APIs which take in lists

2013-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763263#comment-13763263 ] Zhijie Shen commented on YARN-609: -- Checked the three methods bellow. Though they're called

[jira] [Commented] (YARN-978) [YARN-321] Adding ApplicationAttemptReport and Protobuf implementation

2013-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763315#comment-13763315 ] Zhijie Shen commented on YARN-978: -- The patch looks good, but it's better to add some

[jira] [Commented] (YARN-890) The roundup for memory values on resource manager UI is misleading

2013-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763533#comment-13763533 ] Zhijie Shen commented on YARN-890: -- The patch can ensure the UI shows the configured

[jira] [Commented] (YARN-1149) NM throws InvalidStateTransitonException: Invalid event: APPLICATION_LOG_HANDLING_FINISHED at RUNNING

2013-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763670#comment-13763670 ] Zhijie Shen commented on YARN-1149: --- Conducted some investigation on the problem: 1. The

[jira] [Commented] (YARN-609) Fix synchronization issues in APIs which take in lists

2013-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763557#comment-13763557 ] Zhijie Shen commented on YARN-609: -- +1 LGMT Fix synchronization issues in

[jira] [Commented] (YARN-867) Isolation of failures in aux services

2013-09-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763749#comment-13763749 ] Zhijie Shen commented on YARN-867: -- How about issuing a KILL_CONTAINER event instead

[jira] [Updated] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1001: -- Attachment: YARN-1001.3.patch New patch uploaded. bq. We should have a single call which takes in a

[jira] [Commented] (YARN-978) [YARN-321] Adding ApplicationAttemptReport and Protobuf implementation

2013-09-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764579#comment-13764579 ] Zhijie Shen commented on YARN-978: -- {code} + @Private + @Unstable + public abstract void

[jira] [Commented] (YARN-978) [YARN-321] Adding ApplicationAttemptReport and Protobuf implementation

2013-09-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764670#comment-13764670 ] Zhijie Shen commented on YARN-978: -- bq. We have already discussed that we would remove the

[jira] [Commented] (YARN-1149) NM throws InvalidStateTransitonException: Invalid event: APPLICATION_LOG_HANDLING_FINISHED at RUNNING

2013-09-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764880#comment-13764880 ] Zhijie Shen commented on YARN-1149: --- The patch is almost good. One comment:

[jira] [Commented] (YARN-938) Hadoop 2 benchmarking

2013-09-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764907#comment-13764907 ] Zhijie Shen commented on YARN-938: -- Great job, Mayank! Just think out loud: perhaps it is

[jira] [Updated] (YARN-1180) Update capacity scheduler docs to include types on the configs

2013-09-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1180: -- Labels: documentation newbie (was: documentation) Update capacity scheduler docs to include types

[jira] [Commented] (YARN-867) Isolation of failures in aux services

2013-09-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765878#comment-13765878 ] Zhijie Shen commented on YARN-867: -- Think about the problem again. Essentially, problem is

[jira] [Commented] (YARN-867) Isolation of failures in aux services

2013-09-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13765884#comment-13765884 ] Zhijie Shen commented on YARN-867: -- Sorry to post the broken comment before. Think about

[jira] [Updated] (YARN-953) [YARN-321] Change ResourceManager to use HistoryStorage to log history data

2013-09-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-953: - Attachment: YARN-953.4.patch Rebase the patch [YARN-321] Change ResourceManager to use

[jira] [Commented] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766950#comment-13766950 ] Zhijie Shen commented on YARN-1001: --- Having talked to [~srimanth.gunturi] offline. Here's

[jira] [Updated] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1001: -- Attachment: YARN-1001.5.patch Uploaded the patch that uses YarnApplicationState instead

[jira] [Updated] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1001: -- Attachment: YARN-1001.6.patch Rebase with the latest trunk YARN should provide per

[jira] [Updated] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1001: -- Attachment: YARN-1001.7.patch Addressed Vinod's comments. Now if applicationTypes is not provided, we

[jira] [Commented] (YARN-1123) [YARN-321] Adding ContainerReport and Protobuf implementation

2013-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768925#comment-13768925 ] Zhijie Shen commented on YARN-1123: --- Currently, there're two existing choices:

[jira] [Commented] (YARN-1206) Container logs link is broken on RM web UI after application finished

2013-09-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13769192#comment-13769192 ] Zhijie Shen commented on YARN-1206: --- I observed Container does not exist. for the

[jira] [Commented] (YARN-1001) YARN should provide per application-type and state statistics

2013-09-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13769277#comment-13769277 ] Zhijie Shen commented on YARN-1001: --- Vinod, thanks for committing the patch. In addition

[jira] [Created] (YARN-1209) Document applicationType is case-insensitive for submitApplication

2013-09-17 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1209: - Summary: Document applicationType is case-insensitive for submitApplication Key: YARN-1209 URL: https://issues.apache.org/jira/browse/YARN-1209 Project: Hadoop YARN

[jira] [Created] (YARN-1235) Regulate the case of applicationType

2013-09-24 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1235: - Summary: Regulate the case of applicationType Key: YARN-1235 URL: https://issues.apache.org/jira/browse/YARN-1235 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-899) Get queue administration ACLs working

2013-09-25 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1399#comment-1399 ] Zhijie Shen commented on YARN-899: -- 1. Is the following code necessary? {code} +

[jira] [Created] (YARN-1242) AHS's resource needs be added to RM's classpath

2013-09-25 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1242: - Summary: AHS's resource needs be added to RM's classpath Key: YARN-1242 URL: https://issues.apache.org/jira/browse/YARN-1242 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-2298) Move TimelineClient to yarn-common

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2298: -- Attachment: YARN-2298.1.patch I uploaded a patch to move TimeClient classes to yarn-common, such that

[jira] [Commented] (YARN-2298) Move TimelineClient to yarn-common

2014-07-15 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063123#comment-14063123 ] Zhijie Shen commented on YARN-2298: --- Test failure is not related. Move TimelineClient

[jira] [Resolved] (YARN-2282) Does hadoop 2.4 support resource allocation to container for cpu cores ?

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2282. --- Resolution: Invalid Please ask questions via hadoop user mailing list: user\@hadoop.apache.org To

[jira] [Commented] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063306#comment-14063306 ] Zhijie Shen commented on YARN-2277: --- [~jeagles], thanks for your contribution. The idea

[jira] [Updated] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2247: -- Priority: Blocker (was: Major) Target Version/s: 2.5.0 Allow RM web services users to

[jira] [Updated] (YARN-2277) Add Cross-Origin support to the ATS REST API

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2277: -- Assignee: Jonathan Eagles Add Cross-Origin support to the ATS REST API

[jira] [Created] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2302: - Summary: Refactor TimelineWebServices Key: YARN-2302 URL: https://issues.apache.org/jira/browse/YARN-2302 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2302: -- Attachment: YARN-2302.1.patch Upload the patch of the code refactoring. The logic for the web services

[jira] [Commented] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064533#comment-14064533 ] Zhijie Shen commented on YARN-2302: --- Compilation failure is caused by YARN-2219. Will

[jira] [Updated] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2302: -- Attachment: (was: YARN-2302.1.patch) Refactor TimelineWebServices

[jira] [Updated] (YARN-2302) Refactor TimelineWebServices

2014-07-16 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2302: -- Attachment: YARN-2302.1.patch Kick the jenkins again Refactor TimelineWebServices

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065002#comment-14065002 ] Zhijie Shen commented on YARN-2247: --- bq. The current implementation uses the standard

[jira] [Created] (YARN-2310) Revisit the APIs in RM web services where user information can make difference

2014-07-17 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2310: - Summary: Revisit the APIs in RM web services where user information can make difference Key: YARN-2310 URL: https://issues.apache.org/jira/browse/YARN-2310 Project: Hadoop

[jira] [Created] (YARN-2311) Revisit RM web pages where user information may make difference.

2014-07-17 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2311: - Summary: Revisit RM web pages where user information may make difference. Key: YARN-2311 URL: https://issues.apache.org/jira/browse/YARN-2311 Project: Hadoop YARN

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065027#comment-14065027 ] Zhijie Shen commented on YARN-2247: --- I filed YARN-2310 and YARN-2311 for the third point.

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033_ALL.1.patch Upload a patch including the two dependent ones for jenkins to

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033.1.patch I've made a first patch, that include the whole feature for timeline

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066186#comment-14066186 ] Zhijie Shen commented on YARN-2319: --- I encountered some test failures today around this

[jira] [Created] (YARN-2320) Deprecate existing application history store after we store the history data to timeline store

2014-07-18 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-2320: - Summary: Deprecate existing application history store after we store the history data to timeline store Key: YARN-2320 URL: https://issues.apache.org/jira/browse/YARN-2320

[jira] [Commented] (YARN-2301) Improve yarn container command

2014-07-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066195#comment-14066195 ] Zhijie Shen commented on YARN-2301: --- bq. As attempt Id is not shown on console, this is

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066220#comment-14066220 ] Zhijie Shen commented on YARN-2319: --- I ran through the test cases on trunk again. The

[jira] [Commented] (YARN-2304) TestRMWebServices* fails intermittently

2014-07-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14066224#comment-14066224 ] Zhijie Shen commented on YARN-2304: --- It happened several times. Another instance:

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033_ALL.2.patch Investigate merging generic-history into the Timeline Store

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033.2.patch TestFSDownload is not related, but upload a patch to fix remaining

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033_ALL.3.patch Investigate merging generic-history into the Timeline Store

[jira] [Updated] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2033: -- Attachment: YARN-2033.3.patch Rebase against the latest trunk Investigate merging generic-history

[jira] [Commented] (YARN-1954) Add waitFor to AMRMClient(Async)

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068411#comment-14068411 ] Zhijie Shen commented on YARN-1954: --- [~ozawa], I'm generally fine with the patch. Just

[jira] [Commented] (YARN-2304) TestRMWebServices* fails intermittently

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068431#comment-14068431 ] Zhijie Shen commented on YARN-2304: --- [~ozawa] and [~kj-ki], the test failures seem to go

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068444#comment-14068444 ] Zhijie Shen commented on YARN-2319: --- [~gujilangzi], it seems that setupKDC is not need to

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068546#comment-14068546 ] Zhijie Shen commented on YARN-2033: --- The test failures are not related. See YARN-2304.

[jira] [Updated] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2262: -- Issue Type: Sub-task (was: Bug) Parent: YARN-1530 Few fields displaying wrong values in

[jira] [Commented] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068597#comment-14068597 ] Zhijie Shen commented on YARN-2262: --- [~nishan], do you have more details about the issue?

[jira] [Updated] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2262: -- Issue Type: Sub-task (was: Bug) Parent: YARN-321 Few fields displaying wrong values in

[jira] [Updated] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2262: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-1530) Few fields displaying wrong

[jira] [Commented] (YARN-2304) TestRMWebServices* fails intermittently

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068607#comment-14068607 ] Zhijie Shen commented on YARN-2304: --- I saw we've opened a number of Test*WebServices*

[jira] [Commented] (YARN-2322) Provide Cli to refesh Admin Acls for Timeline server

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068633#comment-14068633 ] Zhijie Shen commented on YARN-2322: --- In fact, we need an admin service for the timeline

[jira] [Updated] (YARN-2322) Provide Cli to refesh Admin Acls for Timeline server

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2322: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-1530 Provide Cli to refesh Admin Acls

[jira] [Commented] (YARN-2301) Improve yarn container command

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068810#comment-14068810 ] Zhijie Shen commented on YARN-2301: --- bq. Issue1 : As i understand this option should be

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069814#comment-14069814 ] Zhijie Shen commented on YARN-2270: --- +1, LGTM as well. The test failure was gone locally

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069832#comment-14069832 ] Zhijie Shen commented on YARN-2270: --- Committed to trunk, branch-2, and branch-2.5. Thanks

[jira] [Updated] (YARN-2330) Jobs are not displaying in timeline server after RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2330: -- Issue Type: Sub-task (was: Bug) Parent: YARN-321 Jobs are not displaying in timeline server

[jira] [Commented] (YARN-2330) Jobs are not displaying in timeline server after RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069943#comment-14069943 ] Zhijie Shen commented on YARN-2330: --- It is very likely that the history file of the given

[jira] [Commented] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069950#comment-14069950 ] Zhijie Shen commented on YARN-2262: --- How's your setup for RM restarting? does the

[jira] [Commented] (YARN-2229) ContainerId can overflow with RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069994#comment-14069994 ] Zhijie Shen commented on YARN-2229: --- Some additional comments: 0. For those that have

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070019#comment-14070019 ] Zhijie Shen commented on YARN-2319: --- Almost good to me, but would you mind fixing the

[jira] [Commented] (YARN-2262) Few fields displaying wrong values in Timeline server after RM restart

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070080#comment-14070080 ] Zhijie Shen commented on YARN-2262: --- Then, it should be a bug. Would you mind sharing the

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070090#comment-14070090 ] Zhijie Shen commented on YARN-2319: --- +1. Will commit it once jenkins +1 as well. Fix

[jira] [Commented] (YARN-2247) Allow RM web services users to authenticate using delegation tokens

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070165#comment-14070165 ] Zhijie Shen commented on YARN-2247: --- [~vvasudev], thanks for your patience on my

[jira] [Updated] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-2319: -- Attachment: YARN-2319.2.patch Trigger the jenkins again Fix MiniKdc not close in

[jira] [Commented] (YARN-2319) Fix MiniKdc not close in TestRMWebServicesDelegationTokens.java

2014-07-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14070383#comment-14070383 ] Zhijie Shen commented on YARN-2319: --- Committed the patch to trunk, branch-2, and

<    1   2   3   4   5   6   7   8   9   10   >