[jira] [Created] (YARN-706) Race Condition in TestFSDownload

2013-05-20 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-706: Summary: Race Condition in TestFSDownload Key: YARN-706 URL: https://issues.apache.org/jira/browse/YARN-706 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-681) Move ContainerTokenIdentifier from yarn-common to yarn-server-common

2013-05-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-681. -- Resolution: Invalid Move ContainerTokenIdentifier from yarn-common to yarn-server-common

[jira] [Updated] (YARN-422) Add NM client library

2013-05-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-422: - Attachment: YARN-422.6.patch Addressed Bikas' comments, and updated patch against latest trunk (fixing the

[jira] [Updated] (YARN-706) Race Condition in TestFSDownload

2013-05-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-706: - Attachment: YARN-706.1.patch Ensure the downloading tasks are completed before verifying the results.

[jira] [Updated] (YARN-706) Race Condition in TestFSDownload

2013-05-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-706: - Attachment: YARN-706.2.patch Correct the patch format. Race Condition in TestFSDownload

[jira] [Updated] (YARN-706) Race Condition in TestFSDownload

2013-05-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-706: - Attachment: YARN-706.3.patch Thanks, Omkar! I've fixed the termination issue. On the other hand, I removed

[jira] [Updated] (YARN-706) Race Condition in TestFSDownload

2013-05-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-706: - Attachment: YARN-706.4.patch Add timeout back. Race Condition in TestFSDownload

[jira] [Commented] (YARN-422) Add NM client library

2013-05-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13663910#comment-13663910 ] Zhijie Shen commented on YARN-422: -- bq. There is no need to start NMCommunicator everytime

[jira] [Updated] (YARN-422) Add NM client library

2013-05-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-422: - Attachment: YARN-422.8.patch Thank Vinod for the comments! I've addressed most of them. WRT the question:

[jira] [Commented] (YARN-422) Add NM client library

2013-05-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13664844#comment-13664844 ] Zhijie Shen commented on YARN-422: -- It seems that smart-apply-patch.sh doesn't accept the

[jira] [Updated] (YARN-422) Add NM client library

2013-05-22 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-422: - Attachment: YARN-422.9.patch Updated the patch against the latest trunk Add NM client

[jira] [Updated] (YARN-1363) Get / Cancel / Renew delegation token api should be non blocking

2014-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1363: -- Attachment: YARN-1363.10.patch Kick the jenkins again Get / Cancel / Renew delegation token api

[jira] [Commented] (YARN-1729) ATSWebServices always passes primary and secondary filters as strings

2014-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13914804#comment-13914804 ] Zhijie Shen commented on YARN-1729: --- In the test case, is it good to test scenario of

[jira] [Updated] (YARN-1729) TimelineWebServices always passes primary and secondary filters as strings

2014-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1729: -- Summary: TimelineWebServices always passes primary and secondary filters as strings (was:

[jira] [Commented] (YARN-1363) Get / Cancel / Renew delegation token api should be non blocking

2014-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13915442#comment-13915442 ] Zhijie Shen commented on YARN-1363: --- Jian, thanks for the comments. bq. we don’t need a

[jira] [Updated] (YARN-1363) Get / Cancel / Renew delegation token api should be non blocking

2014-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1363: -- Attachment: YARN-1363.11.patch Get / Cancel / Renew delegation token api should be non blocking

[jira] [Commented] (YARN-1363) Get / Cancel / Renew delegation token api should be non blocking

2014-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13915449#comment-13915449 ] Zhijie Shen commented on YARN-1363: --- We need to think about whether get/cancel/renew

[jira] [Updated] (YARN-1445) Separate FINISHING and FINISHED state in YarnApplicationState

2014-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1445: -- Target Version/s: 2.4.0 Separate FINISHING and FINISHED state in YarnApplicationState

[jira] [Updated] (YARN-1363) Get / Cancel / Renew delegation token api should be non blocking

2014-02-27 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1363: -- Attachment: YARN-1363.12.patch Fix a nit Get / Cancel / Renew delegation token api should be non

[jira] [Commented] (YARN-1445) Separate FINISHING and FINISHED state in YarnApplicationState

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13916057#comment-13916057 ] Zhijie Shen commented on YARN-1445: --- Sorry for raising the new thought so late, but i

[jira] [Updated] (YARN-1685) Bugs around log URL

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1685: -- Description: 1. Log URL should be different when the container is running and finished 2. Null case

[jira] [Assigned] (YARN-1685) Log URL should be different when the container is running and finished, and null case needs to be handled

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-1685: - Assignee: Zhijie Shen (was: Mayank Bansal) Log URL should be different when the container is

[jira] [Commented] (YARN-1685) Log URL should be different when the container is running and finished, and null case needs to be handled

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13916098#comment-13916098 ] Zhijie Shen commented on YARN-1685: --- Take it over, thanks! Log URL should be different

[jira] [Updated] (YARN-1685) Bugs around log URL

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1685: -- Summary: Bugs around log URL (was: Log URL should be different when the container is running and

[jira] [Updated] (YARN-1685) Bugs around log URL

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1685: -- Attachment: YARN-1685.2.patch Created a patch to fix the problems mentioned in the description. In

[jira] [Commented] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analog APIs

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13916618#comment-13916618 ] Zhijie Shen commented on YARN-1389: --- Some high level comments for the initial patch: 1.

[jira] [Commented] (YARN-1756) capture the time when newApplication is called in RM

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13916677#comment-13916677 ] Zhijie Shen commented on YARN-1756: --- What does newApplication meaning? Constructing the

[jira] [Commented] (YARN-1756) capture the time when newApplication is called in RM

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13916692#comment-13916692 ] Zhijie Shen commented on YARN-1756: --- Hm... If I understand correctly, you want to get a

[jira] [Commented] (YARN-1363) Get / Cancel / Renew delegation token api should be non blocking

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13916695#comment-13916695 ] Zhijie Shen commented on YARN-1363: --- To survive RM failover, renew operation needs to

[jira] [Updated] (YARN-1756) Capture one more timestamp for an application when ApplicationClientProtocol#getNewApplication is executed

2014-02-28 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1756: -- Summary: Capture one more timestamp for an application when ApplicationClientProtocol#getNewApplication

[jira] [Created] (YARN-1776) renewDelegationToken should survive RM failover

2014-03-03 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1776: - Summary: renewDelegationToken should survive RM failover Key: YARN-1776 URL: https://issues.apache.org/jira/browse/YARN-1776 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analog APIs

2014-03-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918401#comment-13918401 ] Zhijie Shen commented on YARN-1389: --- [~mayank_bansal], the patch still doesn't compile.

[jira] [Commented] (YARN-1729) TimelineWebServices always passes primary and secondary filters as strings

2014-03-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918507#comment-13918507 ] Zhijie Shen commented on YARN-1729: --- 1. mapper is not necessary, objectReader and

[jira] [Commented] (YARN-1445) Separate FINISHING and FINISHED state in YarnApplicationState

2014-03-03 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918984#comment-13918984 ] Zhijie Shen commented on YARN-1445: --- I've thought about postponing the unregistration

[jira] [Created] (YARN-1780) Improve logging in timeline service

2014-03-03 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1780: - Summary: Improve logging in timeline service Key: YARN-1780 URL: https://issues.apache.org/jira/browse/YARN-1780 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analog APIs

2014-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13919732#comment-13919732 ] Zhijie Shen commented on YARN-1389: --- Thanks for the new patch. Here're some more

[jira] [Updated] (YARN-1780) Improve logging in timeline service

2014-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1780: -- Attachment: YARN-1780.1.patch Create a patch to do the following things: 1. In TimelineClientImpl,

[jira] [Updated] (YARN-1780) Improve logging in timeline service

2014-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1780: -- Description: It's difficult to trace whether the client has successfully posted the entity to the

[jira] [Created] (YARN-1782) CLI should let users to query cluster metrics

2014-03-04 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1782: - Summary: CLI should let users to query cluster metrics Key: YARN-1782 URL: https://issues.apache.org/jira/browse/YARN-1782 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-1787) yarn applicationattempt/container print wrong usage information

2014-03-04 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1787: - Summary: yarn applicationattempt/container print wrong usage information Key: YARN-1787 URL: https://issues.apache.org/jira/browse/YARN-1787 Project: Hadoop YARN

[jira] [Updated] (YARN-1780) Improve logging in timeline service

2014-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1780: -- Attachment: YARN-1780.1.patch Improve logging in timeline service ---

[jira] [Assigned] (YARN-1787) yarn applicationattempt/container print wrong usage information

2014-03-04 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen reassigned YARN-1787: - Assignee: Zhijie Shen yarn applicationattempt/container print wrong usage information

[jira] [Commented] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIs

2014-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13921265#comment-13921265 ] Zhijie Shen commented on YARN-1389: --- 1. In javadoc of ApplicationClientProtocol, we

[jira] [Updated] (YARN-1787) yarn applicationattempt/container print wrong usage information

2014-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1787: -- Attachment: YARN-1787.1.patch Fix the usage message and add corresponding test case. After the patch,

[jira] [Updated] (YARN-1787) yarn applicationattempt/container print wrong usage information

2014-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1787: -- Attachment: YARN-1787.2.patch Upload a new patch, which rebase against the latest trunk yarn

[jira] [Commented] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIs

2014-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13921878#comment-13921878 ] Zhijie Shen commented on YARN-1389: --- I realize there will be an issue that may not have

[jira] [Updated] (YARN-1685) Bugs around log URL

2014-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1685: -- Attachment: YARN-1685.3.patch Bugs around log URL --- Key:

[jira] [Commented] (YARN-1685) Bugs around log URL

2014-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13922074#comment-13922074 ] Zhijie Shen commented on YARN-1685: --- Vinod, thanks for the review. I've updated the

[jira] [Commented] (YARN-1685) Bugs around log URL

2014-03-05 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13922078#comment-13922078 ] Zhijie Shen commented on YARN-1685: --- BTW, it won't lead to race condition, because the

[jira] [Updated] (YARN-1685) Bugs around log URL

2014-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1685: -- Attachment: YARN-1685.4.patch Upload a new patch: 1. Move the logic of constructing the log URL

[jira] [Commented] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIs

2014-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923569#comment-13923569 ] Zhijie Shen commented on YARN-1389: --- Thanks for the update, Mayank! The patch is general

[jira] [Commented] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIs

2014-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923574#comment-13923574 ] Zhijie Shen commented on YARN-1389: --- I've tested the patch locally. yarn

[jira] [Commented] (YARN-1787) yarn applicationattempt/container print wrong usage information

2014-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923621#comment-13923621 ] Zhijie Shen commented on YARN-1787: --- bq. I am fairly sure you broke bin/yarn appliciation

[jira] [Commented] (YARN-1717) Enable offline deletion of entries in leveldb timeline store

2014-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923651#comment-13923651 ] Zhijie Shen commented on YARN-1717: --- Hi Billie, thanks for patch. I've just a quick

[jira] [Commented] (YARN-1701) More intuitive defaults for AHS

2014-03-06 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923658#comment-13923658 ] Zhijie Shen commented on YARN-1701: --- bq. I agree the configuration needs to be simple. So

[jira] [Commented] (YARN-1621) Add CLI to list states of yarn container-IDs/hosts

2014-03-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13924277#comment-13924277 ] Zhijie Shen commented on YARN-1621: --- There should be similar request for yarn

[jira] [Commented] (YARN-445) Ability to signal containers

2014-03-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13924461#comment-13924461 ] Zhijie Shen commented on YARN-445: -- {code} -signal container ID [signal number] Signal the

[jira] [Commented] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIs

2014-03-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13924654#comment-13924654 ] Zhijie Shen commented on YARN-1389: --- One more nit: please add some comments to say we're

[jira] [Created] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2014-03-10 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1809: - Summary: Synchronize RM and Generic History Service Web-UIs Key: YARN-1809 URL: https://issues.apache.org/jira/browse/YARN-1809 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2014-03-10 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13926052#comment-13926052 ] Zhijie Shen commented on YARN-1809: --- Another issue that I think is good to fix together

[jira] [Created] (YARN-1817) Synchronize RM and Generic History Service RESTful Web Services

2014-03-10 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1817: - Summary: Synchronize RM and Generic History Service RESTful Web Services Key: YARN-1817 URL: https://issues.apache.org/jira/browse/YARN-1817 Project: Hadoop YARN

[jira] [Created] (YARN-1819) ApplicationHistoryClientService#getApplications needs to be able to filter applications

2014-03-10 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1819: - Summary: ApplicationHistoryClientService#getApplications needs to be able to filter applications Key: YARN-1819 URL: https://issues.apache.org/jira/browse/YARN-1819

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2014-03-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1809: -- Attachment: YARN-1809.1.patch Synchronize RM and Generic History Service Web-UIs

[jira] [Commented] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIs

2014-03-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931255#comment-13931255 ] Zhijie Shen commented on YARN-1389: --- 1. Please remove this comment {code} /* *

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2014-03-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931121#comment-13931121 ] Zhijie Shen commented on YARN-1809: --- I've uploaded an initial patch. The basic approach

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2014-03-11 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931129#comment-13931129 ] Zhijie Shen commented on YARN-1809: --- BTW, I've done some preliminary test of the app list

[jira] [Commented] (YARN-1717) Enable offline deletion of entries in leveldb timeline store

2014-03-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13932412#comment-13932412 ] Zhijie Shen commented on YARN-1717: --- Thanks for the patch, Billie! Here're some more

[jira] [Commented] (YARN-1717) Enable offline deletion of entries in leveldb timeline store

2014-03-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13932437#comment-13932437 ] Zhijie Shen commented on YARN-1717: --- After the aging mechanism works, there may be some

[jira] [Commented] (YARN-1530) [Umbrella] Store, manage and serve per-framework application-timeline data

2014-03-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13932623#comment-13932623 ] Zhijie Shen commented on YARN-1530: --- I've done some stress test about the timeline

[jira] [Updated] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIs

2014-03-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1389: -- Attachment: YARN-1389.10.patch Mayank, thanks for the new patch. It looks good to me. I did some minor

[jira] [Updated] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIs

2014-03-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1389: -- Hadoop Flags: Reviewed ApplicationClientProtocol and ApplicationHistoryProtocol should expose

[jira] [Updated] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIs

2014-03-12 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1389: -- Attachment: YARN-1389.11.patch Upload a new patch, which should fix the findbugs warning.

[jira] [Commented] (YARN-1389) ApplicationClientProtocol and ApplicationHistoryProtocol should expose analogous APIs

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13932950#comment-13932950 ] Zhijie Shen commented on YARN-1389: --- Test failures are not related.

[jira] [Commented] (YARN-1577) Unmanaged AM is broken because of YARN-1493

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13932957#comment-13932957 ] Zhijie Shen commented on YARN-1577: --- Hi, Naren. YARN-1389 is resolved you can make use of

[jira] [Commented] (YARN-1830) TestRMRestart.testQueueMetricsOnRMRestart failure

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13933586#comment-13933586 ] Zhijie Shen commented on YARN-1830: --- See the same failure reported on YARN-1389

[jira] [Commented] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934027#comment-13934027 ] Zhijie Shen commented on YARN-1809: --- AHS web-UI is still not able to show tags due to

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1809: -- Attachment: YARN-1809.2.patch Upload a new patch with the following changes: 1. Rebase against

[jira] [Commented] (YARN-808) ApplicationReport does not clearly tell that the attempt is running or not

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934165#comment-13934165 ] Zhijie Shen commented on YARN-808: -- After YARN-1389, we have separate APIs to get the

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1809: -- Attachment: YARN-1809.3.patch Fix the findbugs Synchronize RM and Generic History Service Web-UIs

[jira] [Commented] (YARN-1717) Enable offline deletion of entries in leveldb timeline store

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934288#comment-13934288 ] Zhijie Shen commented on YARN-1717: --- Some minor things on the patch: 1. Rename the class

[jira] [Commented] (YARN-1830) TestRMRestart.testQueueMetricsOnRMRestart failure

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934535#comment-13934535 ] Zhijie Shen commented on YARN-1830: --- If I understand correctly, the race condition

[jira] [Updated] (YARN-1830) TestRMRestart.testQueueMetricsOnRMRestart failure

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1830: -- Attachment: YARN-1830.1.patch Upload a patch to see whether the failure can be get rid of.

[jira] [Commented] (YARN-1830) TestRMRestart.testQueueMetricsOnRMRestart failure

2014-03-13 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934625#comment-13934625 ] Zhijie Shen commented on YARN-1830: ---

[jira] [Updated] (YARN-1685) Bugs around log URL

2014-03-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1685: -- Attachment: YARN-1685.5.patch Upload a new patch with the new approach Bugs around log URL

[jira] [Commented] (YARN-1685) Bugs around log URL

2014-03-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934679#comment-13934679 ] Zhijie Shen commented on YARN-1685: --- Vinod, good suggestion. We can make use of the

[jira] [Created] (YARN-1834) YarnClient will not be redirected to the history server when RM is done

2014-03-14 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1834: - Summary: YarnClient will not be redirected to the history server when RM is done Key: YARN-1834 URL: https://issues.apache.org/jira/browse/YARN-1834 Project: Hadoop YARN

[jira] [Updated] (YARN-1834) YarnClient will not be redirected to the history server when RM is done

2014-03-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1834: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-321 YarnClient will not be redirected to

[jira] [Commented] (YARN-1521) Mark appropriate protocol methods with the idempotent annotation or AtMostOnce annotation

2014-03-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13935274#comment-13935274 ] Zhijie Shen commented on YARN-1521: --- Just a reminder, ApplicationClientProtocol has four

[jira] [Created] (YARN-1835) History client service needs to be more robust

2014-03-14 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-1835: - Summary: History client service needs to be more robust Key: YARN-1835 URL: https://issues.apache.org/jira/browse/YARN-1835 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-1835) History client service needs to be more robust

2014-03-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1835: -- Issue Type: Sub-task (was: Bug) Parent: YARN-321 History client service needs to be more

[jira] [Commented] (YARN-1717) Enable offline deletion of entries in leveldb timeline store

2014-03-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13935568#comment-13935568 ] Zhijie Shen commented on YARN-1717: --- Billie, thanks for your metrics. I've don some

[jira] [Updated] (YARN-1717) Enable offline deletion of entries in leveldb timeline store

2014-03-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1717: -- Hadoop Flags: Reviewed Enable offline deletion of entries in leveldb timeline store

[jira] [Updated] (YARN-1838) Timeline service getEntities API should provide ability to get entities from given id

2014-03-14 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1838: -- Component/s: (was: api) Assignee: Billie Rinaldi Summary: Timeline service

[jira] [Commented] (YARN-1690) sending ATS events from Distributed shell

2014-03-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938049#comment-13938049 ] Zhijie Shen commented on YARN-1690: --- Mayank, thanks for the new patch! It's almost good,

[jira] [Updated] (YARN-1685) Bugs around log URL

2014-03-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1685: -- Attachment: YARN-1685.6.patch Vinod, thanks for the review. I've uploaded a new patch: 1. Clean the

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2014-03-17 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1809: -- Attachment: YARN-1809.4.patch Upload a new patch: 1. Rebase after YARN-1685 2. Make

[jira] [Updated] (YARN-1690) Sending timeline entities+events from Distributed shell

2014-03-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1690: -- Summary: Sending timeline entities+events from Distributed shell (was: sending ATS events from

[jira] [Updated] (YARN-1809) Synchronize RM and Generic History Service Web-UIs

2014-03-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-1809: -- Attachment: YARN-1809.5.patch Fix a bug in FairSchedulerAppsBlock Synchronize RM and Generic History

[jira] [Commented] (YARN-1690) Sending timeline entities+events from Distributed shell

2014-03-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13939976#comment-13939976 ] Zhijie Shen commented on YARN-1690: --- +1. the patch looks good to me. I've run through the

[jira] [Commented] (YARN-1690) Sending timeline entities+events from Distributed shell

2014-03-18 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13940129#comment-13940129 ] Zhijie Shen commented on YARN-1690: --- Committed to trunk, branch-2, and branch-2.4.

<    4   5   6   7   8   9   10   11   12   13   >