[jira] [Commented] (YARN-4343) Need to support Application History Server on ATSV2
[ https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15437377#comment-15437377 ] Vrushali C commented on YARN-4343: -- YARN-5561 proposes some new rest endpoints which might help with this jira. > Need to support Application History Server on ATSV2 > --- > > Key: YARN-4343 > URL: https://issues.apache.org/jira/browse/YARN-4343 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Reporter: Naganarasimha G R >Assignee: Naganarasimha G R > Labels: YARN-5355 > > AHS is used by the CLI and Webproxy(REST), if the application related > information is not found in RM then it tries to fetch from AHS and show -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-4343) Need to support Application History Server on ATSV2
[ https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070239#comment-15070239 ] Vrushali C commented on YARN-4343: -- Hi [~Naganarasimha] Towards the end of today's call, you had mentioned this jira id as one of the jiras you wanted some feedback on. I think we discussed this in today's call, more or less? I looked through the previous comments and wanted to say that when you get the chance, do layout your proposal so that we can review this further. thanks Vrushali > Need to support Application History Server on ATSV2 > --- > > Key: YARN-4343 > URL: https://issues.apache.org/jira/browse/YARN-4343 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Reporter: Naganarasimha G R >Assignee: Naganarasimha G R > > AHS is used by the CLI and Webproxy(REST), if the application related > information is not found in RM then it tries to fetch from AHS and show -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4343) Need to support Application History Server on ATSV2
[ https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15070600#comment-15070600 ] Naganarasimha G R commented on YARN-4343: - Hi [~vrushalic], thanks for getting back on this, may be i confused you guys a bit, what i mentioned was me and varun discussed about this issue and i will try to come up with rough approach or WIP to discuss further on this ! > Need to support Application History Server on ATSV2 > --- > > Key: YARN-4343 > URL: https://issues.apache.org/jira/browse/YARN-4343 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Reporter: Naganarasimha G R >Assignee: Naganarasimha G R > > AHS is used by the CLI and Webproxy(REST), if the application related > information is not found in RM then it tries to fetch from AHS and show -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4343) Need to support Application History Server on ATSV2
[ https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025619#comment-15025619 ] Sangjin Lee commented on YARN-4343: --- And if so, you might want to reword the title of this JIRA to summarize this more accurately. It wasn't very clear to me when I first saw it. > Need to support Application History Server on ATSV2 > --- > > Key: YARN-4343 > URL: https://issues.apache.org/jira/browse/YARN-4343 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Reporter: Naganarasimha G R >Assignee: Naganarasimha G R > > AHS is used by the CLI and Webproxy(REST), if the application related > information is not found in RM then it tries to fetch from AHS and show -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4343) Need to support Application History Server on ATSV2
[ https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025614#comment-15025614 ] Sangjin Lee commented on YARN-4343: --- So if I understood correctly, what we're discussing here is to support YARN CLI support for handling YARN-generic app information coming from the timeline service storage, correct? We're *NOT* envisioning a separate notion of AHS here, correct? I'm in agreement that we should see if we can do it on top of the REST API. Could you come up with a simple proposal of what needs to be done and share it? I think that will help us moving forward the discussion. Thanks! > Need to support Application History Server on ATSV2 > --- > > Key: YARN-4343 > URL: https://issues.apache.org/jira/browse/YARN-4343 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Reporter: Naganarasimha G R >Assignee: Naganarasimha G R > > AHS is used by the CLI and Webproxy(REST), if the application related > information is not found in RM then it tries to fetch from AHS and show -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4343) Need to support Application History Server on ATSV2
[
https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025839#comment-15025839
]
Naganarasimha G R commented on YARN-4343:
-
Oops, you are right [~sjlee0], after you mentioned i felt title is little
misleading, basically wanted to mention as {{ApplicationHistoryProtocol}}
support for ATSv2 which is used currently used by {{AHSClientImpl and
AppReportFetcher}} to fetch the AppReportObjects from history server. I will
reword it.
I was discussing some issues with Varun for proposal, as i have few doubts may
be first will discuss with you offline and then put a proposal.
> Need to support Application History Server on ATSV2
> ---
>
> Key: YARN-4343
> URL: https://issues.apache.org/jira/browse/YARN-4343
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
>Reporter: Naganarasimha G R
>Assignee: Naganarasimha G R
>
> AHS is used by the CLI and Webproxy(REST), if the application related
> information is not found in RM then it tries to fetch from AHS and show
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-4343) Need to support Application History Server on ATSV2
[
https://issues.apache.org/jira/browse/YARN-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023786#comment-15023786
]
Naganarasimha G R commented on YARN-4343:
-
Hi [~sjlee0],
I think we need to have *"yarn-2928-1st-milestone"* label for this too. As
YARNClientImpl tries to search the apps(attempts & Container details) from ATS
if its not present in RM. for CLI and AppReportFetcher tries to get the
appliction report from ATS for Webservice.So without this i feel its break in
functionality so i think for ATS v2 too we need to support it
Coming to discussion about the approach, i had offline discussion with
[~varun_saxena] and he said that as per the
[discussion|https://issues.apache.org/jira/browse/YARN-3047?focusedCommentId=14368563=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-14368563]
with [~zjshen] in YARN-3047, RPC need not be supported and it can be supported
at client side for ATSV2 (have a timelineclient get the timeline entities and
convert it into report objects).
{quote}
For some legacy problem. AHS exposes RPC interface. However, IMHO, we don't
need to create the RPC interface again in v2 as we're building the new system
from the ground. What we can do is to wrap over the REST APIs in the java
client, and provide YARN CLI commands.
{quote}
May be i can have some kind of factory and instantiate the client based on the
configurations and try to do it, but little doubt full on the dependcies part.
Let me give a try.
> Need to support Application History Server on ATSV2
> ---
>
> Key: YARN-4343
> URL: https://issues.apache.org/jira/browse/YARN-4343
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: timelineserver
>Reporter: Naganarasimha G R
>Assignee: Naganarasimha G R
>
> AHS is used by the CLI and Webproxy(REST), if the application related
> information is not found in RM then it tries to fetch from AHS and show
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
