[
https://issues.apache.org/jira/browse/YARN-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17022280#comment-17022280
]
Adam Antal commented on YARN-10029:
-----------------------------------
UIv2 using the ATS has the following logic for obtaining a given logfile:
1. The user chooses an application, and goes to its log page.
2. The user chooses an application attempt belonging to the application.
3. The user chooses a container belonging to the application attempt.
4. The user chooses a log file belonging to the container.
1. is already given in the UI, 2 is supported by the UI (RM has API for this),
and 4. is supported by the new log servlet pushed into JHS in YARN-10028.
The missing step is #3. There's no such API currently that would give the full
list of containers belonging to an application (for running containers we have
RM REST API). A new API should be implemented so that we will have every
information in the UI, and would not depend on the ATS at all (regarding logs
at least).
The missing API endpoint would ideally list the containers from logs point of
view, so using {{LogAggregationController}}'s {{#readAggregatedLogsMeta}} call.
That is not related to the ResourceManager at all, so it can be incorporated to
the JHS as a side endpoint to support extracting logs.
> Add option to UIv2 to get container logs from the new JHS API
> -------------------------------------------------------------
>
> Key: YARN-10029
> URL: https://issues.apache.org/jira/browse/YARN-10029
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: yarn
> Affects Versions: 3.2.1
> Reporter: Adam Antal
> Assignee: Adam Antal
> Priority: Major
> Attachments: YARN-10029.001.patch
>
>
> Provided the new API is ready to use (also integrated into JHS in
> YARN-10028), we can add a new config option to UIv2 that would make the UIv2
> to request logs from the JHS API similarly as the ATSv2.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
