[
https://issues.apache.org/jira/browse/YARN-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15300476#comment-15300476
]
Varun Saxena commented on YARN-4835:
------------------------------------
Actually all these changes are required only for MR AM UI.
Even the changes in NM. This is required because we only know AM's container ID
and do not know the log file names for the container.
So containerLogFiles endpoint is to fetch log file names given the container
ID. We can list them on UI and then user can click on it to fetch the contents
through containerLog endpoint.
containerLog endpoint will still be used to read the individual log file.
Initially I had thought this JIRA will cover all the REST changes including
[~sunilg]'s node label related REST changes. That was part of the reason why I
went ahead and completed this JIRA first so that Sunil is not blocked if he is
intending to complete that page.
Anyways, we can raise a MR JIRA for changes in mapreduce project. Maybe have an
umbrella JIRA for MR related web UI changes(which can be taken up later).
Should I include NM changes also in that JIRA or here ? We can atleast have
Sunil's changes here I guess.
Regarding limiting log file size, we can probably add a query param to
containerLogs endpoint for number of bytes to return. Thoughts ?
And have a JIRA for this on trunk ? Or on this branch only ? This issue wasn't
covered in this JIRA so far.
bq. getJobTasks is now supporting a new query param called state. Will this be
backward compatible? Ideally it should be fine, but its better we check once.
Similarly for getJobTaskAttempts
Query params are optional. Should be fine. Those who do not specify the param
will get the REST output same way as earlier and dont need to change their URL.
bq. Could we use StringUtils for splitString.
Yes, that would be better.
> [YARN-3368] REST API related changes for new Web UI
> ---------------------------------------------------
>
> Key: YARN-4835
> URL: https://issues.apache.org/jira/browse/YARN-4835
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: webapp
> Affects Versions: YARN-3368
> Reporter: Varun Saxena
> Assignee: Varun Saxena
> Attachments: YARN-4835-YARN-3368.01.patch,
> YARN-4835-YARN-3368.02.patch
>
>
> Following things need to be added for AM related web pages.
> 1. Support task state query param in REST URL for fetching tasks.
> 2. Support task attempt state query param in REST URL for fetching task
> attempts.
> 3. A new REST endpoint to fetch counters for each task belonging to a job.
> Also have a query param for counter name.
> i.e. something like :
> {{/jobs/\{jobid\}/taskCounters}}
> 4. A REST endpoint in NM for fetching all log files associated with a
> container. Useful if logs served by NM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
