[
https://issues.apache.org/jira/browse/YARN-4835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15299198#comment-15299198
]
Wangda Tan commented on YARN-4835:
----------------------------------
Thanks [~varun_saxena],
I would suggest to split this JIRA to two JIRAs:
1) REST API enhancements for MR UI
2) REST API enhancements for YARN UI
As we discussed offline, we may need to put MR UI to a different folder under
MR project, so we need to expose common part of YARN UI to avoid duplicated
code. We can finish MR REST API enhancements later.
Few comments to NM related APIs:
- Move {{/containerlogfiles/...}} to {{/containerlog/...}}? Since it supports
only logs for only one container
- Add a query parameter to specify offset (\?) and length to obtain part of a
large file.
- May need to limit max bytes returned to AM. If a container has huge log file,
read whole log file into memory may cause OOM issue. Not sure how existing NM
handle this, if user open a log file on NM web UI, and click "view all file",
will the file filly loaded to memory?
- Could you attach a sample JSON response for the API for easier review?
Thanks,
> [YARN-3368] REST API related changes for new Web UI
> ---------------------------------------------------
>
> Key: YARN-4835
> URL: https://issues.apache.org/jira/browse/YARN-4835
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: webapp
> Affects Versions: YARN-3368
> Reporter: Varun Saxena
> Assignee: Varun Saxena
> Attachments: YARN-4835-YARN-3368.01.patch,
> YARN-4835-YARN-3368.02.patch
>
>
> Following things need to be added for AM related web pages.
> 1. Support task state query param in REST URL for fetching tasks.
> 2. Support task attempt state query param in REST URL for fetching task
> attempts.
> 3. A new REST endpoint to fetch counters for each task belonging to a job.
> Also have a query param for counter name.
> i.e. something like :
> {{/jobs/\{jobid\}/taskCounters}}
> 4. A REST endpoint in NM for fetching all log files associated with a
> container. Useful if logs served by NM.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
