[
https://issues.apache.org/jira/browse/MAPREDUCE-2863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150701#comment-13150701
]
Hitesh Shah commented on MAPREDUCE-2863:
----------------------------------------
bq. Perhaps for everything memory related I can make web services all common
with MB?
That should work. When eventually yarn becomes more consistent with the values,
we will not need to change/break the web-service response output.
amoutput:
- (JSON output:) Not sure if this is really an issue but "job" and "task" in
one set point to an array of objects and in another point to an object ( /jobs
vs /job and likewise for /tasks and /task ). I believe this is the case for
most multi-obj vs single-obj get calls.
rmoutput:
- do we need to support some form of pagination of the responses?
- we can probably expect hundreds of nodes, apps - when making an /apps
call, do we intend to dump out all the data? For now, as this is the first
version, I believe we can look at addressing this issue in a later version.
Probably follow the same approach as the web ui as done in prev versions when
handling large amounts of info.
bq. Upon further review I'm going to change the output to be a bit more restful
where things like /apps, /tasks, /taskattempts, /containers return only a list
of the ids.
Any ideas on how the folks in SE/operations would plan to use these apis? It
might be worth discussing the output formats with them to understand if the
main use cases can be met without incurring a lot of calls/overhead. If in
general, the use case is to get detailed info on all apps, this will result in
a lot more calls to the RM which will be a performance overhead. In addition to
the ids, it might make sense to return some minimal additional/useful info in
the full listing such that detailed info calls are not required.
> Support web-services for RM & NM
> --------------------------------
>
> Key: MAPREDUCE-2863
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2863
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2, nodemanager, resourcemanager
> Affects Versions: 0.23.0
> Reporter: Arun C Murthy
> Assignee: Thomas Graves
> Priority: Blocker
> Attachments: MAPREDUCE-2863.patch, amoutput.txt, nmoutput.txt,
> nmoutput.txt, rmoutput.txt, rmoutput.txt
>
>
> It will be very useful for RM and NM to support web-services to export
> json/xml.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
