[
https://issues.apache.org/jira/browse/KNOX-74?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vladimir Tkhir updated KNOX-74:
-------------------------------
Attachment: KNOX-74.patch
Attached the patch for initial support of YARN 2.4.0.
A few items remained:
* *logs via REST*
We don't have any details how to get logs via REST API. This functionality
is present in RM REST API but unable to understand how to get log file
identifier. Logs resource was added to YARN REST API in
[YARN-649|https://issues.apache.org/jira/browse/YARN-649]
* *Location header that points to Web UI*
If application is completed than MapReduce Application Master REST API
returns 302 response and Location header that points to History Server's UI.
Needs to decide what response should be in this case.
* *job configuration details*
See [Job Conf
API|http://hadoop.apache.org/docs/r2.4.0/hadoop-yarn/hadoop-yarn-site/MapredAppMasterRest.html#Job_Conf_API].
In fact configuration have much more cluster details. They are present in
proxy-mapreduce-job-conf.xml patch file.
The tests for job configuration are commented out. Especially
hadoop.proxyuser.\*.hosts properies is problematic and the value may be "*" or
comma separated list of hosts.
Also there is an issue with rewrite keytabs properties. See following
comment in GatewayBasicFuncTest.java
{code}
//TODO: resolve java.util.regex.PatternSyntaxException: Unmatched closing ')'
near index 17 m@\..*EXAMPLE\.COM)s
{code}
* *not valid JSON response*
In the documentation JSON object is correct. But in reality JSON object in the
response body is not valid. See proxy-mapreduce-task-attempts.json file in the
patch. Note that key "type" is specified twice. According to [RFC
7159|http://tools.ietf.org/html/rfc7159#section-4]
{quote}
The names within an object SHOULD be unique
{quote}
Gateway works well with such JSONs, that JSON is incorrect. I think YARN team
should know about that.
> Support YARN REST API access via the Gateway
> --------------------------------------------
>
> Key: KNOX-74
> URL: https://issues.apache.org/jira/browse/KNOX-74
> Project: Apache Knox
> Issue Type: New Feature
> Components: ClientDSL, Server
> Affects Versions: 0.3.0
> Reporter: Kevin Minder
> Assignee: Vladimir Tkhir
> Fix For: 0.5.0
>
> Attachments: KNOX-74.patch, YARN RM via KNOX.docx
>
>
> YARN has a fairly rich REST API set that we should expose via the gateway.
> http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/WebServicesIntro.html
--
This message was sent by Atlassian JIRA
(v6.2#6252)
