[
https://issues.apache.org/jira/browse/YARN-3084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14287336#comment-14287336
]
Michael Br commented on YARN-3084:
----------------------------------
Hi,
first thanks for your quick reply...
1. Where can i see the queue? i looked for it but i still dont get how to get
to it
2. I cant reach the logs...
The only clue I have regarding this job fails is:
Thats the only information i can see from the URL:
http://192.168.38.133:8088/ws/v1/cluster/apps/application_1421661392788_0039
(the links there when i try to use them for the logs dont
work....http://sandbox.hortonworks.com:8088/proxy/application_1421661392788_0039/
[i replace and insert my host ip]
and also the link for the container logs dont work.....
http://sandbox.hortonworks.com:8042/node/containerlogs/container_1421661392788_0039_02_000001/dr.who
----------------------------------
<app>
<id>application_1421661392788_0039</id>
<user>dr.who</user>
<name>test_33</name>
<queue>default</queue>
<state>FAILED</state>
<finalStatus>FAILED</finalStatus>
<progress>0.0</progress>
<trackingUI>History</trackingUI>
<trackingUrl>
http://sandbox.hortonworks.com:8088/cluster/app/application_1421661392788_0039
</trackingUrl>
<diagnostics>
Application application_1421661392788_0039 failed 2 times due to AM Container
for appattempt_1421661392788_0039_000002 exited with exitCode: 0 For more
detailed output, check application tracking
page:http://sandbox.hortonworks.com:8088/proxy/application_1421661392788_0039/Then,
click on links to logs of each attempt. Diagnostics: Failing this attempt.
Failing the application.
</diagnostics>
<clusterId>1421661392788</clusterId>
<applicationType>MAPREDUCE</applicationType>
<applicationTags>michael,pi example</applicationTags>
<startedTime>1421923561425</startedTime>
<finishedTime>1421923723426</finishedTime>
<elapsedTime>162001</elapsedTime>
<amContainerLogs>
http://sandbox.hortonworks.com:8042/node/containerlogs/container_1421661392788_0039_02_000001/dr.who
</amContainerLogs>
<amHostHttpAddress>sandbox.hortonworks.com:8042</amHostHttpAddress>
<allocatedMB>-1</allocatedMB>
<allocatedVCores>-1</allocatedVCores>
<runningContainers>-1</runningContainers>
<memorySeconds>200857</memorySeconds>
<vcoreSeconds>160</vcoreSeconds>
<preemptedResourceMB>0</preemptedResourceMB>
<preemptedResourceVCores>0</preemptedResourceVCores>
<numNonAMContainerPreempted>0</numNonAMContainerPreempted>
<numAMContainerPreempted>0</numAMContainerPreempted>
</app>
> YARN REST API 2.6 - can't submit simple job in hortonworks-allways job failes
> to run
> ------------------------------------------------------------------------------------
>
> Key: YARN-3084
> URL: https://issues.apache.org/jira/browse/YARN-3084
> Project: Hadoop YARN
> Issue Type: Bug
> Components: resourcemanager, webapp
> Affects Versions: 2.6.0
> Environment: Using eclipse on windows 7 (client)to run the map reduce
> job on the host of Hortonworks HDP 2.2 (hortonworks is on vmware version
> 6.0.2 build-1744117)
> Reporter: Michael Br
> Priority: Minor
>
> Hello,
> 1. I want to run the simple Map Reduce job example (with the REST API 2.6
> for yarn applications) and to calculate PI… for now it doesn’t work.
> When I use the command in the hortonworks terminal it works: “hadoop jar
> /usr/hdp/2.2.0.0-2041/hadoop-mapreduce/hadoop-mapreduce-examples-2.6.0.2.2.0.0-2041.jar
> pi 10 10”.
> But I want to submit the job with the REST API and not in the terminal as a
> command line.
> [http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_Applications_APISubmit_Application]
> 2. I do succeed with other REST API requests: get state, get new
> application id and even kill(change state), but when I try to submit my
> example, the response is:
> --------------------------------------------------
> --------------------------------------------------
> The Response Header:
> Key : null ,Value : [HTTP/1.1 202 Accepted]
> Key : Date ,Value : [Thu, 22 Jan 2015 07:47:24 GMT, Thu, 22 Jan 2015 07:47:24
> GMT]
> Key : Content-Length ,Value : [0]
> Key : Expires ,Value : [Thu, 22 Jan 2015 07:47:24 GMT, Thu, 22 Jan 2015
> 07:47:24 GMT]
> Key : Location ,Value : [http://[my
> port]:8088/ws/v1/cluster/apps/application_1421661392788_0038]
> Key : Content-Type ,Value : [application/json]
> Key : Server ,Value : [Jetty(6.1.26.hwx)]
> Key : Pragma ,Value : [no-cache, no-cache]
> Key : Cache-Control ,Value : [no-cache]
> The Respone Body:
> Null (No Response)
> --------------------------------------------------
> --------------------------------------------------
> 3. I need help with the http request body filling. I am doing a POST http
> request and I know that I am doing it right (in java).
> 4. I think the problem is in the request body.
> 5. I used this guy’s answer to help me build my map reduce example xml but
> it does not work:
> [http://hadoop-forum.org/forum/general-hadoop-discussion/miscellaneous/2136-how-can-i-run-mapreduce-job-by-rest-api].
> 6. What am I missing? (the description is not clear to me in the submit
> section of the rest api 2.6)
> 7. Does someone have an xml example for using a simple MR job?
> 8. Thanks! Here is the XML file I am using for the request body:
> --------------------------------------------------
> --------------------------------------------------
> <?xml version="1.0" encoding="UTF-8" standalone="yes"?>
> <application-submission-context>
> <application-id>application_1421661392788_0038</application-id>
> <application-name>test_21_1</application-name>
> <queue>default</queue>
> <priority>3</priority>
> <am-container-spec>
> <environment>
> <entry>
> <key>CLASSPATH</key>
>
> <value>/usr/hdp/2.2.0.0-2041/hadoop/conf<CPS>/usr/hdp/2.2.0.0-2041/hadoop/lib/*<CPS>/usr/hdp/2.2.0.0-2041/hadoop/.//*<CPS>/usr/hdp/2.2.0.0-2041/hadoop-hdfs/./<CPS>/usr/hdp/2.2.0.0-2041/hadoop-hdfs/lib/*<CPS>/usr/hdp/2.2.0.0-2041/hadoop-hdfs/.//*<CPS>/usr/hdp/2.2.0.0-2041/hadoop-yarn/lib/*<CPS>/usr/hdp/2.2.0.0-2041/hadoop-yarn/.//*<CPS>/usr/hdp/2.2.0.0-2041/hadoop-mapreduce/lib/*<CPS>/usr/hdp/2.2.0.0-2041/hadoop-mapreduce/.//*<CPS><CPS>/usr/share/java/mysql-connector-java-5.1.17.jar<CPS>/usr/share/java/mysql-connector-java.jar<CPS>/usr/hdp/current/hadoop-mapreduce-client/*<CPS>/usr/hdp/current/tez-client/*<CPS>/usr/hdp/current/tez-client/lib/*<CPS>/etc/tez/conf/<CPS>/usr/hdp/2.2.0.0-2041/tez/*<CPS>/usr/hdp/2.2.0.0-2041/tez/lib/*<CPS>/etc/tez/conf</value>
> </entry>
> </environment>
> <commands>
> <command>hadoop jar
> /usr/hdp/2.2.0.0-2041/hadoop-mapreduce/hadoop-mapreduce-examples-2.6.0.2.2.0.0-2041.jar
> pi 10 10</command>
> </commands>
> </am-container-spec>
> <unmanaged-AM>false</unmanaged-AM>
> <max-app-attempts>2</max-app-attempts>
> <resource>
> <memory>1024</memory>
> <vCores>1</vCores>
> </resource>
> <application-type>MAPREDUCE</application-type>
>
> <keep-containers-across-application-attempts>false</keep-containers-across-application-attempts>
> <application-tags>
> <tag>Michael</tag>
> <tag>PI example</tag>
> </application-tags>
> </application-submission-context>
> --------------------------------------------------
> --------------------------------------------------
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
