[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container
[ https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14695687#comment-14695687 ] Gagan commented on YARN-4037: - Hi Mohammed, I am not sure what difference came in hadoop configs but I configured everything from scratch using the following link https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html#YARN_on_Single_Node The error "Failed while trying to construct the redirect url to the log server. Log Server url may not be configured java.lang.Exception: Unknown container" disappeared and I could see standard err, out files, which contain the following Error: Could not create the Java Virtual Machine. Error: A fatal exception has occurred. Program will exit. I tried setting various values of set HADOOP_HEAPSIZE=512 but in vain, a value over 512 did not start the daemons. I have 8 gb ram. Could you help me on the same ? > Hadoop - failed redirect for container > -- > > Key: YARN-4037 > URL: https://issues.apache.org/jira/browse/YARN-4037 > Project: Hadoop YARN > Issue Type: Bug > Components: yarn >Affects Versions: 2.7.1 > Environment: Windows 7, Apache Hadoop 2.7.1 >Reporter: Gagan > Attachments: mapred-site.xml, yarn-site.xml > > > I believe this issue has been addressed earlier in > https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because > the description of the JIRA does not talk about the following message > Failed while trying to construct the redirect url to the log server. Log > Server url may not be configured > java.lang.Exception: Unknown container. Container either has not started or > has already completed or doesn't belong to this node at all. > Could some one look at the same and provide detail on the root cause and > resolution ? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container
[ https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14693868#comment-14693868 ] Gagan commented on YARN-4037: - Hi Mohammed, I reverted the property to mapreduce.jobhistory.address Garima-PC:10020 mapreduce.jobhistory.webapp.address Garima-PC:19888 in map reduce.xml and to yarn.log.server.url http://Garima-PC:19888/jobhistory/logs URL for job history server in yarn-site.xml. Restarted everything!! I am directed to http://garima-pc:19888/jobhistory/logs/Garima-PC:49552/container_1439399185544_0001_02_01/container_1439399185544_0001_02_01/Garima again the link is broken. Could you tell me if I can check the logs anywhere else, I need to find what went wrong with running the wordcount.jar example ? > Hadoop - failed redirect for container > -- > > Key: YARN-4037 > URL: https://issues.apache.org/jira/browse/YARN-4037 > Project: Hadoop YARN > Issue Type: Bug > Components: yarn >Affects Versions: 2.7.1 > Environment: Windows 7, Apache Hadoop 2.7.1 >Reporter: Gagan > Attachments: mapred-site.xml, yarn-site.xml > > > I believe this issue has been addressed earlier in > https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because > the description of the JIRA does not talk about the following message > Failed while trying to construct the redirect url to the log server. Log > Server url may not be configured > java.lang.Exception: Unknown container. Container either has not started or > has already completed or doesn't belong to this node at all. > Could some one look at the same and provide detail on the root cause and > resolution ? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container
[ https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14693293#comment-14693293 ] Mohammad Shahid Khan commented on YARN-4037: It should go +to the link http://garima-pc:49712/jobhistory/logs/Garima-PC:50415/container_1439303739376_0001_02_01/container_1439303739376_0001_02_01/Garima Seems like you have not restarted the Cluster after the configuration change. > Hadoop - failed redirect for container > -- > > Key: YARN-4037 > URL: https://issues.apache.org/jira/browse/YARN-4037 > Project: Hadoop YARN > Issue Type: Bug > Components: yarn >Affects Versions: 2.7.1 > Environment: Windows 7, Apache Hadoop 2.7.1 >Reporter: Gagan > Attachments: mapred-site.xml, yarn-site.xml > > > I believe this issue has been addressed earlier in > https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because > the description of the JIRA does not talk about the following message > Failed while trying to construct the redirect url to the log server. Log > Server url may not be configured > java.lang.Exception: Unknown container. Container either has not started or > has already completed or doesn't belong to this node at all. > Could some one look at the same and provide detail on the root cause and > resolution ? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container
[
https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681316#comment-14681316
]
Mohammad Shahid Khan commented on YARN-4037:
Hi Gagan,
The below convention in configuring the log server url.
{CODE}
yarn.log.server.url
http://$jobhistoryserver.full.hostname:port/jobhistory/logs
URL for job history server
{CODE}
Note:
The port should be the port being used for the
mapreduce.jobhistory.webapp.address.
for example if the mapreduce.jobhistory.webapp.address has the value ip1:10988,
then the host and port for the log server shuld ip1:10988
Please verify once your configuration.
> Hadoop - failed redirect for container
> --
>
> Key: YARN-4037
> URL: https://issues.apache.org/jira/browse/YARN-4037
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.7.1
> Environment: Windows 7, Apache Hadoop 2.7.1
>Reporter: Gagan
>
> I believe this issue has been addressed earlier in
> https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because
> the description of the JIRA does not talk about the following message
> Failed while trying to construct the redirect url to the log server. Log
> Server url may not be configured
> java.lang.Exception: Unknown container. Container either has not started or
> has already completed or doesn't belong to this node at all.
> Could some one look at the same and provide detail on the root cause and
> resolution ?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container
[ https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681141#comment-14681141 ] Gagan commented on YARN-4037: - Hi Xuan, Could you please confirm upon the points mentioned in my previous comment ? > Hadoop - failed redirect for container > -- > > Key: YARN-4037 > URL: https://issues.apache.org/jira/browse/YARN-4037 > Project: Hadoop YARN > Issue Type: Bug > Components: yarn >Affects Versions: 2.7.1 > Environment: Windows 7, Apache Hadoop 2.7.1 >Reporter: Gagan > > I believe this issue has been addressed earlier in > https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because > the description of the JIRA does not talk about the following message > Failed while trying to construct the redirect url to the log server. Log > Server url may not be configured > java.lang.Exception: Unknown container. Container either has not started or > has already completed or doesn't belong to this node at all. > Could some one look at the same and provide detail on the root cause and > resolution ? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container
[ https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679515#comment-14679515 ] Gagan commented on YARN-4037: - Hi Xuan, Yes I forgot to mention it, I did try to both in the yarn-site and mapred but couldn't get success either. I will retry with yarn-site. Could you tell me is the following value correct for yarn.log.server.url localhost:jobhistory port I think I might have put in the incorrect port earlier. What would be the correct port to put in and where to get it from ? Also when I googled about this error, one of the links mentioned the creation of stderr file, where is it created ? > Hadoop - failed redirect for container > -- > > Key: YARN-4037 > URL: https://issues.apache.org/jira/browse/YARN-4037 > Project: Hadoop YARN > Issue Type: Bug > Components: yarn >Affects Versions: 2.7.1 > Environment: Windows 7, Apache Hadoop 2.7.1 >Reporter: Gagan > > I believe this issue has been addressed earlier in > https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because > the description of the JIRA does not talk about the following message > Failed while trying to construct the redirect url to the log server. Log > Server url may not be configured > java.lang.Exception: Unknown container. Container either has not started or > has already completed or doesn't belong to this node at all. > Could some one look at the same and provide detail on the root cause and > resolution ? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container
[
https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14679222#comment-14679222
]
Xuan Gong commented on YARN-4037:
-
[~gagan.ban...@gmail.com]
Have you configured the
{code}
yarn.log.server.url
{code}
in the yarn-site.xml for container log redirection for the case you want to
check the container log when the app finished ?
> Hadoop - failed redirect for container
> --
>
> Key: YARN-4037
> URL: https://issues.apache.org/jira/browse/YARN-4037
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
>Affects Versions: 2.7.1
> Environment: Windows 7, Apache Hadoop 2.7.1
>Reporter: Gagan
>
> I believe this issue has been addressed earlier in
> https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because
> the description of the JIRA does not talk about the following message
> Failed while trying to construct the redirect url to the log server. Log
> Server url may not be configured
> java.lang.Exception: Unknown container. Container either has not started or
> has already completed or doesn't belong to this node at all.
> Could some one look at the same and provide detail on the root cause and
> resolution ?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
