[jira] [Commented] (YARN-1473) Exception from container-launch(Apache Hadoop 2.2.0)

2016-03-10 Thread Gagan (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15189194#comment-15189194
 ] 

Gagan commented on YARN-1473:
-

Hi Nishant, Maximiliano
I got so frustrated building hadoop, that I decided to start from scratch and 
just followed Building.txt present with hadoop's download. An example would be 
https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347/BUILDING.txt
Please check your build version and look for this file.
I followed every instruction present there and was able to build the same (did 
it last year).

> Exception from container-launch(Apache Hadoop 2.2.0)
> 
>
> Key: YARN-1473
> URL: https://issues.apache.org/jira/browse/YARN-1473
> Project: Hadoop YARN
>  Issue Type: Bug
> Environment: CentOS5.8 and Apache Hadoop 2.2.0
>Reporter: Joy Xu
> Attachments: yarn-site.xml
>
>
> Hello all,
> I have meet a exception from container-launch when I run the built-in 
> wordcount program .and the error messge as follow:
> {code}
> 13/12/05 00:17:31 INFO mapreduce.Job: Job job_1386171829089_0003 failed with 
> state FAILED due to: Application application_1386171829089_0003 failed 2 
> times due to AM Container for appattempt_1386171829089_0003_02 exited 
> with  exitCode: 1 due to: Exception from container-launch: 
> org.apache.hadoop.util.Shell$ExitCodeException: 
>   at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
>   at org.apache.hadoop.util.Shell.run(Shell.java:379)
>   at 
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
>   at 
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
>   at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
>   at 
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
>   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
>   at java.lang.Thread.run(Thread.java:662)
> .Failing this attempt.. Failing the application.
> 13/12/05 00:17:31 INFO mapreduce.Job: Counters: 0
> {code}
> Hope someone can Help. Thx.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container

2015-08-13 Thread Gagan (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14695687#comment-14695687
 ] 

Gagan commented on YARN-4037:
-

Hi Mohammed,

I am not sure what difference came in hadoop configs but I configured 
everything from scratch using the following link
https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/SingleCluster.html#YARN_on_Single_Node

The error
Failed while trying to construct the redirect url to the log server. Log 
Server url may not be configured
java.lang.Exception: Unknown container

disappeared and I could see standard err, out files, which contain the 
following 

Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.

I tried setting various values of 
set HADOOP_HEAPSIZE=512
but in vain, a value over 512 did not start the daemons. I have 8 gb ram.

Could you help me on the same ?


 Hadoop - failed redirect for container
 --

 Key: YARN-4037
 URL: https://issues.apache.org/jira/browse/YARN-4037
 Project: Hadoop YARN
  Issue Type: Bug
  Components: yarn
Affects Versions: 2.7.1
 Environment: Windows 7, Apache Hadoop 2.7.1
Reporter: Gagan
 Attachments: mapred-site.xml, yarn-site.xml


 I believe this issue has been addressed earlier in 
 https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because 
 the description of the JIRA does not talk about the following message 
 Failed while trying to construct the redirect url to the log server. Log 
 Server url may not be configured
 java.lang.Exception: Unknown container. Container either has not started or 
 has already completed or doesn't belong to this node at all.
 Could some one look at the same and provide detail on the root cause and 
 resolution ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container

2015-08-12 Thread Gagan (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14693868#comment-14693868
 ] 

Gagan commented on YARN-4037:
-

Hi Mohammed,

I reverted the property to 
  property
namemapreduce.jobhistory.address /name
valueGarima-PC:10020/value
  /property
  property
namemapreduce.jobhistory.webapp.address/name
valueGarima-PC:19888/value
  /property
in map reduce.xml
and to 
property 
   nameyarn.log.server.url/name 
   valuehttp://Garima-PC:19888/jobhistory/logs/value
   descriptionURL for job history server  /description
  /property
in yarn-site.xml. Restarted everything!!
I am directed to 
http://garima-pc:19888/jobhistory/logs/Garima-PC:49552/container_1439399185544_0001_02_01/container_1439399185544_0001_02_01/Garima
 
again the link is broken. Could you tell me if I can check the logs anywhere 
else, I need to find what went wrong with running the wordcount.jar example ?


 Hadoop - failed redirect for container
 --

 Key: YARN-4037
 URL: https://issues.apache.org/jira/browse/YARN-4037
 Project: Hadoop YARN
  Issue Type: Bug
  Components: yarn
Affects Versions: 2.7.1
 Environment: Windows 7, Apache Hadoop 2.7.1
Reporter: Gagan
 Attachments: mapred-site.xml, yarn-site.xml


 I believe this issue has been addressed earlier in 
 https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because 
 the description of the JIRA does not talk about the following message 
 Failed while trying to construct the redirect url to the log server. Log 
 Server url may not be configured
 java.lang.Exception: Unknown container. Container either has not started or 
 has already completed or doesn't belong to this node at all.
 Could some one look at the same and provide detail on the root cause and 
 resolution ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (YARN-4037) Hadoop - failed redirect for container

2015-08-11 Thread Gagan (JIRA) 

 [ 
https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Gagan updated YARN-4037:

Attachment: mapred-site.xml
yarn-site.xml

Hi Mohammad,

May be I am making a fundamental mistake.

My target is to run - wordcount example jar with 2.7.1 on yarn in a psuedo 
distributed mode (on my laptop). 

When I run it I get an exception, in order to check what it is  I am trying to 
look for logs at 
http://garima-pc:8088/cluster/apps/FAILED to 
http://garima-pc:8088/cluster/app/application_1439303739376_0001 to logs link 
and after implementing what you have described it takes me to a link
http://garima-pc:19888/jobhistory/logs/Garima-PC:50415/container_1439303739376_0001_02_01/container_1439303739376_0001_02_01/Garima
which is broken. seems like port 50415 port is getting dynamically generated.
I am attaching my configuration xml files.

 Hadoop - failed redirect for container
 --

 Key: YARN-4037
 URL: https://issues.apache.org/jira/browse/YARN-4037
 Project: Hadoop YARN
  Issue Type: Bug
  Components: yarn
Affects Versions: 2.7.1
 Environment: Windows 7, Apache Hadoop 2.7.1
Reporter: Gagan
 Attachments: mapred-site.xml, yarn-site.xml


 I believe this issue has been addressed earlier in 
 https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because 
 the description of the JIRA does not talk about the following message 
 Failed while trying to construct the redirect url to the log server. Log 
 Server url may not be configured
 java.lang.Exception: Unknown container. Container either has not started or 
 has already completed or doesn't belong to this node at all.
 Could some one look at the same and provide detail on the root cause and 
 resolution ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container

2015-08-10 Thread Gagan (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14681141#comment-14681141
 ] 

Gagan commented on YARN-4037:
-

Hi Xuan,

Could you please confirm upon the points mentioned in my previous comment ?

 Hadoop - failed redirect for container
 --

 Key: YARN-4037
 URL: https://issues.apache.org/jira/browse/YARN-4037
 Project: Hadoop YARN
  Issue Type: Bug
  Components: yarn
Affects Versions: 2.7.1
 Environment: Windows 7, Apache Hadoop 2.7.1
Reporter: Gagan

 I believe this issue has been addressed earlier in 
 https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because 
 the description of the JIRA does not talk about the following message 
 Failed while trying to construct the redirect url to the log server. Log 
 Server url may not be configured
 java.lang.Exception: Unknown container. Container either has not started or 
 has already completed or doesn't belong to this node at all.
 Could some one look at the same and provide detail on the root cause and 
 resolution ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (YARN-4037) Hadoop - failed redirect for container

2015-08-09 Thread Gagan (JIRA) 
Gagan created YARN-4037:
---

 Summary: Hadoop - failed redirect for container
 Key: YARN-4037
 URL: https://issues.apache.org/jira/browse/YARN-4037
 Project: Hadoop YARN
  Issue Type: Bug
  Components: yarn
Affects Versions: 2.7.1
 Environment: Windows 7, Apache Hadoop 2.7.1
Reporter: Gagan


I believe this issue has been addressed earlier in 
https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because 
the description of the JIRA does not talk about the following message 
Failed while trying to construct the redirect url to the log server. Log Server 
url may not be configured
java.lang.Exception: Unknown container. Container either has not started or has 
already completed or doesn't belong to this node at all.

Could some one look at the same and provide detail on the root cause and 
resolution ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (YARN-1473) Exception from container-launch(Apache Hadoop 2.2.0)

2015-08-09 Thread Gagan (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-1473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679132#comment-14679132
 ] 

Gagan commented on YARN-1473:
-

Hi, 
I am running hadoop 2.7.1 and facing a similar issue. The details are 
Failed redirect for container_1439014904092_0001_02_01


Failed while trying to construct the redirect url to the log server. Log Server 
url may not be configured
java.lang.Exception: Unknown container. Container either has not started or has 
already completed or doesn't belong to this node at all.


Diagnostics: Exception from container-launch.
Container id: container_1439014904092_0001_02_01
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:
722)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.la
unchContainer(DefaultContainerExecutor.java:211)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.C
ontainerLaunch.call(ContainerLaunch.java:302)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.C
ontainerLaunch.call(ContainerLaunch.java:82)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.
java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor
.java:615)
at java.lang.Thread.run(Thread.java:744)

Shell output: 1 file(s) moved.


Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
15/08/08 11:55:51 INFO mapreduce.Job: Counters: 0
I tried to understand the root cause but could not. Can some one help me out to 
at least understand the reason of this issue and the resolution ?

 Exception from container-launch(Apache Hadoop 2.2.0)
 

 Key: YARN-1473
 URL: https://issues.apache.org/jira/browse/YARN-1473
 Project: Hadoop YARN
  Issue Type: Bug
 Environment: CentOS5.8 and Apache Hadoop 2.2.0
Reporter: Joy Xu
 Attachments: yarn-site.xml


 Hello all,
 I have meet a exception from container-launch when I run the built-in 
 wordcount program .and the error messge as follow:
 {code}
 13/12/05 00:17:31 INFO mapreduce.Job: Job job_1386171829089_0003 failed with 
 state FAILED due to: Application application_1386171829089_0003 failed 2 
 times due to AM Container for appattempt_1386171829089_0003_02 exited 
 with  exitCode: 1 due to: Exception from container-launch: 
 org.apache.hadoop.util.Shell$ExitCodeException: 
   at org.apache.hadoop.util.Shell.runCommand(Shell.java:464)
   at org.apache.hadoop.util.Shell.run(Shell.java:379)
   at 
 org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:589)
   at 
 org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:195)
   at 
 org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:283)
   at 
 org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:79)
   at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
   at java.util.concurrent.FutureTask.run(FutureTask.java:138)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
   at 
 java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
   at java.lang.Thread.run(Thread.java:662)
 .Failing this attempt.. Failing the application.
 13/12/05 00:17:31 INFO mapreduce.Job: Counters: 0
 {code}
 Hope someone can Help. Thx.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (YARN-4037) Hadoop - failed redirect for container

2015-08-09 Thread Gagan (JIRA) 

[ 
https://issues.apache.org/jira/browse/YARN-4037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14679515#comment-14679515
 ] 

Gagan commented on YARN-4037:
-

Hi Xuan,

Yes I forgot to mention it, I did try to both in the yarn-site and mapred but 
couldn't get success either. I will retry with yarn-site. Could you tell me is 
the following value correct for 
nameyarn.log.server.url/name
valuelocalhost:jobhistory port/value

I think I might have put in the incorrect port earlier. What would be the 
correct port to put in and where to get it from ?
Also when I googled about this error, one of the links mentioned the creation 
of stderr file, where is it created ?

 Hadoop - failed redirect for container
 --

 Key: YARN-4037
 URL: https://issues.apache.org/jira/browse/YARN-4037
 Project: Hadoop YARN
  Issue Type: Bug
  Components: yarn
Affects Versions: 2.7.1
 Environment: Windows 7, Apache Hadoop 2.7.1
Reporter: Gagan

 I believe this issue has been addressed earlier in 
 https://issues.apache.org/jira/browse/YARN-1473 though I am not sure because 
 the description of the JIRA does not talk about the following message 
 Failed while trying to construct the redirect url to the log server. Log 
 Server url may not be configured
 java.lang.Exception: Unknown container. Container either has not started or 
 has already completed or doesn't belong to this node at all.
 Could some one look at the same and provide detail on the root cause and 
 resolution ?



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)