Do you have capacity on your cluster? Did you submit it to the right queue? Go
to your scheduler page:
http://YOUR-RESOURCE-MANAGER-HOSTNAME:8088/cluster/scheduler
On Thursday, January 29, 2015 4:48 AM, Frank Lanitz
<[email protected]> wrote:
Hi,
Sorry for spamming the list. ;)
Am 29.01.2015 um 05:38 schrieb Akira AJISAKA:
> Job.setJarByClass is missing in the grep job.
>
> https://issues.apache.org/jira/browse/MAPREDUCE-6231
>
> Did you run another example job (ex. PiEstimator)?
> Other example jobs are setting user classes by Job.setJarByClass.
> I'm thinking they would work in your environment.
Well, finally some of the other examples are working but seem to also
get stuck at some point.
E.g.
> $ hadoop jar
> /home/hadoop/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.6.0.jar
> pi 16 100000
> Number of Maps = 16
> Samples per Map = 100000
> 15/01/29 13:38:18 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> Wrote input for Map #0
> Wrote input for Map #1
> Wrote input for Map #2
> Wrote input for Map #3
> Wrote input for Map #4
> Wrote input for Map #5
> Wrote input for Map #6
> Wrote input for Map #7
> Wrote input for Map #8
> Wrote input for Map #9
> Wrote input for Map #10
> Wrote input for Map #11
> Wrote input for Map #12
> Wrote input for Map #13
> Wrote input for Map #14
> Wrote input for Map #15
> Starting Job
> 15/01/29 13:38:19 INFO client.RMProxy: Connecting to ResourceManager at
> hadoopm/192.168.20.235:8032
> 15/01/29 13:38:19 INFO input.FileInputFormat: Total input paths to process :
> 16
> 15/01/29 13:38:19 INFO mapreduce.JobSubmitter: number of splits:16
> 15/01/29 13:38:20 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1422524123097_0008
> 15/01/29 13:38:20 INFO impl.YarnClientImpl: Submitted application
> application_1422524123097_0008
> 15/01/29 13:38:20 INFO mapreduce.Job: The url to track the job:
> http://hadoopm:8088/proxy/application_1422524123097_0008/
> 15/01/29 13:38:20 INFO mapreduce.Job: Running job: job_1422524123097_0008
and then noting more happens. When checking the job-list it's saying
that it is still in prep mode:
> $ mapred job -list
> 15/01/29 13:45:18 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 15/01/29 13:45:18 INFO client.RMProxy: Connecting to ResourceManager at
> hadoopm/192.168.20.235:8032
> Total jobs:1
> JobId State StartTime UserName
>Queue Priority UsedContainers RsvdContainers UsedMem
>RsvdMem NeededMem AM info
> job_1422524123097_0008 PREP 1422535100215 hadoop
>default NORMAL 1 0 2048M
> 0M 2048M
>http://hadoopm:8088/proxy/application_1422524123097_0008/
So my original question is still active: Where I have to dig in to see,
why it's not starting. What am I looking for?
Cheers,
Frank
