Hi,
for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several
errors regarding pig jobs, which are failing:
...
2015-07-08 12:19:30,883 [JobControl] INFO
org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob -
PigLatin:sthToHive.pig got an error while submitting
java.io.IOException: Failed to run job : Application
application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue:
default
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
at
org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
at
org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191)
at java.lang.Thread.run(Thread.java:745)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271)
...
I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion
0.12.1.2.1.11.0-891.
Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and
PigVersion 0.12.1.2.1.2.0-402.
The only difference in my logfiles are the outputs of the TimelineClient and I
also found several issues (but not mine) with it online.
I also know, that there was a patch in
YARN-1962<https://issues.apache.org/jira/browse/YARN-1962>, which disables the
timelineserver by default.
Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but
none of the minor releases in between.
To convince my IT to maybe disable the timelineserver, I need to know if
2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0
but not disabled by default (as it seems to be not included in
2.4.0.2.1.2.0-402).
Where can I get such information?
Thanks an best regards,
Florian
