The error seems to clearly indicate that you are submitting to an invalid queue: "java.io.IOException: Failed to run job : Application application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: default”
You may want to address the queue name issue first before looking into enabling/disabling Timeline. Furthermore, Apache releases are not versioned using 6 digits (https://hadoop.apache.org/releases.html). For your deployment and the changes across the 2 versions, you may wish to contact the Hadoop distro vendor that has been used for your cluster. thanks — Hitesh On Jul 10, 2015, at 2:32 AM, Krautwurm, Florian <[email protected]> wrote: > Hi, > > for reasons I have to use hadoop 2.4.0.2.1.11.0-891, but now I get several > errors regarding pig jobs, which are failing: > > … > 2015-07-08 12:19:30,883 [JobControl] INFO > org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob - > PigLatin:sthToHive.pig got an error while submitting > java.io.IOException: Failed to run job : Application > application_1435937105729_0100 submitted by user xxxxxxxx to unknown queue: > default > at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:300) > at > org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432) > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285) > at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:415) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594) > at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282) > at > org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at > org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128) > at > org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:191) > at java.lang.Thread.run(Thread.java:745) > at > org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:271) > … > > > I am now using HadoopVersion 2.4.0.2.1.11.0-891 and PigVersion > 0.12.1.2.1.11.0-891. > > > Everything was working as expected with HadoopVersion 2.4.0.2.1.2.0-402 and > PigVersion 0.12.1.2.1.2.0-402. > > The only difference in my logfiles are the outputs of the TimelineClient and > I also found several issues (but not mine) with it online. > > I also know, that there was a patch in YARN-1962, which disables the > timelineserver by default. > Unfortunately I can only find release notes for version 2.4.0 and 2.4.1 but > none of the minor releases in between. > > To convince my IT to maybe disable the timelineserver, I need to know if > 2.4.0.2.1.11.0-891 is a Version, where the server is included in hadoop 2.4.0 > but not disabled by default (as it seems to be not included in > 2.4.0.2.1.2.0-402). > > Where can I get such information? > > Thanks an best regards, > Florian
