Hello list,
We have a testing hadoop cluster made up of 3 machines, we decided to
use oozie to submit jobs
to this cluster. I'm able to run the examples packaged in the oozie rpm package
using the command line tool oozie,
but when I use the java API OozieClient to submit jobs to the cluster, I
continuingly get the following error:
2013-07-25 17:40:39,717 WARN ActionStartXCommand:542 - USER[root] GROUP[-]
TOKEN[] APP[workflow-2] JOB[0000005-130725173118231-oozie-oozi-W]
ACTION[0000005-130725173118231-oozie-oozi-W@mapreduce-23] Error starting action
[mapreduce-23]. ErrorType [TRANSIENT], ErrorCode [JA009], Message [JA009: Call
to BDMStest02.abc.com/192.168.0.235:50070 failed on local exception:
java.io.EOFException]
org.apache.oozie.action.ActionExecutorException: JA009: Call to
BDMStest02.scistor.com/192.168.0.235:50070 failed on local exception:
java.io.EOFException
at
org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:379)
at
org.apache.oozie.action.hadoop.JavaActionExecutor.addToCache(JavaActionExecutor.java:331)
at
org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:415)
at
org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:603)
at
org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:831)
at
org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:194)
at
org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:55)
at org.apache.oozie.command.XCommand.call(XCommand.java:277)
at
org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:326)
at
org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:255)
at
org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: Call to BDMStest02.abc.com/192.168.0.235:50070
failed on local exception: java.io.EOFException
at org.apache.hadoop.ipc.Client.wrapException(Client.java:1144)
at org.apache.hadoop.ipc.Client.call(Client.java:1112)
at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:229)
at $Proxy24.getProtocolVersion(Unknown Source)
at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:411)
at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:135)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:276)
at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:241)
at
org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:100)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1426)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1444)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:238)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187)
at
org.apache.hadoop.filecache.DistributedCache.addFileToClassPath(DistributedCache.java:438)
at
org.apache.oozie.service.HadoopAccessorService$3.run(HadoopAccessorService.java:434)
at
org.apache.oozie.service.HadoopAccessorService$3.run(HadoopAccessorService.java:429)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1136)
at
org.apache.oozie.service.HadoopAccessorService.addFileToClassPath(HadoopAccessorService.java:429)
at
org.apache.oozie.action.hadoop.JavaActionExecutor.addToCache(JavaActionExecutor.java:310)
... 12 more
Caused by: java.io.EOFException
at java.io.DataInputStream.readInt(DataInputStream.java:375)
at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:848)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:786)
I searched the web and it seems like someone also ran into this problem, but
there is no right fix. The hadoop version is
Hadoop 1.1.2.21
Subversion -r
Compiled by jenkins on Thu Jan 10 03:38:39 PST 2013
>From source with checksum ce0aa0de785f572347f1afee69c73861
Oozie client/server version:
Oozie client build version: 3.2.0.23
Does anyone have clue on this issue? Thanks in advance!
Thanks,
Ying Zhu
