Hi Ying Zhu, I think you're using the wrong port for the NameNode. Unless you changed the defaults, 50070 is the Web UI and you should be using 8020 for actually using HDFS.
- Robert On Thu, Jul 25, 2013 at 3:19 AM, YingZhu <[email protected]> wrote: > Hello list, > We have a testing hadoop cluster made up of 3 machines, we decided > to use oozie to submit jobs > to this cluster. I'm able to run the examples packaged in the oozie rpm > package using the command line tool oozie, > but when I use the java API OozieClient to submit jobs to the cluster, I > continuingly get the following error: > 2013-07-25 17:40:39,717 WARN ActionStartXCommand:542 - USER[root] > GROUP[-] TOKEN[] APP[workflow-2] JOB[0000005-130725173118231-oozie-oozi-W] > ACTION[0000005-130725173118231-oozie-oozi-W@mapreduce-23] Error starting > action [mapreduce-23]. ErrorType [TRANSIENT], ErrorCode [JA009], Message > [JA009: Call to BDMStest02.abc.com/192.168.0.235:50070 failed on local > exception: java.io.EOFException] > org.apache.oozie.action.ActionExecutorException: JA009: Call to > BDMStest02.scistor.com/192.168.0.235:50070 failed on local exception: > java.io.EOFException > at > org.apache.oozie.action.ActionExecutor.convertException(ActionExecutor.java:379) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.addToCache(JavaActionExecutor.java:331) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.setLibFilesArchives(JavaActionExecutor.java:415) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.submitLauncher(JavaActionExecutor.java:603) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:831) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:194) > at > org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:55) > at org.apache.oozie.command.XCommand.call(XCommand.java:277) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:326) > at > org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:255) > at > org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.io.IOException: Call to > BDMStest02.abc.com/192.168.0.235:50070 failed on local exception: > java.io.EOFException > at org.apache.hadoop.ipc.Client.wrapException(Client.java:1144) > at org.apache.hadoop.ipc.Client.call(Client.java:1112) > at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:229) > at $Proxy24.getProtocolVersion(Unknown Source) > at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:411) > at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:135) > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:276) > at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:241) > at > org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:100) > at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1426) > at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) > at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1444) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123) > at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:238) > at org.apache.hadoop.fs.Path.getFileSystem(Path.java:187) > at > org.apache.hadoop.filecache.DistributedCache.addFileToClassPath(DistributedCache.java:438) > at > org.apache.oozie.service.HadoopAccessorService$3.run(HadoopAccessorService.java:434) > at > org.apache.oozie.service.HadoopAccessorService$3.run(HadoopAccessorService.java:429) > at java.security.AccessController.doPrivileged(Native Method) > at javax.security.auth.Subject.doAs(Subject.java:396) > at > org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1136) > at > org.apache.oozie.service.HadoopAccessorService.addFileToClassPath(HadoopAccessorService.java:429) > at > org.apache.oozie.action.hadoop.JavaActionExecutor.addToCache(JavaActionExecutor.java:310) > ... 12 more > Caused by: java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:375) > at org.apache.hadoop.ipc.Client$Connection.receiveResponse(Client.java:848) > at org.apache.hadoop.ipc.Client$Connection.run(Client.java:786) > > > I searched the web and it seems like someone also ran into this problem, > but there is no right fix. The hadoop version is > Hadoop 1.1.2.21 > Subversion -r > Compiled by jenkins on Thu Jan 10 03:38:39 PST 2013 > From source with checksum ce0aa0de785f572347f1afee69c73861 > Oozie client/server version: > Oozie client build version: 3.2.0.23 > > > Does anyone have clue on this issue? Thanks in advance! > > > Thanks, > Ying Zhu
