I've got a hadoop cluster running the example files just fine, but am having difficulty running a custom job.

Specifically, the job starts, and then each task that is scheduled fails, with the following error:

Error initializing task_0007_m_000063_0:
java.io.IOException: /DFS_ROOT/tmp/mapred/system/submit_i849v1/ job.xml: No such file or directory

I was under the impression that when starting hadoop using bin/hadoop jar myJarFile.jar <options>, hadoop would do the magic of actually transferring the jar for me. In fact, I do see it temporarily appear in tmp/mapred/local/jobTracker (a jar and xml file) on the DFS drive I am using. But for whatever reason, this is not making it to the client machines (or locating it in the correct place).

The job itself is very simple, literally a copy of wordcount, with a slightly changed map function.

If anyone has any ideas, I would greatly appreciate it.

Thanks.

Ross Boucher
[EMAIL PROTECTED]

Reply via email to