Just out of curiosity, how does it work if I am not using HDFS? ~ Neeraj
-----Original Message----- From: Owen O'Malley [mailto:[EMAIL PROTECTED] Sent: Thursday, July 12, 2007 6:47 PM To: [email protected] Subject: Re: Submitting jobs into Hadoop On Jul 12, 2007, at 2:10 PM, Doug Cutting wrote: > The job's jar file is unpacked in the directory that tasks are > connected to when they run. The classpath of the task JVM includes > all jars in the lib/ directory in the job's jar, the classes/ > directory from the jar, and the top-level directory of the jar. Just a few more details: 1. The JobClient copies the jar from the local file system into HDFS under the "system" directory. 2. The first task for a given job that is run on a TaskTracker reads the jar out of HDFS, writes it locally, and expands it. 3. When the job is done, the jar is deleted from all of the TaskTrackers and the system directory. -- Owen
