Re: MapReduce: specify a *DFS* path for mapred.jar property

2006-08-31 Thread Frédéric Bertin
Doug Cutting wrote: Frédéric Bertin wrote: *// Set the user's name and working directory* String user = System.getProperty(user.name); job.setUser(user != null ? user : Dr Who); if (job.getWorkingDirectory() == null) {

Re: MapReduce: specify a *DFS* path for mapred.jar property

2006-08-31 Thread Doug Cutting
Frédéric Bertin wrote: This should run clientside, since it depends on the username, which is different on the server. then, what about passing the username as a parameter to the JobSubmissionProtocol.submitJob(...) ? This avoids loading the whole JobConf clientside just to set the username.

Re: MapReduce: specify a *DFS* path for mapred.jar property

2006-08-31 Thread Owen O'Malley
On Aug 31, 2006, at 9:48 AM, Frédéric Bertin wrote: Doug Cutting wrote: Frédéric Bertin wrote: *// Set the user's name and working directory* String user = System.getProperty(user.name); job.setUser(user != null ? user : Dr Who); if

Re: MapReduce: specify a *DFS* path for mapred.jar property

2006-08-31 Thread Eric Baldeschwieler
Interesting thread. This relates to HADOOP-288. Also the thread I started last week on using URLs in general for input arguments. Seems like we should just take a URL for the jar, which could be file: or hdfs: Thoughts? On Aug 31, 2006, at 10:54 AM, Doug Cutting wrote: Frédéric Bertin

Re: MapReduce: specify a *DFS* path for mapred.jar property

2006-08-31 Thread Doug Cutting
Eric Baldeschwieler wrote: Also the thread I started last week on using URLs in general for input arguments. Seems like we should just take a URL for the jar, which could be file: or hdfs: That would work. The jobclient could automatically copy file: urls to the jobtracker's native fs.

RE: URIs and hadoop

2006-08-31 Thread Michel Tourn
On URIs: I had to learn more about URIs while looking at WebDAV code... I am starting to like them. Below scheme file: is really for local files Hadoop Path-s would use scheme hdfs: Some developers like named pipes. You can write to an existing named pipe from Java. But this is not supported