Ok, I have completed the testing and it is working good. One problem
though. I noticed that we are using a distributed cache for the job
files. If I am creating new job jar files on the fly, but still copying
them to the job.jar location, how is this affected by distributed caching?
Dennis Kubes
Dennis Kubes wrote:
Ok, I read the JIRA and have been hacking away at this for the past
couple of hours. I have a workable patch for that I just need to test.
It follows what the JIRA proposed to create a master job.jar file from
multiple job jar files passed. I will test and post tomorrow morning.
Dennis Kubes
Runping Qi wrote:
Yes, definitely. There is a JIRA opened precisely for that:
https://issues.apache.org/jira/browse/HADOOP-1622
Runping Qi
-----Original Message-----
From: Dennis Kubes [mailto:[EMAIL PROTECTED]
Sent: Wednesday, July 18, 2007 5:14 PM
To: [email protected]
Subject: Multiple Job Jar files?
Is it possible to have multiple job jar files being submitted to hadoop
at once? If not, is this a feature that might be useful?
I can see this being useful for custom Nutch development, having a nutch
job.jar and a custom.job.jar file.
Dennis Kubes
