If you could share more specifics regarding just how it's not working (i.e., job specifics, stack traces, how you're invoking it, etc), you might get more assistance in troubleshooting.
On Wed, Apr 6, 2011 at 1:44 AM, Shuja Rehman <[email protected]> wrote: > -libjars is not working nor distributed cache, any other > solution?????????????????????????????????????????? > > On Mon, Apr 4, 2011 at 11:40 PM, James Seigel <[email protected]> wrote: > >> James’ quick and dirty, get your job running guideline: >> >> -libjars <-- for jars you want accessible by the mappers and reducers >> classpath or bundled in the main jar <-- for jars you want accessible to >> the runner >> >> Cheers >> James. >> >> >> >> On 2011-04-04, at 12:31 PM, Shuja Rehman wrote: >> >> > well...i think to put in distributed cache is good idea. do u have any >> > working example how to put extra jars in distributed cache and how to >> make >> > available these jars for job? >> > Thanks >> > >> > On Mon, Apr 4, 2011 at 10:20 PM, Mark Kerzner <[email protected]> >> wrote: >> > >> >> I think you can put them either in your jar or in distributed cache. >> >> >> >> As Allen pointed out, my idea of putting them into hadoop lib jar was >> >> wrong. >> >> >> >> Mark >> >> >> >> On Mon, Apr 4, 2011 at 12:16 PM, Marco Didonna <[email protected] >> >>> wrote: >> >> >> >>> On 04/04/2011 07:06 PM, Allen Wittenauer wrote: >> >>> >> >>>> >> >>>> On Apr 4, 2011, at 8:06 AM, Shuja Rehman wrote: >> >>>> >> >>>> Hi All >> >>>>> >> >>>>> I have created a map reduce job and to run on it on the cluster, i >> have >> >>>>> bundled all jars(hadoop, hbase etc) into single jar which increases >> the >> >>>>> size >> >>>>> of overall file. During the development process, i need to copy again >> >> and >> >>>>> again this complete file which is very time consuming so is there any >> >> way >> >>>>> that i just copy the program jar only and do not need to copy the lib >> >>>>> files >> >>>>> again and again. i am using net beans to develop the program. >> >>>>> >> >>>>> kindly let me know how to solve this issue? >> >>>>> >> >>>> >> >>>> This was in the FAQ, but in a non-obvious place. I've updated >> it >> >>>> to be more visible (hopefully): >> >>>> >> >>>> >> >>>> >> >> >> http://wiki.apache.org/hadoop/FAQ#How_do_I_submit_extra_content_.28jars.2C_static_files.2C_etc.29_for_my_job_to_use_during_runtime.3F >> >>>> >> >>> >> >>> Does the same apply to jar containing libraries? Let's suppose I need >> >>> lucene-core.jar to run my project. Can I put my this jar into my job >> jar >> >> and >> >>> have hadoop "see" lucene's classes? Or should I use distributed cache?? >> >>> >> >>> MD >> >>> >> >>> >> >> >> > >> > >> > >> > -- >> > Regards >> > Shuja-ur-Rehman Baig >> > <http://pk.linkedin.com/in/shujamughal> >> >> > > > -- > Regards > Shuja-ur-Rehman Baig > <http://pk.linkedin.com/in/shujamughal> >
