jar files on NFS instead of DistributedCache

2008-04-18 Thread Mikhail Bautin
)); or something similar. Is there already such a feature or should I just go ahead and implement it? Thanks, Mikhail Bautin

Re: jar files on NFS instead of DistributedCache

2008-04-19 Thread Mikhail Bautin
/18/08, Doug Cutting [EMAIL PROTECTED] wrote: Mikhail Bautin wrote: Specifically, I just need a way to alter the child JVM's classpath via JobConf, without having the framework copy anything in and out of HDFS, because all my files are already accessible from all nodes. I see how to do

Re: hadoop jobs take long time to setup

2009-06-28 Thread Mikhail Bautin
This is the way we deal with this problem, too. We put our jar files on NFS, and the attached patch makes possible to add those jar files to the tasktracker classpath through a configuration property. Thanks, Mikhail On Sun, Jun 28, 2009 at 5:21 PM, Stuart White stuart.whi...@gmail.comwrote:

Re: hadoop jobs take long time to setup

2009-06-28 Thread Mikhail Bautin
? To be explicit: Do you confirm that using tmpjars like I do is a costful slow operation ? To what branch to you apply the patch (we use 0.18.3) ? Cheers //Marcus On Sun, Jun 28, 2009 at 11:26 PM, Mikhail Bautin mbau...@gmail.com wrote: This is the way we deal with this problem, too. We put our

Re: hadoop jobs take long time to setup

2009-06-28 Thread Mikhail Bautin
the patched code right ? Or is it the tasktrackers ? Kindly //Marcus On Mon, Jun 29, 2009 at 12:08 AM, Mikhail Bautin mbau...@gmail.com wrote: Marcus, We currently use 0.20.0 but this patch just inserts 8 lines of code into TaskRunner.java, which could certainly be done with 0.18.3