Thanks for the fast answer. On 8/18/07, Arun C Murthy <[EMAIL PROTECTED]> wrote: > > Thorsten, > > On Sat, Aug 18, 2007 at 01:18:06PM +0200, Thorsten Schuett wrote: > > >Please correct me if I am wrong, but it looks like hadoop is using the > rpc > >mechanism to copy the map output files to the reduce task (in this case > via > >the loopback device). i > > Hadoop uses http to copy map output files, not rpc.
The comments in ReduceTask made me think, that it uses rpc. >If my assumptions are correct, would it be possible to > >read/access the files directly in the "one-node mode"? > > Please take a look at LocalJobRunner in src/org/apache/hadoop/mapred ... > set the jobtracker in your config to 'local' and this happens automatically. > (http://wiki.apache.org/lucene-hadoop/HowToDebugMapReducePrograms) When I use "local", I loose the web interface and the multi-threading. I can live with the former, but the latter is not an option. Thorsten
