Re: Caching frequently map input files

[Arun C Murthy]

Shimi,

On Feb 10, 2008, at 10:32 AM, Shimi K wrote:
Is Hadoop cache frequently/LRU/MRU map input files? Or does it  
upload files
from the disk each time a file is needed no matter if it was the  
same file
that was required by the last job on the same node?


There is no concept of caching input files across jobs.

Hadoop is geared towards dealing with _huge_ amounts of data which  
don't fit into memory anyway... and hence doing it across jobs is moot.

Arun

I am currently using version 0.14.4

- Shimi