Re: Number of map and reduce tasks to run.

[Enis Soztutar]

Avinash Lakshman wrote:

Hi All

Is there any heuristic to figuring out as to how many map/reduce tasks I
need to be running ? For eg if I am processing a file that is 100GB how many
map/reduce tasks do I need to run ?

Thanks
A

you can just check out the wiki page :
http://wiki.apache.org/lucene-hadoop/HowManyMapsAndReduces