There is some obvious limitation in terms of memory usages in Jobtracker. Why would you want such enormous number of tasks?


Derek Gottfrid wrote:
I tried to create a job that set the # of Tasks to 900k and it hung
and then ended up killing it's self. The 900k should have been split
over 300 machines but it never took. When I reduced the task # down to
200k it worked with out issue (over the same 300 machines). Are there
any guidelines about maximum # of tasks ?

thanks,
derek

Reply via email to