On Mar 18, 2008, at 4:41 PM, Jimmy Wan wrote:
The properties mentioned here: http://wiki.apache.org/hadoop/FAQ#13 have been deprecated in favor of two separate properties: mapred.tasktracker.map.tasks.maximum mapred.tasktracker.reduce.tasks.maximum
I've updated the wiki to reflect those... sorry you got mislead.
I'd like to limit the total # of threads on a task tracker (think limited resources on a given compute node) to a given number, and there does not appear to be a way to do that anymore. Am I correct in my understanding that there is no capability to do this?
The map/reduce tasks are not threads, they are run in separate JVMs which are forked by the tasktracker.
OTOH, there are other threads (RPC etc.) - are you looking at limiting those?
Arun
-- Jimmy