JobTracker is slowed down because it forks subprocesses to do a df command
--------------------------------------------------------------------------
Key: MAPREDUCE-1345
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1345
Project: Hadoop Map/Reduce
Issue Type: Bug
Reporter: dhruba borthakur
Assignee: Scott Chen
The JobTracker periodically does a df on the local directories. It forks a
shell a shell to run a df command. The creation of the separate process is very
slow because the process address space is copied by the OS on every subprocess
creation. This becomes worse when the JT is configured to use a large heap
space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
