Distributed simulator for stressing JobTracker and NameNode
-----------------------------------------------------------
Key: MAPREDUCE-2425
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2425
Project: Hadoop Map/Reduce
Issue Type: New Feature
Components: benchmarks
Reporter: Min Zhou
Fix For: 0.22.0
Hadoop need a tool for stressing JobTracker and NameNode. Mumak introduced a
simulated JobTracker, whose behavior doesn't exactly like that of the real
JobTracker. Even more, mumak can't simulate a large cluster with quite a lot of
jobs run on it. On the other hand, Gridmix v3 need hundreds of physical nodes
to replay job stories.
You can think this tool a complementation of mumak and gridmix v3. We
successfully used this tool to simulate a 12000 nodes cluster through 4 real
machines.
I've talk to Hong Tang and Scott Chen offline, they suggested me contributing
this tool to the hadoop community.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
