Create a mock MapReduce cluster simulator to test schedulers
------------------------------------------------------------
Key: HADOOP-5005
URL: https://issues.apache.org/jira/browse/HADOOP-5005
Project: Hadoop Core
Issue Type: Test
Components: test
Reporter: Matei Zaharia
Currently the Hadoop schedulers use a FakeTaskTrackerManager to run tests which
is both messy and doesn't really simulate trackers going up and down, tasks
finishing at different times, faiulres, etc. It would be nice to have a
simulated MapReduce cluster where tasks really do take different amounts of
(simulated) time, trackers may be slow, tasks can be made to fail, etc. The
existing TaskTrackerManager interface given to the schedulers, plus perhaps a
mockable clock (e.g. the FairScheduler.Clock class) should be enough to do all
this. The end result will be easier-to-write and more complex scheduler tests.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
