Hi Raajay, I don't think this would it be an easy change (Maybe you can do it VertexManager, but may still not be trivial change), do you mind tell what's your purpose for waiting for a period of time ?
Best Regard, Jeff Zhang From: Raajay <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Wednesday, January 13, 2016 at 9:20 AM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Subject: DAGScheduler Hello, I want to implement a DAGScheduler that ensures that all (or some) map vertices of a given dag are not scheduled immediately, but say after a configurable amount of time, T. I can think to do this in 3 following ways: 1. I would buffer all the "scheduleTask" events and then raise "TaskAttemptEventSchedule" after time, T. For this, I would need a clock with in DAGScheduler. I can also subscribe to an event raised periodically. Is there such an eventGenerator in Tez ? 2. Using delayed events. Is there support to raised delayed events ? 3. Modify the priority levels in "DAGSchedulerNaturalOrderControlled" based on T, to delay the start of vertices ? Which of the three is easiest to implement and possibly have limited side-effects ? Any help/pointers is appreciated. Thanks Raajay
