There are some hooks available in the schedulers that could be useful also. I think they were expected to be used to allow you to schedule tasks based on load average on the host, but I'd expect you can customize them for your purpose.
On Fri, Jan 28, 2011 at 6:46 AM, Harsh J <[email protected]> wrote: > Moving discussion to the MapReduce-User list: > [email protected] > > Reply inline: > > On Fri, Jan 28, 2011 at 2:39 PM, rishi pathak <[email protected]> > wrote: > > Hi, > > Is there a way to drain a tasktracker. What we require is not to > > schedule any more map/red tasks onto a tasktracker(mark it offline) but > > still the running tasks should not be affected. > > You could simply shut the TT down. MapReduce was designed with faults > in mind and thus tasks that are running on a particular TaskTracker > can be re-run elsewhere if they failed. Is this not usable in your > case? > > -- > Harsh J > www.harshj.com >
