Ryan Rawson <[email protected]> writes: > So are we talking about re-implementing IO scheduling in Hadoop at the > application level?
Essentially yes. It does seem nasty to do that, but realistically there's no way that a general purpose I/O scheduler in the OS can schedule I/O optimally for M/R kind of applications. -rsi
