Unless you write your own, optimized for M/R applications. Yes, application level I/O scheduler for M/R kind of applications can be much efficient than standard Linux I/O scheduler. But this is off topic in hbase-dev list, I presume.
Best regards, Vladimir Rodionov Principal Platform Engineer Carrier IQ, www.carrieriq.com e-mail: [email protected] ________________________________________ From: Rajappa Iyer [[email protected]] Sent: Monday, December 06, 2010 12:24 PM To: [email protected] Subject: Re: Local sockets Ryan Rawson <[email protected]> writes: > So are we talking about re-implementing IO scheduling in Hadoop at the > application level? Essentially yes. It does seem nasty to do that, but realistically there's no way that a general purpose I/O scheduler in the OS can schedule I/O optimally for M/R kind of applications. -rsi
