, www.carrieriq.com
e-mail: vrodio...@carrieriq.com
From: Todd Lipcon [t...@cloudera.com]
Sent: Saturday, December 04, 2010 3:04 PM
To: dev@hbase.apache.org
Subject: Re: Local sockets
On Sat, Dec 4, 2010 at 2:57 PM, Vladimir Rodionov
vrodio...@carrieriq.comwrote
From: Todd Lipcon [t...@cloudera.com]
Sent: Saturday, December 04, 2010 3:04 PM
To: dev@hbase.apache.org
Subject: Re: Local sockets
On Sat, Dec 4, 2010 at 2:57 PM, Vladimir Rodionov
vrodio...@carrieriq.comwrote:
From my own experiments performance difference is huge even
: vrodio...@carrieriq.com
From: Todd Lipcon [t...@cloudera.com]
Sent: Monday, December 06, 2010 10:04 AM
To: dev@hbase.apache.org
Subject: Re: Local sockets
On Mon, Dec 6, 2010 at 9:59 AM, Vladimir Rodionov
vrodio...@carrieriq.comwrote:
Todd,
The major
, www.carrieriq.com
e-mail: vrodio...@carrieriq.com
From: Todd Lipcon [t...@cloudera.com]
Sent: Monday, December 06, 2010 10:04 AM
To: dev@hbase.apache.org
Subject: Re: Local sockets
On Mon, Dec 6, 2010 at 9:59 AM, Vladimir Rodionov
vrodio...@carrieriq.comwrote
regards,
Vladimir Rodionov
Principal Platform Engineer
Carrier IQ, www.carrieriq.com
e-mail: vrodio...@carrieriq.com
From: Todd Lipcon [t...@cloudera.com]
Sent: Monday, December 06, 2010 10:04 AM
To: dev@hbase.apache.org
Subject: Re: Local sockets
their results to any of the mailing lists!
-Todd
From: Todd Lipcon [t...@cloudera.com]
Sent: Monday, December 06, 2010 10:04 AM
To: dev@hbase.apache.org
Subject: Re: Local sockets
On Mon, Dec 6, 2010 at 9:59 AM, Vladimir Rodionov
vrodio
, December 06, 2010 10:04 AM
To: dev@hbase.apache.org
Subject: Re: Local sockets
On Mon, Dec 6, 2010 at 9:59 AM, Vladimir Rodionov
vrodio...@carrieriq.comwrote:
Todd,
The major hdfs problem is inefficient processing of multiple streams in
parallel -
multiple readers/writers per one
10:04 AM
To: dev@hbase.apache.org
Subject: Re: Local sockets
On Mon, Dec 6, 2010 at 9:59 AM, Vladimir Rodionov
vrodio...@carrieriq.comwrote:
Todd,
The major hdfs problem is inefficient processing of multiple streams in
parallel -
multiple readers/writers per one physical drive result
, www.carrieriq.com
e-mail: vrodio...@carrieriq.com
From: Todd Lipcon [t...@cloudera.com]
Sent: Monday, December 06, 2010 10:04 AM
To: dev@hbase.apache.org
Subject: Re: Local sockets
On Mon, Dec 6, 2010 at 9:59 AM, Vladimir Rodionov
vrodio
Ryan Rawson ryano...@gmail.com writes:
So are we talking about re-implementing IO scheduling in Hadoop at the
application level?
Essentially yes. It does seem nasty to do that, but realistically
there's no way that a general purpose I/O scheduler in the OS can
schedule I/O optimally for M/R
Carrier IQ, www.carrieriq.com
e-mail: vrodio...@carrieriq.com
From: Rajappa Iyer [...@panix.com]
Sent: Monday, December 06, 2010 12:24 PM
To: dev@hbase.apache.org
Subject: Re: Local sockets
Ryan Rawson ryano...@gmail.com writes:
So are we talking about
Hi,
has anyone tested the performance impact (when there is a hdfs
datanode and a hbase node on the same machine) of using unix domain
sockets communication or shared memory ipc using nio? I guess this
should make a difference on reads?
Regards,
Leen
Hi Leen,
Check out HDFS-347 for more info on this. I hope to pick this back up in
2011 - in 2010 we mostly focused on stability above performance in HBase's
interactions with HDFS.
Thanks
-Todd
On Sat, Dec 4, 2010 at 12:28 PM, Leen Toelen toe...@gmail.com wrote:
Hi,
has anyone tested the
-mail: vrodio...@carrieriq.com
From: Todd Lipcon [t...@cloudera.com]
Sent: Saturday, December 04, 2010 12:30 PM
To: dev@hbase.apache.org
Subject: Re: Local sockets
Hi Leen,
Check out HDFS-347 for more info on this. I hope to pick this back up in
2011
Lipcon [t...@cloudera.com]
Sent: Saturday, December 04, 2010 12:30 PM
To: dev@hbase.apache.org
Subject: Re: Local sockets
Hi Leen,
Check out HDFS-347 for more info on this. I hope to pick this back up in
2011 - in 2010 we mostly focused on stability above performance in HBase's
interactions
: vrodio...@carrieriq.com
From: Todd Lipcon [t...@cloudera.com]
Sent: Saturday, December 04, 2010 12:30 PM
To: dev@hbase.apache.org
Subject: Re: Local sockets
Hi Leen,
Check out HDFS-347 for more info on this. I hope to pick this back up in
2011
16 matches
Mail list logo