On Thu, Jan 9, 2014 at 6:50 PM, LEI Xiaofeng le...@ihep.ac.cn wrote:
Hi,
I have some strong reasons to make me use c++ access hbase. But the
reading performance is poor. I tried to tune hbase.client.scanner.caching,
hbase.regionserver.global.memstore.upperLimit and BLOCKSIZE and so on. But
Hi,
I have some strong reasons to make me use c++ access hbase. But the reading
performance is poor. I tried to tune hbase.client.scanner.caching,
hbase.regionserver.global.memstore.upperLimit and BLOCKSIZE and so on. But
these all made no obvious difference.
Does anyone have any suggetion
the BLOCKSIZE.
-- Lars
From: LEI Xiaofeng le...@ihep.ac.cn
To: user@hbase.apache.org
Sent: Monday, January 6, 2014 11:06 PM
Subject: hbase read performance tuning failed
Hi,
I am running hbase-0.94.6-cdh4.5.0 and set up a cluster of 5 nodes. The random
read
: Monday, January 6, 2014 11:06 PM
Subject: hbase read performance tuning failed
Hi,
I am running hbase-0.94.6-cdh4.5.0 and set up a cluster of 5 nodes. The
random read performance is ok, but the scan performance is poor.
I tried to increase hbase.client.scanner.caching to 100 to promote the
scan
收件人: user@hbase.apache.org
抄送:
主题: Re: hbase read performance tuning failed
but the scan performance is poor.
Did you set start row and end row in the Scan? Besides, if the random read
performance of your cluster is ok, maybe smallscan could help you.
HBASE-9488 https://issues.apache.org
as you
said. Could you give me some more detailed suggestion?
Thanks
-原始邮件-
发件人: lars hofhansl la...@apache.org
发送时间: 2014年1月8日 星期三
收件人: user@hbase.apache.org user@hbase.apache.org
抄送:
主题: Re: hbase read performance tuning failed
If increasing hbase.client.scanner.caching
...@explorysmedical.com
发送时间: 2014年1月8日 星期三
收件人: user@hbase.apache.org user@hbase.apache.org, lars hofhansl
la...@apache.org
抄送:
主题: Re: hbase read performance tuning failed
In addition to what Lars just said about the blocksize, this is a similar
question to another one that somebody asked
...@apache.org
抄送:
主题: Re: hbase read performance tuning failed
In addition to what Lars just said about the blocksize, this is a similar
question to another one that somebody asked, and it's always good to make
sure that you understand where your data is. As a sanity check, make sure
it's
In addition, I am using c++ to access HBase. Will it make any difference
compared to using Java?
-原始邮件-
发件人: LEI Xiaofeng le...@ihep.ac.cn
发送时间: 2014年1月8日 星期三
收件人: user@hbase.apache.org, doug.m...@explorysmedical.com
抄送:
主题: Re: Re: hbase read performance tuning failed
I
...@ihep.ac.cn
发送时间: 2014年1月8日 星期三
收件人: user@hbase.apache.org, doug.m...@explorysmedical.com
抄送:
主题: Re: Re: hbase read performance tuning failed
I tried to set BLOCKSIZE to 0 when created table to tune the scan
performance, but it did not work. Another thing is what do you mean by
turing HBase
...@apache.org
Sent: Tuesday, January 7, 2014 5:29 PM
Subject: Re: Re: hbase read performance tuning failed
Lars,
I use scannerOpenWithPrefix func to get my scanner and use
scannerGetList(rowResults, scanner,100) func to get rows. I can only get
about 5K records per second. But my exception
Hi,
I am running hbase-0.94.6-cdh4.5.0 and set up a cluster of 5 nodes. The random
read performance is ok, but the scan performance is poor.
I tried to increase hbase.client.scanner.caching to 100 to promote the scan
performance but it made no difference. And when I tried to make smaller blocks
...@gmail.com javascript:;
To: user@hbase.apache.org javascript:;; lars hofhansl
la...@apache.orgjavascript:;
Sent: Saturday, December 21, 2013 3:17 PM
Subject: Re: Performance tuning
There are quite a lot of established and time wait connections between the
RS on port 50010, but i dont know
PM
Subject: Re: Performance tuning
There are quite a lot of established and time wait connections between
the
RS on port 50010, but i dont know a good way of monitoring how much data
is
going through each connection (if that's what you meant)?
On Sun, Dec 22, 2013 at 12:00 AM
Hi
I have been performance tuning HBase 0.94.6 running Phoenix 2.2.0 the last
couple of days and need some help.
Background.
- 23 machine cluster, 32 cores, 4GB heap per RS.
- Table t_24 have 24 online regions (24 salt buckets).
- Table t_96 have 96 online regions (96 salt buckets).
- 10.5
are slow. What are the pings like from a bad RS to another bad RS?
On Sat, Dec 21, 2013 at 7:17 PM, Kristoffer Sjögren sto...@gmail.comwrote:
Hi
I have been performance tuning HBase 0.94.6 running Phoenix 2.2.0 the last
couple of days and need some help.
Background.
- 23 machine cluster, 32
administrator to see why pings to these
machines are slow. What are the pings like from a bad RS to another bad RS?
On Sat, Dec 21, 2013 at 7:17 PM, Kristoffer Sjögren sto...@gmail.com
wrote:
Hi
I have been performance tuning HBase 0.94.6 running Phoenix 2.2.0 the
last
couple of days
administrator to see why pings to
these
machines are slow. What are the pings like from a bad RS to another bad
RS?
On Sat, Dec 21, 2013 at 7:17 PM, Kristoffer Sjögren sto...@gmail.com
wrote:
Hi
I have been performance tuning HBase 0.94.6 running Phoenix 2.2.0 the
last
From: Kristoffer Sjögren sto...@gmail.com
To: user@hbase.apache.org
Sent: Saturday, December 21, 2013 11:17 AM
Subject: Performance tuning
Hi
I have been performance tuning HBase 0.94.6 running Phoenix 2.2.0 the last
couple of days and need some help.
Background.
- 23 machine cluster
To: user@hbase.apache.org
Sent: Saturday, December 21, 2013 11:17 AM
Subject: Performance tuning
Hi
I have been performance tuning HBase 0.94.6 running Phoenix 2.2.0 the last
couple of days and need some help.
Background.
- 23 machine cluster, 32 cores, 4GB heap per RS.
- Table t_24 have 24
you mean an actual network ping, or some operation on top of
HBase?
-- Lars
From: Kristoffer Sjögren sto...@gmail.com
To: user@hbase.apache.org
Sent: Saturday, December 21, 2013 11:17 AM
Subject: Performance tuning
Hi
I have been performance tuning
From: Kristoffer Sjögren sto...@gmail.com
To: user@hbase.apache.org; lars hofhansl la...@apache.org
Sent: Saturday, December 21, 2013 1:28 PM
Subject: Re: Performance tuning
@pradeep scanner caching should not be an issue since data transferred to
the client
, 2013 1:28 PM
Subject: Re: Performance tuning
@pradeep scanner caching should not be an issue since data transferred to
the client is tiny.
@lars Yes, the data might be small for this particular case :-)
I have checked everything I can think of on RS (CPU, network, Hbase
console, uptime etc
:28 PM
Subject: Re: Performance tuning
@pradeep scanner caching should not be an issue since data transferred to
the client is tiny.
@lars Yes, the data might be small for this particular case :-)
I have checked everything I can think of on RS (CPU, network, Hbase
console, uptime etc
Subject: Re: Performance tuning
@pradeep scanner caching should not be an issue since data transferred to
the client is tiny.
@lars Yes, the data might be small for this particular case :-)
I have checked everything I can think of on RS (CPU, network, Hbase
console, uptime etc) and nothing
Subject: Re: Performance tuning
@pradeep scanner caching should not be an issue since data transferred to
the client is tiny.
@lars Yes, the data might be small for this particular case :-)
I have checked everything I can think of on RS (CPU, network, Hbase
console, uptime etc
From: James Taylor [jtay...@salesforce.com]
Sent: Saturday, December 21, 2013 3:30 PM
To: user@hbase.apache.org
Cc: lars hofhansl
Subject: Re: Performance tuning
FYI, scanner caching defaults to 1000 in Phoenix, but as folks have pointed
out, that's not relevant in this case b/c only a single row
on the
regionserver UI pages (or maybe Hannibal tells you?)
-- Lars
From: Kristoffer Sjögren sto...@gmail.com
To: user@hbase.apache.org; lars hofhansl la...@apache.org
Sent: Saturday, December 21, 2013 3:17 PM
Subject: Re: Performance tuning
There are quite a lot
Hi,
Currently it takes 11 odd minutes to load 1.2 million record into hbase from
hdfs. Can u pls share some tips to do the same in few seconds?
We tried doing this in both pig script and in pentaho. Both are taking 11 odd
minutes.
Regards,
Rams
On Mon, Sep 10, 2012 at 9:58 AM, Ramasubramanian
ramasubramanian.naraya...@gmail.com wrote:
Hi,
Currently it takes 11 odd minutes to load 1.2 million record into hbase from
hdfs. Can u pls share some tips to do the same in few seconds?
We tried doing this in both pig script and in pentaho.
Hi,
Will be helpful if u say specific things to look into. Pls help
Regards,
Rams
On 10-Sep-2012, at 10:40 PM, Stack st...@duboce.net wrote:
On Mon, Sep 10, 2012 at 9:58 AM, Ramasubramanian
ramasubramanian.naraya...@gmail.com wrote:
Hi,
Currently it takes 11 odd minutes to load 1.2
Well,
Lets actually skip a few rounds of questions... and start from the beginning.
What does your physical cluster look like?
On Sep 10, 2012, at 12:40 PM, Ramasubramanian
ramasubramanian.naraya...@gmail.com wrote:
Hi,
Will be helpful if u say specific things to look into. Pls help
32 matches
Mail list logo
