How client initiate create new table.
For existing table it will communicate to zookeeper and get -ROOT-/.META.
table Region server location. And then get region server location for user
table. and so on...
But in case of create new table. How it happen.
Not only create table but for all DDL
Hi,
We are seeing that our cluster has become imbalanced and we've noticed that
there are some servers with disk utilization of ~90% and the others are at
~40%.
We would like to run the DFS balancer but after some initial search I came
across suggestions to not run DFS balancer on HBase cluster.
Hi Divye,
the DFS balancer is that last thing you want to run in your HBase
cluster.That will break all the data locallity for the compacted regions.
On compaction, a region write the files on the local server first, then the
2 other replicates are going on different datanodes. so on read, HBase
Thanks Jean, but why does only a couple of RS get loaded with data? We are
seeing out of 5 only 2 datanodes have around 90% of disk usage. Where as
the rest are at around 40%.
We have run the hbase balancer, and on an average we have around 500
regions per regionserver and a total of 5 RS's. We
Hello,
i have an application which does a lot of sequential reads. I also save more
data, meaning the reads always have to be done in bigger amount of data in
storage (writes and reads don't happen parallel).
To see how the hbase installation reacts to my needs, I evaluated the reads
and
Thanks Bharath, I had a look at the jira and the fix version is 0.94.0. I
am using 0.94.2, I assume this should already be a part of Hbase. Is the
assumption correct? If no do I have to make these changes in hbase-site.xml?
Note: We have not run major_compaction for any of the tables so far. Will
Also try running balancer from hbase shell. See if that works.
Thanks
Upender
On Tue, Mar 4, 2014 at 2:24 AM, divye sheth divs.sh...@gmail.com wrote:
Could you paste the region server logs along with the master logs as well.
Thanks
Divye Sheth
On Tue, Mar 4, 2014 at 11:56 AM, Vimal Jain
New regionserver will be assigned regions moved out from other regionserver by
balance, and there are some reasons why balance doesn't happen immediately
after the regionserver is added to cluster:
1. balance isn't enabled
2. balance interval not elapses (balance is triggered once every 5
1) You might want to add the time limits in your command like in the link I
sent. End time will be time when you have started the replication.
2) I think it is. Did not tried. You can look at your job trackers to see.
2014-03-04 0:03 GMT-05:00 Vimal Jain vkj...@gmail.com:
Hi Jean,
Lets say
Hi All,
If i create a maven project with the following maven dependency then the
HBase jar doesn't have org.apache.hadoop.hbase.ipc.SecureRpcEngine class.
dependency
groupIdorg.apache.hbase/groupId
artifactIdhbase/artifactId
version0.94.12/version
/dependency
SecureRPCEngine class
Secure HBase 0.94 is not published in maven repo.
On Tue, Mar 4, 2014 at 10:02 AM, anil gupta anilgupt...@gmail.com wrote:
Hi All,
If i create a maven project with the following maven dependency then the
HBase jar doesn't have org.apache.hadoop.hbase.ipc.SecureRpcEngine class.
dependency
For HBase 0.94, you need a version of HBase built with the security
profile to get SecureRpcEngine and other security classes. I'm not sure
that the published releases on maven central actually include this.
However, it's easily to build yourself, just add -Psecurity to the mvn
command line to
Thanks for the reply.
Since the HBase security jar is not published in Maven repo. I am running
into Problem with enhancing the jdbc connection of Phoenix(
https://issues.apache.org/jira/browse/PHOENIX-19) to support connecting to
a secure HBase cluster.
Is there any particular reason due to
I have two tables in HBase, say *table1* and *index_table*. Each row in
*table1* has around 5 columns. I need to get records based on the value of
any of these columns. So I created a secondary index table, *index_table* where
the row key will be *columnName+value* and column values will be the
HBase supports natural versioning for free. It is cell's timestamp
Your cell address in HBase tables the following:
rowkey:column-family:column-qualifier:timestamp
First on table, column family, column qualifier concept:
Table is similar to RDBMS table, but does not have rigid schema. When you
Let's just target your patch for the Phoenix 4.0 release so we can rely on
Maven having what we need.
Thanks,
James
On Tue, Mar 4, 2014 at 11:29 AM, anil gupta anilgupt...@gmail.com wrote:
Phoenix refers to maven artifact of HBase. If its not in Maven repo of
HBase then either we add the
To understand table creation process, digging into code base would help.
You can start with this method in HBaseAdmin:
public void createTable(HTableDescriptor desc)
And this method in the HMaster:
public void createTable(HTableDescriptor hTableDescriptor,
byte [][] splitKeys)
which
Looks like it's on by default.
From: Bharath Vissapragada bhara...@cloudera.com
To: user@hbase.apache.org
Sent: Tuesday, March 4, 2014 6:22 AM
Subject: Re: DFS Balancer with Hbase
Yes, its included in 0.94.2. Include this property in master's
hbase-site.xml
Might be better to push the secure build to maven. No disadvantage in doing so.
Not sure if there's any maven blackmagic missing/needed.
-- Lars
From: anil gupta anilgupt...@gmail.com
To: user@hbase.apache.org user@hbase.apache.org
Cc: James Taylor
*i can not see any problem about these config option*
*zookeeper.session.timeout is default value 3min*
tickTime=2000
maxClientCnxns=500
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks,
+1 for pushing the secure build to maven.
We run on HBase0.94 and for at least 1 year we are not going to upgrade our
system to HBase0.96.
On Tue, Mar 4, 2014 at 4:33 PM, lars hofhansl la...@apache.org wrote:
Might be better to push the secure build to maven. No disadvantage in
doing so.
On Wed, Mar 5, 2014 at 8:33 AM, lars hofhansl la...@apache.org wrote:
Might be better to push the secure build to maven. No disadvantage in
doing so. Not sure if there's any maven blackmagic missing/needed.
Yes, the necessary Maven black magic for differentiating security artifacts
is
zookeeper.session.timeout not set ,so it min value is 4s and max value is
40s
tickTime=2000
maxClientCnxns=500
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending
Thanks for correcting me Lars. Yes its enabled by default in 0.94.2 but
disabled in trunk after HBASE-6849.
Divye, you can still check the block locality index and do a major
compaction and see how it goes.
On Wed, Mar 5, 2014 at 6:02 AM, lars hofhansl la...@apache.org wrote:
Looks like it's
Hmaster getting aborted after starting ./start-hbase.sh in hbase-0.96.0
with hadoop 2.2.0.
Tried with hbase-0.94.16 and hbase-0.98 but same result. Hmaster aborts as
soon as it starts. Even tried with replacing jars in hbase lib manually as
well as using maven but the issue is unresolved. Is
Did you run the upgrade script ?
See:
http://hbase.apache.org/book.html#upgrade0.96
On Tue, Mar 4, 2014 at 6:47 PM, Richard Chen cxd3...@gmail.com wrote:
Hmaster getting aborted after starting ./start-hbase.sh in hbase-0.96.0
with hadoop 2.2.0.
Tried with hbase-0.94.16 and hbase-0.98 but
You can try to refering the following link
https://issues.apache.org/jira/browse/HBASE-9278
https://issues.apache.org/jira/browse/HBASE-9497
2014-03-05 10:47 GMT+08:00 Richard Chen cxd3...@gmail.com:
Hmaster getting aborted after starting ./start-hbase.sh in hbase-0.96.0
with hadoop 2.2.0.
hi all,
when I run ./bin/hbase shell. it's ok. but when I execute 'list', it hangs.
I have tested it with telnet zookeeper 2181 and it's ok.
but I use netstat -lnp can't find any outgoing tcp connections.
I use jstack to check the status:
main prio=10 tid=0x7ff648009800
What version of HBase are you using ?
Take a look at http://hbase.apache.org/book.html#trouble.tools.builtin.zkcli
On Tue, Mar 4, 2014 at 9:23 PM, Li Li fancye...@gmail.com wrote:
hi all,
when I run ./bin/hbase shell. it's ok. but when I execute 'list', it
hangs.
I have tested it
Please check your hmaster logs and hmaster servic3
On 5 Mar 2014 10:54, Li Li fancye...@gmail.com wrote:
hi all,
when I run ./bin/hbase shell. it's ok. but when I execute 'list', it
hangs.
I have tested it with telnet zookeeper 2181 and it's ok.
but I use netstat -lnp can't find
That's a surprising change in behavior.
It seems like it was intentional in HBASE-6849, but it will catch folks by
surprise.
-- Lars
From: Bharath Vissapragada bhara...@cloudera.com
To: user@hbase.apache.org; lars hofhansl la...@apache.org
Sent: Tuesday,
after long time, it throws exception
HBase Shell; enter 'helpRETURN' for list of supported commands.
Type exitRETURN to leave the HBase Shell
Version 0.94.11, r1513697, Wed Aug 14 04:54:46 UTC 2013
hbase(main):001:0 list
TABLE
14/03/05 15:10:38 ERROR zookeeper.ZooKeeperWatcher: ZK is null on
0.94.11
On Wed, Mar 5, 2014 at 1:45 PM, Ted Yu yuzhih...@gmail.com wrote:
What version of HBase are you using ?
Take a look at http://hbase.apache.org/book.html#trouble.tools.builtin.zkcli
On Tue, Mar 4, 2014 at 9:23 PM, Li Li fancye...@gmail.com wrote:
hi all,
when I run ./bin/hbase
Hello Rodionov,
For your use case, there are two possible approaches:
1. rowkey = messageID and Version is in a timestamp (you can put any value
instead of a time or keep default timestamp)
Seems very interesting approach. Analogy of timestamp to version makes
sense.
So I can use,
34 matches
Mail list logo
