But, if your counters are on the row keys, then just send one Increment
objects, and have the hourly, daily columns in there, as well the general
counter columns. Way easier than doing it by a region observer.
On 6 בדצמ 2012, at 15:42, Amit Sela am...@infolinks.com wrote:
Got it, so if my
Emm, have you tried to tune your GC deeply? please provide the exactly VM
options and jdk version and GC logs..
In our test cluster this week, i managed to reduce the longest STW from 22+
seconds(Xmx20G) to 1.1s(Xmx48G) under a very heavy YCSB stress
long-term-testing.
Also it would be better
Hi,
In the HBase doc it's explained how we can change the balancer period
http://hbase.apache.org/book/config.files.html), but I'm not able to
find how to configure the balancer class.
The balancer used is DefaultLoadBalancer which extends
BaseLoadBalancer which implements LoadBalancer. I guess
You need to implement your own class, and plug it in via the configuration
key hbase.master.loadbalancer.class in the master's configuration.
On Fri, Dec 7, 2012 at 6:04 PM, Jean-Marc Spaggiari jean-m...@spaggiari.org
wrote:
Hi,
In the HBase doc it's explained how we can change the balancer
Hi,
1. Too bad that you can't change the hostname to be an actual meaningful
one. I would not consider a node in the network a proper one if it does not
define a usable default hostname.
2. Virtual NIF name support (iface:sub-iface format) is available in Hadoop
2.x based releases. Perhaps that
Thanks for your prompt reply.
I have submited a documentation update to add this in
http://hbase.apache.org/book/config.files.html .
JM
2012/12/7, Harsh J ha...@cloudera.com:
You need to implement your own class, and plug it in via the configuration
key hbase.master.loadbalancer.class in the
Hi, Yun
Code in HConnectionManager.java, method: submit(ListActionR actionList,
...).
It will combine all actions towards the same rs, and send them together...
- Dong
在 2012-12-7，上午2:34， yun peng 写道：
Hi, I have question on how the multiple Puts() are executed when they are
issued against
Hi,
I am trying to connect to hbase-0.94.1, through a java war (soup ui) but
it is not connected to hbase and through error as below.
As for reference i have added all the required jar to war for the new
version of the hadoop as well as hbase.
WARN client.HConnectionManager: Error
Yi,
Thanks for your reply.
following is the link for regionserver 'dn004' log :http://pastebin.com/224CKwsu
I can't find anything useful.
Thanks,
Jing Wang
At 2012-12-07 13:16:14,Yi Liang white...@gmail.com wrote:
Jing,
I think you could follow this kind of log to check rs log to find why
I was reading up on HBase Replication and wanted to make sure I'm not
missing something.
Given that replication happens asynchronously the replication strategy has
an eventually consistent policy.
I was considering using this feature for Production / Disaster Recovery
setup.
Is there a way to
Juan,
No; that would mean every single write to HBase has to wait for an ACK from a
remote data center, which would decrease your cluster throughput dramatically.
If you need that, consider other database solutions.
Ian
On Dec 7, 2012, at 12:14 PM, Juan P. wrote:
I was reading up on HBase
That regionserver is stopping? If not, you may need to restart it.
2012-12-07 13:18:53,947 DEBUG
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler:
Processing open of -ROOT-,,0.70236052
2012-12-07 13:18:53,947 INFO
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler:
Strongly consistent reads/writes: HBase is not an eventually consistent
DataStore. This makes it very suitable for tasks such as high-speed counter
aggregation
http://hbase.apache.org/book/architecture.html
Am I missing something ?
- Sri
From: Ian Varley
Yes, I think so. A single HBase cluster can't (or, at least, really shouldn't)
span multiple data centers; the strong consistency you refer to is only
available within a cluster.
But the replication you were referring to in your initial email is cross-data
center, between two or more
What failure condition are you trying to safeguard against? A full
data center failure? That's when you would lose your entire cluster
and need the DR to kick in. Otherwise, you could deploy such that an
entire rack failure or even a row failure won't take you down. Just
span across multiple racks
Thanks Ian. I DID miss the point. The person who started the chain is a
different person :)
- Sri
From: Ian Varley ivar...@salesforce.com
To: user@hbase.apache.org user@hbase.apache.org
Sent: Saturday, 8 December 2012, 1:21
Subject: Re: PROD/DR - Replication
Ha - that's what I get for trying to answer list emails from my phone. :)
Ian
On Dec 7, 2012, at 1:58 PM, sriraam h wrote:
Thanks Ian. I DID miss the point. The person who started the chain is a
different person :)
- Sri
From: Ian Varley
Hi Harsh,
Thanks a lot for your reply, it's enlightening.
For #2, I double checked and found the patches(HADOOP-8154 and HADOOP-7806)
are also in branch-1, only that it exists in hadoop release later
than(including) 1.1.0, but we're using hadoop-1.0.4 here.
On 7 December 2012 21:12, Harsh J
Hi Harsh,
Thanks a lot for your reply, it's . For #2, I double checked and found the
patches(HADOOP-8154 and HADOOP-7806) are also in branch-1, only that it
exists in hadoop release later than(including) 1.1.0, we're using
hadoop-1.0.4 here, so it's not included.
On 7 December 2012 21:12, Harsh
We have a couple tables that had thousands of regions due to the size of
the day in them. We recently changed them to have larger regions (nearly
4GB). We are trying to bulk load these in now, but every time we do our
servers die with OOM.
The logs seem to show that there is always a major
On 12/07/2012 04:01 PM, Bryan Beaudreault wrote:
We have a couple tables that had thousands of regions due to the size of
the day in them. We recently changed them to have larger regions (nearly
4GB). We are trying to bulk load these in now, but every time we do our
servers die with OOM.
On Fri, Dec 7, 2012 at 1:01 PM, Bryan Beaudreault
bbeaudrea...@hubspot.comwrote:
We have a couple tables that had thousands of regions due to the size of
the day in them. We recently changed them to have larger regions (nearly
4GB). We are trying to bulk load these in now, but every time we
Agree with what Ian says below except I'd say with work it's possible to do
cross DC quorum writes in a layer on top of HBase that persists into
HBase, like
when Google built Megastore on BigTable. At this year's VLDB if I recall
correctly there was a megastore-like system with an interesting
Hi,
Here is the situation.
I have an heterogeneous cluster with 2 cores CPUs, 4 cores CPUs and 8
cores CPUs servers. The performances of those different servers allow
them to handle different size of load. So far, I built a LoadBalancer
which balance the regions over those servers based on the
24 matches
Mail list logo
