d recommend going to something like Redis.
On Mon, Jun 3, 2013 at 12:13 PM, ramkrishna vasudevan <
ramkrishna.s.vasude...@gmail.com> wrote:
> What is that you are observing now?
>
> Regards
> Ram
>
>
> On Mon, Jun 3, 2013 at 2:00 PM, Liu, Raymond
> wrote:
>
> > H
Hi
If all the data is already in RS blockcache.
Then what's the typical scan latency for scan a few rows from a say
several GB table ( with dozens of regions ) on a small cluster with say 4 RS ?
A few ms? Tens of ms? Or more?
Best Regards,
Raymond Liu
How about this one : https://issues.apache.org/jira/browse/HBASE-8542
Best Regards,
Raymond Liu
> -Original Message-
> From: Lior Schachter [mailto:lior...@gmail.com]
> Sent: Thursday, May 16, 2013 1:18 AM
> To: user
> Subject: Re: checkAnd...
>
> yes, I believe this will cover most of
representing graphs at large scale better. I'm saying this
> since you have one ID referencing another ID (using target ID).
>
>
>
> On May 10, 2013, at 11:47 AM, "Liu, Raymond"
> wrote:
>
> > Thanks, seems there are no other better solution?
> >
Thanks, seems there are no other better solution?
Really need a "GetAndPut" atomic op here ...
>
> You can do this by looping over a checkAndPut operation until it succeeds.
>
> -Mike
>
> On Thu, May 9, 2013 at 8:52 PM, Liu, Raymond
> wrote:
>
Any suggestion?
>
> Hi
>
> Say, I have four field for one record :id, status, targetid, and count.
> Status is on and off, target could reference other id, and count will
> record
> the number of "on" status for all targetid from same id.
>
> The record could be add / delete,
> Btw. Is that possible or practice to implement something like PutAndGet
> which put in new row and return the old row back to client been implemented?
> That would help a lot for my case.
Oh, I realized that it is better to be named as GetAndMutate, say Mutate
anyway, but return the origi
Hi
Say, I have four field for one record :id, status, targetid, and count.
Status is on and off, target could reference other id, and count will
record the number of "on" status for all targetid from same id.
The record could be add / delete, or updated to change the stat
So what is lacking here? The action should also been parallel inside RS for
each region, Instead of just parallel on RS level?
Seems this will be rather difficult to implement, and for Get, might not be
worthy?
>
> I looked
> at src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.ja
I guess rob mean that use one query to query rcfile and HBASE table at the same
time.
If your query is on two table, one upon rcfile, another upon HBASE through
hbase storage handler, I think that should be ok.
Best Regards,
Raymond Liu
>
> what's mean a composite query? Hive's query doesn't d
me that it will end up in a
single store file per region.
Best Regards,
Raymond Liu
>
> Raymond:
>
> Major compaction does not first flush. Should it or should it be an option?
>
> St.Ack
>
>
> On Tue, Mar 12, 2013 at 6:46 PM, Liu, Raymond
> wrote:
>
>
fore a memstore is flushed? Then a user invoked compact
don't force to flush it?
Best Regards,
Raymond Liu
>
> Did you try from java api? If flush does not happen we may need to fix it.
>
> Regards
> RAm
>
> On Tue, Mar 12, 2013 at 1:04 PM, Liu, Raymond
> wrote
It seems to me that a major_compact table command from hbase shell do not fush
memstore? When I done with major compact, still some data in memstore and will
be flush out to disk when I shut down hbase cluster.
Best Regards,
Raymond Liu
n column (qualifier)
> is present in an HFile or not. But for the user he dont know the rowkeys. He
> wants all the rows with column 'x'
>
> -Anoop-
>
> ____________
> From: Liu, Raymond [raymond@intel.com]
> Sent: Monday, March 11
Just curious, won't ROWCOL bloom filter works for this case?
Best Regards,
Raymond Liu
>
> As per the above said, you will need a full table scan on that CF.
> As Ted said, consider having a look at your schema design.
>
> -Anoop-
>
>
> On Sun, Mar 10, 2013 at 8:10 PM, Ted Yu wrote:
>
> > b
t; >
> > >
> > > Yes, Raymond.
> > > You should lower sloppiness.
> > >
> > > On Tue, Feb 19, 2013 at 7:48 PM, Liu, Raymond
> > >
> > > wrote:
> > >
> > > > I mean region number is small.
> > > >
>
> >
> > This means that I need to limit the slop to 0.02 etc? so that the
> > balancer actually run on this table?
> >
> > Best Regards,
> > Raymond Liu
> >
> > From: Marcos Ortiz [mailto:mlor...@uci.cu]
> > Sent: Wednesday, February 20, 2013
dBalancer.java
>
> Meaning, region count on any server can be as far as 20% from average region
> count.
>
> You can tighten sloppiness.
>
> On Tue, Feb 19, 2013 at 7:40 PM, Liu, Raymond
> wrote:
>
> > Hi
> >
> > I do call balancer, while it seems
un on this table?
Best Regards,
Raymond Liu
From: Marcos Ortiz [mailto:mlor...@uci.cu]
Sent: Wednesday, February 20, 2013 11:44 AM
To: user@hbase.apache.org
Cc: Liu, Raymond
Subject: Re: Is there any way to balance one table?
What is the size of your table?
On 02/19/2013 10:40 PM, Liu, Raymond wrot
AM
> To: user@hbase.apache.org
> Subject: Re: Is there any way to balance one table?
>
> Hi Liu,
>
> Why did not you simply called the balancer? If other tables are already
> balanced, it should not touch them and will only balance the table which is
> not
> balancer?
>
> From: Ted Yu [mailto:yuzhih...@gmail.com]
> > Sent: Wednesday, February 20, 2013 9:09 AM
> > To: user@hbase.apache.org
> > Subject: Re: Is there any way to balance one table?
> >
> > What version of HBase are you using ?
> >
> > 0.94 has per-table load bal
gt; Subject: Re: Is there any way to balance one table?
>
> What version of HBase are you using ?
>
> 0.94 has per-table load balancing.
>
> Cheers
>
> On Tue, Feb 19, 2013 at 5:01 PM, Liu, Raymond
> wrote:
>
> > Hi
> >
> > Is there any way to bala
Hi
Is there any way to balance just one table? I found one of my table is not
balanced, while all the other table is balanced. So I want to fix this table.
Best Regards,
Raymond Liu
Hi
I have hadoop 1.1.1 and hbase 0.94.1. Around 300 region on each region
server. Right after the cluster is started, before I do anything. There are
already around 500 (CLOSE_WAIT) connection from regionserver process to
Datanode process. Is that normal?
Seems there are a lot
> link<http://blog.cloudera.com/blog/2012/03/hbase-hadoop-xceivers/>helpful.
> It explains the problem
> and solution in great detail.
>
> Warm Regards,
> Tariq
> https://mtariq.jux.com/
> cloudfront.blogspot.com
>
>
> On Thu, Jan 17, 2013 at 12:14 PM, Liu,
Hi
I have a table with about 24 region on the one regionserver, and each
region have about 20 block files on hdfs.
The xceiverCount is set to 1024, I have thought that this is quite
enough since at most 480 blocks will be opened.
While when I do a MR job to scan the table
behind region, which lead to lag behind map task and on this region server.
>
> This is the best guess I have gain up to now. But not knowing why this issue
> come out suddenly on my cluster, or why I don't observe it before...
>
>
> >
> > Hi there,
> &g
efore...
>
> Hi there,
>
> The HBase RefGuide has a comprehensive case study on such a case. This
> might not be the exact problem, but the diagnostic approach should help.
>
> http://hbase.apache.org/book.html#casestudies.slownode
>
>
>
>
>
> On
uster, then, it suddenly go wrong...
>
> Cheers
>
> On Fri, Jan 4, 2013 at 8:08 PM, Liu, Raymond wrote:
>
> > Hi Ted
> >
> > Thanks for your reply
> >
> > >
> > > Did you use TableInputFormat in your MR job ?
> > No, a custom one w
s done on every node. And I change
it back later. Hmm...
>
> Cheers
>
> On Fri, Jan 4, 2013 at 7:37 PM, Liu, Raymond wrote:
>
> > Hi
> >
> > I encounter a weird lag behind map task issue here :
> >
> > I have a small hadoop/hbase cluster with 1 mast
Hi
I encounter a weird lag behind map task issue here :
I have a small hadoop/hbase cluster with 1 master node and 4 regionserver node
all have 16 CPU with map and reduce slot set to 24.
A few table is created with regions distributed on each region node evenly (
say 16 region for each region
Hi
I am just curious about the region assignment strategy upon table
re-enabling.
By default, it's random assigned to the region server. I checked jira
and found HBASE-6143 suggest to make it smarter like take load balancing into
account.
While, I am wondering what prev
32 matches
Mail list logo
