RE: issue about search speed and rowkey

2013-08-07 Thread Lu, Wei
decrease cache size (say, 1000) and increase batch or just set it as default if #qualifiers in a row is not too many. -Original Message- From: ch huang [mailto:justlo...@gmail.com] Sent: Wednesday, August 07, 2013 5:18 PM To: user@hbase.apache.org Subject: issue about search speed and

RE: ‘split’ start/stop key range of large table regions for more map tasks

2013-03-25 Thread Lu, Wei
ble is 1TB size, and you > have 10 RS and want 12 regions per server, you can setup this to > 1TB/(10x12) and you will get at least all those regions (and even a > bit more). > > JM > > 2013/3/25 Lu, Wei : >> We are facing big region size but small region number of a tab

‘split’ start/stop key range of large table regions for more map tasks

2013-03-25 Thread Lu, Wei
We are facing big region size but small region number of a table. 10 region servers, each has only one region with size over 10G, map slot of each task tracker is 12. We are planning to ‘split’ start/stop key range of large table regions for more map tasks, so that we can better make usage of m

RE: region server down when scanning using mapreduce

2013-03-12 Thread Lu, Wei
some background of block cache. On Tue, Mar 12, 2013 at 1:31 PM, Lu, Wei wrote: > No, does block cache matter? Btw, the mr dump is a mr program we > implemented rather than the hbase tool. > > Thanks > > -Original Message- > From: Azuryy Yu [mailto:azury...@gmail

RE: region server down when scanning using mapreduce

2013-03-11 Thread Lu, Wei
using mapreduce did you closed block cache when you used mr dump? On Mar 12, 2013 1:06 PM, "Lu, Wei" wrote: > Hi, > > When we use mapreduce to dump data from a pretty large table on hbase. One > region server crash and then another. Mapreduce is deployed together with >

region server down when scanning using mapreduce

2013-03-11 Thread Lu, Wei
Hi, When we use mapreduce to dump data from a pretty large table on hbase. One region server crash and then another. Mapreduce is deployed together with hbase. 1) From log of the region server, there are both "next" and "multi" operations on going. Is it because there is write/read conflict th

[resend] region server of -ROOT- table is dead, but not reassigned

2013-02-19 Thread Lu, Wei
Hi, all, When I scan any table, I got: 13/02/20 05:16:45 INFO ipc.HBaseRPC: Server at Rs1/10.20.118.3:60020 could not be reached after 1 tries, giving up. ... ERROR: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=7, exceptions: ... What I observe: 1

RE: region server of -ROOT- table is dead, but not reassigned

2013-02-19 Thread Lu, Wei
By the way, the hbase version I am using is 0.92.1-cdh4.0.1 From: Lu, Wei Sent: Wednesday, February 20, 2013 1:28 PM To: user@hbase.apache.org Subject: region server of -ROOT- table is dead, but not reassigned Hi, all, When I scan any table, I got: 13/02/20 05:16:45 INFO ipc.HBaseRPC: Server

region server of -ROOT- table is dead, but not reassigned

2013-02-19 Thread Lu, Wei
Hi, all, When I scan any table, I got: 13/02/20 05:16:45 INFO ipc.HBaseRPC: Server at Rs1/10.20.118.3:60020 could not be reached after 1 tries, giving up. ... ERROR: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=7, exceptions: ... What I observe: 1) -ROO

0.92 client fail to log in when using JNI

2012-09-13 Thread Lu, Wei
Hi, When I use C++ to call 0.92 HBase java APIs, it failed to log in. I tried similar operation by directly using Java Api, and they succeed. So, is there any difference between using java api through JNI with directly calling the same java api?? Can anyone help me out? Thank you very much. He

RE: number of region servers is wrong

2012-02-23 Thread Lu, Wei
. also look at your zookeeper logs to see whats going on.. i tried bunch of things, so not sure what worked. but what i did was increase zookeeper connections and timeout limits and that did the trick IIRC. thanks On Wed, Feb 22, 2012 at 10:55 PM, Lu, Wei wrote: > Hi, > > I met wit

number of region servers is wrong

2012-02-23 Thread Lu, Wei
Hi, I met with a weird problem when using HBase. There are 3 machines: 1 master and 2 region servers (wlu-rs1/10.27.17.251 and wlu-rs2/10.27.16.11). But when I use "status 'detailed'" to see region servers' status, it show there are three server, and one server appears twice (exactly same). 3 l

number of region servers is wrong

2012-02-22 Thread Lu, Wei
Hi, I met with a weird problem when using HBase. There are 3 machines: 1 master and 2 region servers (wlu-rs1/10.27.17.251 and wlu-rs2/10.27.16.11). But when I use "status 'detailed'" to see region servers' status, it show there are three server, and one server appears twice (exactly same). 3 l