Status update:
- We moved to cdh 4b1, so hbase 0.92 and hdfs 0.23(until now we were
using 0.20.2 series)
- Did the tests now with 256/512 regions, the numbers do appear to
scale which is good.
BUT, our write throughput has gone in the dump. If we disable wal
writes, we still get nearly 40,000 a
Also, the latency on requests is extremely long. If we group them into
sets of 10 puts(128-256 bytes each) before flushing the client table,
latency is over 1 second.
We get entries like this in our logs:
22:17:51,010 WARN org.apache.hadoop.ipc.HBaseServer:
(responseTooSlow):
am trying to set up a hbase cluster
which is running on top of a hadopp cluster.
Both clusters are up and running but
when i try to create a table in Hbase
client..am seeing the following error in the logs!!
compute-0-11 : is the name node for the hadoop cluster.
2012-03-18 01:18:54,696
Have you followed http://hbase.apache.org/book.html#hadoop to the
word, even on your client installations? What you may be running into
is a simple mismatch of hadoop versions in your client and server
installations.
On Fri, Mar 23, 2012 at 1:48 PM, kamal-hbase-haddop-new
kamalnath...@gmail.com
Hello,
I have been experimenting some problems with the fully distributed version.
First of all I'll tell you my configuration:
I have 4 servers(server_{1,2,3,4}) with 6GB Ram and 2 cores. I installed
hadoop in all of them, this is the configuration:
- server_1 is namenode, datanode and
Your logs still point to a permissions issue on /hbase, so I would start at
resolving that first thing..
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:1602)
*Caused by:
1) your configuration is sub optimal so toss performance out the window. You
appear to be on vms. Toss performance out the window.
2) sounds like you are picking up the default value and not your cluster's
config.
Sent from a remote device. Please excuse any typos...
Mike Segel
On Mar 23,
Peter, that doesnt make sense.
I mean I believe you in what you are saying, but don't see how a VPN in would
cause this variance in results.
Do you have any speculative execution turned on?
Are you counting just the numbers of rows in the result set, or are you using
counters in the map
Thanks for your quick repy. I am quite new in this field so:
1) I don't understand quite well what you mean, do you mean that is not
optimal the configuration? I have also this in hbase:
!-- perfomance tunning --
property
namehbase.client.scanner.caching/name
Hi Michel,
I agree it doesn't make sense, but then I believe we are tracking a bug.
I don't know about speculative execution, but I certainly did not switch
it on.
I am just counting the number of rows that come back in the Result.
If you are interested in this, try my Unit test. I'd be
Speculative execution is on by default.
http://hbase.apache.org/book.html#mapreduce.specex
On 3/23/12 8:04 AM, Peter Wolf opus...@gmail.com wrote:
Hi Michel,
I agree it doesn't make sense, but then I believe we are tracking a bug.
I don't know about speculative execution, but I certainly
Sorry... Distracted by trying to do a 0.94rc.
VPN... Hmm... Do you see any packet fragmentation/truncation?
-- Lars
- Original Message -
From: Peter Wolf opus...@gmail.com
To: user@hbase.apache.org; lars.geo...@gmail.com; lars hofhansl
lhofha...@yahoo.com
Cc:
Sent: Thursday, March
Have you ensured your HBase RegionServers are all up, and reporting on
the HBase Master Web UI (MasterHost:60010)?
On Sat, Mar 24, 2012 at 12:02 AM, balachandra maddina
chandu2...@gmail.com wrote:
HI There,
Im experimenting with 'hbase' and going through wiki document, part of
the document
Hi Harsh,
Thank you for the reply. when i checked the page im seeing following
details for regionservers
Region Servers
Dead Region Servers
ServerName
localhost,42063,1332493190942
Total: servers: 1
Regions in Transition
No regions in transition.
Does this indicate that there is a problem
On Fri, Mar 23, 2012 at 12:22 PM, balachandra maddina
chandu2...@gmail.com wrote:
Hi Harsh,
Thank you for the reply. when i checked the page im seeing following
details for regionservers
That looks right.
Creating a table, it just hangs? It never timesout? What do the logs
for the master
Yes im following the same document '
http://hbase.apache.org/book/quickstart.html'. i see following errors in
the log. im copying parts of the log file here
txntype:-1 reqpath:n/a Error Path:/hbase/root-region-server
Error:KeeperErrorCode = NoNode for /hbase/root-region-server
Hi ,
I my case hbase table has only row key.
The way I add a record to hbase is:
.
Put put = new Put(keyBytes);
put.add(Bytes.toBytes(familyName) , HConstants.EMPTY_BYTE_ARRAY ,
HConstants.EMPTY_BYTE_ARRAY);
..
My questions is about internal implementation
No problem. Still trying to get a handle on when it happens.
There is no error, and the results seem valid. There are just not
enough of them. Would packet fragmentation/truncation cause errors or
corruption?
P
On 3/23/12 2:49 PM, lars hofhansl wrote:
Sorry... Distracted by trying to
1) As I understand column family internally represents a file , but in my
case I enter nothing to the column family ( actually I enter empty
qualifier:value pairs).
I can't find any details about how rowkeys is stores. Any information
about storing rowkeys will be very helpful.
Right now
19 matches
Mail list logo
