Re: HBase acl commands are too slow

2016-06-17 Thread kumar r
Hi, I don't think the problem from zookeeper quorum. Create, scan and list commands are working without delay. It won't take more than 5 seconds. But when executing acl commands getting slow response. I have noticed in log as *auth: SIMPLE *but actually it should be *KERBEROS *authentication.

Re: Scan.setMaxResultSize and Result.isPartial

2016-06-17 Thread Enis Söztutar
You should probably read https://blogs.apache.org/hbase/entry/scan_improvements_in_hbase_1 first. In HBase-1.1 and later code bases, you can call Scan.allowPartialResults() to instruct the ClientScanner to give you partial results. In this case, you can use Result.isPartial() to stitch together

Scan.setMaxResultSize and Result.isPartial

2016-06-17 Thread Bryan Beaudreault
Hello, We are running 1.2.0-cdh5.7.0 on our server side, and 1.0.0-cdh5.4.5 on the client side. We're in the process of upgrading the client, but aren't there yet. I'm trying to figure out the relationship of Result.isPartial and the user, when setMaxResultSize is used. I've done a little

Re: what causes "Memst oreFlusherChore requesting flush" messages?

2016-06-17 Thread Ted
so what you're saying is that everyone will see at least 1 of those lines roughly every hour no matter what, and under higher load you'll see it when ever limits are hit for either WAL or Memstore causing flushes. So by the sounds of it, it's perfectly normal to be seeing a slew of those in the

Re: what causes "Memst oreFlusherChore requesting flush" messages?

2016-06-17 Thread Vladimir Rodionov
This is done to prevent runaway WAL files. WAL file can't be deleted if some unflushed edits from this file exist in RS memstore. In case of a high load this may lead to accumulation of a large number of WAL files in a file system. -Vlad On Fri, Jun 17, 2016 at 12:49 PM, Vladimir Rodionov

Re: what causes "Memst oreFlusherChore requesting flush" messages?

2016-06-17 Thread Vladimir Rodionov
>> has an old edit Yes, this is what PeriodicMemstoreFlusher does: it checks if there are edits older than (1h, but configurable) in memstore and flushes this memstore if find old edits. -Vlad On Fri, Jun 17, 2016 at 11:49 AM, Ted wrote: > Wondering if anyone knows the

Re: HBase acl commands are too slow

2016-06-17 Thread Ted Yu
I have gone through the log but haven't identified the cause. Can you outline the time range for the 30 second response so that I can correlate with the log ? Is communication with zookeeper quorum working without noticeable delay ? Thanks On Fri, Jun 17, 2016 at 3:47 AM, kumar r

what causes "Memst oreFlusherChore requesting flush" messages?

2016-06-17 Thread Ted
Wondering if anyone knows the cause of messages like : "MemstoreFlusherChore requesting flush of ,,1465289533949.94286e3c616b8b4635c9f0665e424a05. because has an old edit so flush to free WALs after random delay 265357ms" My log files seem to be filled with them, I think they account for over

Re: `hbase classpath` command causes “File name too long” error

2016-06-17 Thread Brian Jeltema
It’s the first ‘$’ that’s killing you. it should be` export HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath` > On Jun 17, 2016, at 6:41 AM, Mahesha999 wrote: > > I am trying out HBase bulk loading. The command looks like this: > >

Re: HBase acl commands are too slow

2016-06-17 Thread kumar r
Hi, Please find the log, http://pastebin.com/Bc3ywAQQ *hbase(main):007:0> grant 'Selva','RWXCA','@default'0 row(s) in 21.4610 secondshbase(main):008:0> revoke 'Selva','@default'0 row(s) in 31.8870 seconds* Thanks, Kumar On Wed, Jun 15, 2016 at 7:56 PM, Ted Yu wrote:

`hbase classpath` command causes “File name too long” error

2016-06-17 Thread Mahesha999
I am trying out HBase bulk loading. The command looks like this: $HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath` ${HADOOP_HOME}/bin/hadoop jar ${HBASE_HOME}/hbase-server-1.2.1.jar importtsv -Dimporttsv.columns=HBASE_ROW_KEY,d:c1,d:c2