Can a compaction storm occur in hbase 1.0

2016-10-26 Thread meirav.malka
Hi, As far as I understand, a compaction storm occurs when multiple regions of the same region server perform compaction. It looks like,  from watching hbase UI that within a region server, compaction is done serially for a specific table.(one region at a time) So does this mean that a compaction

Ycsb and Hbase - read+write simulation.

2017-08-09 Thread meirav.malka
Hi everyone, Does anyone know of a ycdb option that will allow the following read request distribution: 1. 90% of the material read was inserted in the last 24 hours.2. 97% in the last 2 hours. The only options i see for request distribution is "latest", "zipfian" and "uniform" Is there anyway

DamagedWALException: Append requesting roll of WAL

2018-07-05 Thread meirav.malka
Hi everyone,We have experienced a slowdown on writes and we have seen this error in the rest servers log : org.apache.hadoop.hbase.regionserver.wal.DamagedWALException: Append  sequenceId=8689, requesting roll of WAL I have not seen any issues in the region server or master log files. A few minute

Re: Can MOB be enabled for existing table?

2018-09-20 Thread meirav.malka
Hi,Since you probably don't have enough space for backup for such a large table, test it on a small one and rowcount before and after.We work extensively with mob and there are several issues with it that we had to work around.1.Mob and ttl - region server crashes after ttl archiver runs.2.Mob a

Re: HBase top activity

2019-01-09 Thread meirav.malka
Thanks for the replies.I understand the difficulty in tracking distributed scans.Meanwhile I found that "responseTooSlow" queries, do get written to log. The entry contains scan details(table, start and endrowkey, response size and processing time)So I was thinking to lower the threshold so that