How to avoid read/write update blocking in hbase and on what condition Hbase block read/write?
what should the frequency of Major compaction ( I have daily data insert on average is 18 GB and 48 GB max, its with SNAPPY and FAST_DIFF) a. should it be on daily basis? b. should it be in weekends? c. does Major compaction on daily basis will avoid blocking? What is the calculation? Right now its on weekend when load is low. we have : total 7 (3+4) data nodes 3 80GB Ram 1.8TB HDD 4 125 GB Ram HDD 6 TB below are few important configurations: hbase.regionserver.global.memstore.lowerLimit = .38 hbase.regionserver.global.memstore.upperLimit = .4 hbase.hregion.memstore.block.multiplier=2 hbase.hregion.majorcompaction=0 ( scheduled on weekend) hbase.hregion.memstore.flush.size 128 MB hbase.hregion.preclose.flush.size 5 MB hbase.hstore.compactionThreshold 3 -- luv all
