Dear All, We have a row where there are a million entries inserted as columns per day. The qualifier structure "prefix-reversetimestamp". I am performing a day wise slice of the columns using Columnrangefilter. When I tried to fetch columns that span within 3 days from the current time. There was no problem at all.
When, I tried to increase the number of days to morethan 3, then my entire cluster stops accepting new requests. Is it the case of region hot swapping due to my schema design? Is it a good to have million columns under a single row and growing each day. It is a production cluster, so I can't afford this outage. Please suggest me the workaround to handle this. Hbase version: 0.94.1 My sample code: Scan scan = new Scan(rowBytes, rowBytes); scan.setBatch(200); byte[] startPrefix = prefix + "-" + (Long.Max_value - currentimeroundedtoday); byte[] endPrefix = prefix + "-" + (Long.Max_value - (currenttimeroundedtoday - 7 days)); ColumnRangeFilger crf = new ColumnRangeFilter(startPrefix, true, endPrefix, true); scan.setFilter(crf); -- Thank you Kiran Sarvabhotla -----Even a correct decision is wrong when it is taken late
