I have a big table and rows will be added to this table each day. I wanna run a MapReduce job over this table and select rows of several days as the job's input data. How can I achieve this?
If I prefix the rowkey with the date, I can easily select one day's data as the job's input, but this will involve hot spot problem because hundreds of millions of rows will be added to this table each day and the data will probably go to a single region server. Secondary index would be good for query but not good for a batch processing job. Are there any other ways? Are there any other frameworks which can achieve this goal easieruser? Shark? Stinger？HSearch?
