Re: Want to change key structure

2018-02-23 Thread Marcell Ortutay
Thanks for the info Anil. I first tried a MR which did Put's, based on the examples at [1] but this was much too slow, as you said. I switching to writing HFiles directly via HFileOutputFormat solves the issue. Also, I wanted to post an issue I ran into, in case anyone runs into it in the future.

Re: Want to change key structure

2018-02-20 Thread anil gupta
Hi Marcell, Since key is changing you will need to rewrite the entire table. I think generating HFlies(rather than doing puts) will be the most efficient here. IIRC, you will need to use HFileOutputFormat in your MR job. For locality, i dont think you should worry that much because major compactio