MapReduce on Sanpshots

2015-05-08 Thread Rahul Malviya
Hi All, I have been MapReduce on HBase for a while now and this has been really successful for me. But I have some MRs jobs in my pipeline which scan every row on hbase. So I was wondering I move this MR job to run on snapshot that will reduce the load on RSs and HBase direct operations mostly

Re: MapReduce on Sanpshots

2015-05-08 Thread Ted Yu
Please see Release Note of HBASE-8369 Cheers On Fri, May 8, 2015 at 8:16 AM, Rahul Malviya malviyarahul2...@gmail.com wrote: Hi All, I have been MapReduce on HBase for a while now and this has been really successful for me. But I have some MRs jobs in my pipeline which scan every row on

Re: MapReduce on Sanpshots

2015-05-08 Thread Rahul Malviya
Thanks Ted. Seems to answer my question. Rahul On May 8, 2015, at 9:04 AM, Ted Yu yuzhih...@gmail.com wrote: Please see Release Note of HBASE-8369 Cheers On Fri, May 8, 2015 at 8:16 AM, Rahul Malviya malviyarahul2...@gmail.com wrote: Hi All, I have been MapReduce on HBase for a

Re: MapReduce on Sanpshots

2015-05-08 Thread Michael Segel
On May 8, 2015, at 11:04 AM, Ted Yu yuzhih...@gmail.com wrote: HBASE-8369 WARNING: This feature bypasses HBase-level security completely since the files are read from the hdfs directly. The user who is running the scan / job has to have read permissions to the data files and snapshot

Re: MapReduce on Sanpshots

2015-05-08 Thread rahul malviya
Currently we have only one user accessing all the big data stack - hdfs/hbase etc ... so security is not a issue for us but thanks for stressing on this and I will keep this in mind when we move to secured cluster. Apart from security there are no other concerns ? Thanks, Rahul On Fri, May 8,