Re: Should Taking A Snapshot Work Even If Balancer Is Moving A Few Regions Around?

2018-03-23 Thread Saad Mufti
Thanks. Saad On Wed, Mar 21, 2018 at 3:04 PM, Ted Yu wrote: > Looking at > hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java in > branch-1.4 : > > boolean[] setSplitOrMergeEnabled(final boolean enabled, final boolean > synchronous, >

Re: Should Taking A Snapshot Work Even If Balancer Is Moving A Few Regions Around?

2018-03-23 Thread Saad Mufti
Thanks. Saad On Wed, Mar 21, 2018 at 2:33 PM, Vladimir Rodionov wrote: > >>So my question is whether taking a snapshot is supposed to work even with > >>regions being moved around. In our case it is usually only a couple here > >>and there. > > No, if region was

Re: Should Taking A Snapshot Work Even If Balancer Is Moving A Few Regions Around?

2018-03-21 Thread Ted Yu
Looking at hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java in branch-1.4 : boolean[] setSplitOrMergeEnabled(final boolean enabled, final boolean synchronous, final MasterSwitchType... switchTypes) throws IOException; boolean

Re: Should Taking A Snapshot Work Even If Balancer Is Moving A Few Regions Around?

2018-03-21 Thread Vladimir Rodionov
>>So my question is whether taking a snapshot is supposed to work even with >>regions being moved around. In our case it is usually only a couple here >>and there. No, if region was moved, split or merged during snapshot operation - snapshot will fail. This is why taking snapshots on a large

Should Taking A Snapshot Work Even If Balancer Is Moving A Few Regions Around?

2018-03-20 Thread Saad Mufti
Hi, We are using HBase 1.4.0 on AWS EMR based Hbase. Since snapshots are in S3, they take much longer than when using local disk. We have a cron script to take regular snapshots as backup, and they fail quite often on our largest table which takes close to an hour to complete the snapshot. The