Re: CorruptedSnapshotException Taking Snapshot Of Table With Large Number Of Files

2018-03-19 Thread Saad Mufti
Thanks, I tried briefly but maybe I didn't do quite the right search. In any case, thanks for the help. Saad On Mon, Mar 19, 2018 at 2:50 PM, Huaxiang Sun wrote: > You can google search the exception stack and mostly it will find the JIRA. > > Regards, > > Huaxiang > >

Re: CorruptedSnapshotException Taking Snapshot Of Table With Large Number Of Files

2018-03-19 Thread Huaxiang Sun
You can google search the exception stack and mostly it will find the JIRA. Regards, Huaxiang > On Mar 19, 2018, at 10:52 AM, Saad Mufti wrote: > > Thanks!!! Wish that was documented somewhere in the manual. > > Cheers. > > > Saad > > > On Mon, Mar 19, 2018 at

Re: CorruptedSnapshotException Taking Snapshot Of Table With Large Number Of Files

2018-03-19 Thread Saad Mufti
Thanks!!! Wish that was documented somewhere in the manual. Cheers. Saad On Mon, Mar 19, 2018 at 1:38 PM, Huaxiang Sun wrote: > Mostly it is due to HBASE-15430 jira/browse/HBASE-15430>, “snapshot.manifest.size.limit” needs to be >

Re: CorruptedSnapshotException Taking Snapshot Of Table With Large Number Of Files

2018-03-19 Thread Huaxiang Sun
Mostly it is due to HBASE-15430 , “snapshot.manifest.size.limit” needs to be configured as 64MB or 128MB. Regards, Huaxiang Sun > On Mar 19, 2018, at 10:16 AM, Saad Mufti wrote: > > Hi, > > We are running on HBase

CorruptedSnapshotException Taking Snapshot Of Table With Large Number Of Files

2018-03-19 Thread Saad Mufti
Hi, We are running on HBase 1.4.0 on an AWS EMR/HBase cluster. We have started seeing the following stacktrace when trying to take a snapshot of a table with a very large number of files (12000 regions and roughly 36 - 40 files). The number of files should go down as we haven't been