Re: ABORTING region server and following HBase cluster "crash"

2018-09-08 Thread Batyrshin Alexander
After update we still can't recover HBase cluster. Our region servers ABORTING over and over: prod003: Sep 09 02:51:27 prod003 hbase[1440]: 2018-09-09 02:51:27,395 FATAL [RpcServer.default.FPBQ.Fifo.handler=92,queue=2,port=60020] regionserver.HRegionServer: ABORTING region server

Re: ABORTING region server and following HBase cluster "crash"

2018-09-08 Thread Batyrshin Alexander
Thank you. We're updating our cluster right now... > On 9 Sep 2018, at 01:39, Ted Yu wrote: > > It seems you should deploy hbase with the following fix: > > HBASE-21069 NPE in StoreScanner.updateReaders causes RS to crash > > 1.4.7 was recently released. > > FYI > > On Sat, Sep 8, 2018 at

Re: ABORTING region server and following HBase cluster "crash"

2018-09-08 Thread Ted Yu
It seems you should deploy hbase with the following fix: HBASE-21069 NPE in StoreScanner.updateReaders causes RS to crash 1.4.7 was recently released. FYI On Sat, Sep 8, 2018 at 3:32 PM Batyrshin Alexander <0x62...@gmail.com> wrote: > Hello, > > We got this exception from *prod006* server >

ABORTING region server and following HBase cluster "crash"

2018-09-08 Thread Batyrshin Alexander
Hello, We got this exception from prod006 server Sep 09 00:38:02 prod006 hbase[18907]: 2018-09-09 00:38:02,532 FATAL [MemStoreFlusher.1] regionserver.HRegionServer: ABORTING region server prod006,60020,1536235102833: Replay of WAL required. Forcing server shutdown Sep 09 00:38:02 prod006