Yes, this looks like HBASE-10499, but without more logs from the region server it is hard to tell.
<hdp_specific> The next version of HDP-2.1 is already scheduled to contain HBASE-10499. If you want, we can continue at the HDP forums. Enis On Tue, Feb 24, 2015 at 10:38 AM, Brian Jeltema < [email protected]> wrote: > > > What vendor/version/release corresponds with version > > "0.98.0.2.1.2.1-471-hadoop2" ? I've not seen that before. > > That’s what Ambari 1.6.0 installed when we selected HDP 2.1 (if memory > serves). > > > > > We did recently analyze and fix an issue involving the flush queue, see > > HBASE-10499 (https://issues.apache.org/jira/browse/HBASE-10499). This > was > > released in 0.98.10. I'm not definitively saying this is your issue but > do > > recommend an upgrade to the the current Apache HBase 0.98 release, which > is > > 0.98.10.1, or contact your vendor. > > Looks promising. Thanks. > > > > > > > > > On Tue, Feb 24, 2015 at 8:15 AM, Brian Jeltema < > > [email protected]> wrote: > > > >> I’m seeing occasional HBase log output similar to the output shown > below. > >> It appears there is a request to flush a region, repeated every 10 > >> seconds, that apparently is never being performed. It’s causing MR jobs > to > >> timeout because they cannot write to this region. Is this a known > problem? > >> > >> hbase version 0.98.0.2.1.2.1-471-hadoop2 > >> hadoop version 2.4.0.2.1.2.1-471 > >> > >> > >> 2015-02-23 14:51:47,612 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1415044750009.6ec50faa43a312cd6465d991e5984ec6. > after a > >> delay of 13758 > >> 2015-02-23 14:51:57,611 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1415044750009.6ec50faa43a312cd6465d991e5984ec6. > after a > >> delay of 18080 > >> 2015-02-23 14:52:07,611 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1415044750009.6ec50faa43a312cd6465d991e5984ec6. > after a > >> delay of 17701 > >> 2015-02-23 14:52:17,612 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1415044750009.6ec50faa43a312cd6465d991e5984ec6. > after a > >> delay of 19090 > >> 2015-02-23 14:52:27,616 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1415044750009.6ec50faa43a312cd6465d991e5984ec6. > after a > >> delay of 4042 > >> 2015-02-23 14:52:37,615 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1415044750009.6ec50faa43a312cd6465d991e5984ec6. > after a > >> delay of 12968 > >> 2015-02-23 18:12:03,307 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1424724136146.48d4d3fa0e02a97a8a1d9b85d5cf0162. > after a > >> delay of 10482 > >> 2015-02-23 18:12:13,308 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1424724136146.48d4d3fa0e02a97a8a1d9b85d5cf0162. > after a > >> delay of 14829 > >> 2015-02-23 19:15:13,330 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1424724136146.48d4d3fa0e02a97a8a1d9b85d5cf0162. > after a > >> delay of 22888 > >> 2015-02-23 19:15:23,329 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1424724136146.48d4d3fa0e02a97a8a1d9b85d5cf0162. > after a > >> delay of 21081 > >> 2015-02-23 19:15:33,329 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1424724136146.48d4d3fa0e02a97a8a1d9b85d5cf0162. > after a > >> delay of 6387 > >> 2015-02-23 20:50:23,368 INFO [regionserver60020.periodicFlusher] > >> regionserver.HRegionServer: regionserver60020.periodicFlusher requesting > >> flush for region > >> Host,\x00_m\xB8\x06,1424724136146.48d4d3fa0e02a97a8a1d9b85d5cf0162. > after a > >> delay of 8828 > >> > >> > > > > > > -- > > Best regards, > > > > - Andy > > > > Problems worthy of attack prove their worth by hitting back. - Piet Hein > > (via Tom White) > >
