Wellington Chevreuil created HBASE-25331:
--------------------------------------------

             Summary: [HBOSS] TreeLockManager should log warnings about lock 
contention periodically
                 Key: HBASE-25331
                 URL: https://issues.apache.org/jira/browse/HBASE-25331
             Project: HBase
          Issue Type: Improvement
            Reporter: Wellington Chevreuil
            Assignee: Wellington Chevreuil


While performing some internal tests with hboss, [~psomogyi] noticed that 
*TreeLockManager* class logs too frequently when it is waiting on parent write 
lock.
{noformat}
2020-10-26 17:35:41,719 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager: 
Blocked waiting for some parent write lock, waiting: 
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,720 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager: 
Blocked waiting for some parent write lock, waiting: 
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,721 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager: 
Blocked waiting for some parent write lock, waiting: 
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,723 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager: 
Blocked waiting for some parent write lock, waiting: 
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,724 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager: 
Blocked waiting for some parent write lock, waiting: 
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,725 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager: 
Blocked waiting for some parent write lock, waiting: 
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,726 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager: 
Blocked waiting for some parent write lock, waiting: 
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,728 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager: 
Blocked waiting for some parent write lock, waiting: 
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,729 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager: 
Blocked waiting for some parent write lock, waiting: 
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,730 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager: 
Blocked waiting for some parent write lock, waiting: 
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
 {noformat}
In 4 seconds on a single RegionServer this WARN was logged 1767 times.

This modifies current logging logic, to calculate the time spent trying to 
acquire locks on individual nodes, then warning only given a configurable 
threshold is exhausted.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to