Wellington Chevreuil created HBASE-25331:
--------------------------------------------
Summary: [HBOSS] TreeLockManager should log warnings about lock
contention periodically
Key: HBASE-25331
URL: https://issues.apache.org/jira/browse/HBASE-25331
Project: HBase
Issue Type: Improvement
Reporter: Wellington Chevreuil
Assignee: Wellington Chevreuil
While performing some internal tests with hboss, [~psomogyi] noticed that
*TreeLockManager* class logs too frequently when it is waiting on parent write
lock.
{noformat}
2020-10-26 17:35:41,719 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager:
Blocked waiting for some parent write lock, waiting:
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,720 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager:
Blocked waiting for some parent write lock, waiting:
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,721 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager:
Blocked waiting for some parent write lock, waiting:
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,723 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager:
Blocked waiting for some parent write lock, waiting:
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,724 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager:
Blocked waiting for some parent write lock, waiting:
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,725 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager:
Blocked waiting for some parent write lock, waiting:
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,726 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager:
Blocked waiting for some parent write lock, waiting:
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,728 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager:
Blocked waiting for some parent write lock, waiting:
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,729 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager:
Blocked waiting for some parent write lock, waiting:
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
2020-10-26 17:35:41,730 WARN org.apache.hadoop.hbase.oss.sync.TreeLockManager:
Blocked waiting for some parent write lock, waiting:
/s3a/hbase/hbase-dl/db1/hbase/data/default/test1/.tabledesc/.tableinfo.0000000001
{noformat}
In 4 seconds on a single RegionServer this WARN was logged 1767 times.
This modifies current logging logic, to calculate the time spent trying to
acquire locks on individual nodes, then warning only given a configurable
threshold is exhausted.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)