chiranjeevi created HBASE-25717:
-----------------------------------
Summary: RegionServer aborted with due to ClassCastException
Key: HBASE-25717
URL: https://issues.apache.org/jira/browse/HBASE-25717
Project: HBase
Issue Type: Bug
Reporter: chiranjeevi
{color:#000000}Observed RegionServer crash while writing huge data concurrently
through YCSB tool,
{noformat}
2021-03-29 14:35:37,860 | ERROR |
RpcServer.priority.RWQ.Fifo.write.handler=19,queue=3,port=RS_PORT | *****
ABORTING region server RS_IP,RS_PORT,1616999325078: The coprocessor
org.apache.hadoop.hbase.coprocessor.MetaTableMetrics threw
java.lang.ClassCastException: java.util.HashMap$Node cannot be cast to
java.util.HashMap$TreeNode ***** |
org.slf4j.helpers.MarkerIgnoringBase.error(MarkerIgnoringBase.java:159)
java.lang.ClassCastException: java.util.HashMap$Node cannot be cast to
java.util.HashMap$TreeNode
at java.util.HashMap$TreeNode.moveRootToFront(HashMap.java:1835)
at java.util.HashMap$TreeNode.treeify(HashMap.java:1951)
at java.util.HashMap.treeifyBin(HashMap.java:772)
at java.util.HashMap.putVal(HashMap.java:644)
at java.util.HashMap.put(HashMap.java:612)
at java.util.HashSet.add(HashSet.java:220)
at
org.apache.hadoop.hbase.coprocessor.MetaTableMetrics$ExampleRegionObserverMeta.registerAndMarkMeter(MetaTableMetrics.java:200)
at
org.apache.hadoop.hbase.coprocessor.MetaTableMetrics$ExampleRegionObserverMeta.regionMetricRegisterAndMark(MetaTableMetrics.java:173)
at
org.apache.hadoop.hbase.coprocessor.MetaTableMetrics$ExampleRegionObserverMeta.registerAndMarkMetrics(MetaTableMetrics.java:106)
at
org.apache.hadoop.hbase.coprocessor.MetaTableMetrics$ExampleRegionObserverMeta.prePut(MetaTableMetrics.java:91)
at
org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:948)
at
org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost$23.call(RegionCoprocessorHost.java:945)
at
org.apache.hadoop.hbase.coprocessor.CoprocessorHost$ObserverOperationWithoutResult.callObserver(CoprocessorHost.java:581)
at
org.apache.hadoop.hbase.coprocessor.CoprocessorHost.execOperation(CoprocessorHost.java:655)
at
org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut(RegionCoprocessorHost.java:945)
{noformat}
This problem occured only once in my test cluster. Discussed offline with
[~pankajkumar] it looks like race condition in MetaTableMetrics.metrics.{color}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
