[
https://issues.apache.org/jira/browse/HBASE-25701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17309856#comment-17309856
]
Juanjuan Tian edited comment on HBASE-25701 at 3/27/21, 4:04 AM:
------------------------------------------------------------------
sometimes JVM crash when append wal entry, I add some callstack logs,
at org.apache.hadoop.hbase.util.ByteBufferUtils.toByte(ByteBufferUtils.java:418)
at
org.apache.hadoop.hbase.ByteBufferKeyValue.getFamilyLength(ByteBufferKeyValue.java:120)
at
org.apache.hadoop.hbase.ByteBufferKeyValue.getFamilyLength(ByteBufferKeyValue.java:102)
at
org.apache.hadoop.hbase.PrivateCellUtil.matchingFamily(PrivateCellUtil.java:731)
at org.apache.hadoop.hbase.CellUtil.matchingFamily(CellUtil.java:816)
at org.apache.hadoop.hbase.wal.WALEdit.isMetaEditFamily(WALEdit.java:209)
at
org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALActionListener.lambda$scopeWALEdits$0(ReplicationSourceWALActionListener.java:76)
at java.util.stream.MatchOps$1MatchSink.accept(MatchOps.java:90)
at java.util.ArrayList$ArrayListSpliterator.tryAdvance(ArrayList.java:1359)
at
java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126)
at
java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:498)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:485)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:230)
at java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:196)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.allMatch(ReferencePipeline.java:454)
at
org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALActionListener.scopeWALEdits(ReplicationSourceWALActionListener.java:76)
at
org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALActionListener.visitLogEntryBeforeWrite(ReplicationSourceWALActionListener.java:59)
at
org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.appendEntry(AbstractFSWAL.java:930)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.appendAndSync(AsyncFSWAL.java:497)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:599)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
was (Author: jutia):
I add some callstack logs, sometimes JVM crash when append wal entry
at org.apache.hadoop.hbase.util.ByteBufferUtils.toByte(ByteBufferUtils.java:418)
at
org.apache.hadoop.hbase.ByteBufferKeyValue.getFamilyLength(ByteBufferKeyValue.java:120)
at
org.apache.hadoop.hbase.ByteBufferKeyValue.getFamilyLength(ByteBufferKeyValue.java:102)
at
org.apache.hadoop.hbase.PrivateCellUtil.matchingFamily(PrivateCellUtil.java:731)
at org.apache.hadoop.hbase.CellUtil.matchingFamily(CellUtil.java:816)
at org.apache.hadoop.hbase.wal.WALEdit.isMetaEditFamily(WALEdit.java:209)
at
org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALActionListener.lambda$scopeWALEdits$0(ReplicationSourceWALActionListener.java:76)
at java.util.stream.MatchOps$1MatchSink.accept(MatchOps.java:90)
at java.util.ArrayList$ArrayListSpliterator.tryAdvance(ArrayList.java:1359)
at
java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126)
at
java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:498)
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:485)
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471)
at java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:230)
at java.util.stream.MatchOps$MatchOp.evaluateSequential(MatchOps.java:196)
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.util.stream.ReferencePipeline.allMatch(ReferencePipeline.java:454)
at
org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALActionListener.scopeWALEdits(ReplicationSourceWALActionListener.java:76)
at
org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALActionListener.visitLogEntryBeforeWrite(ReplicationSourceWALActionListener.java:59)
at
org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.appendEntry(AbstractFSWAL.java:930)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.appendAndSync(AsyncFSWAL.java:497)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.consume(AsyncFSWAL.java:599)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
> RegionServer JVM crash when append wal entry
> --------------------------------------------
>
> Key: HBASE-25701
> URL: https://issues.apache.org/jira/browse/HBASE-25701
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 2.2.6
> Reporter: Juanjuan Tian
> Priority: Major
>
> Region Server JVM crash when append wal entry, JVM crash log:
> #
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x00000000027af93f,
> pid=17992, tid=0x0000000000002d54
> #
> # JRE version: Java(TM) SE Runtime Environment (8.0_202-b08) (build
> 1.8.0_202-b08)
> # Java VM: Java HotSpot(TM) 64-Bit Server VM (25.202-b08 mixed mode
> windows-amd64 compressed oops)
> # Problematic frame:
> # J 10214 C2 org.apache.hadoop.hbase.ByteBufferKeyValue.getFamilyLength()B (9
> bytes) @ 0x00000000027af93f [0x00000000027af860+0xdf]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
