[
https://issues.apache.org/jira/browse/HBASE-27572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17680769#comment-17680769
]
Mariusz Szpatuśko commented on HBASE-27572:
-------------------------------------------
for FSHLog it is working properly, but about 30% slower. Workaround is to
switch off WALs in Durability. I see corresponding errors in hadoop for
asnychfswal:
2023-01-24 08:27:24,762 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode:
xxxx-1:50010:DataXceiver error processing WRITE_BLOCK operation src:
/xxxx:33860 dst: /xxxx:50010
java.io.IOException: Premature EOF from inputStream
at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:211)
at
org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211)
at
org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134)
at
org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109)
at
org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528)
at
org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968)
at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877)
at
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166)
at
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103)
at
org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290)
at java.lang.Thread.run(Thread.java:748)
> resource leak for store flush during high load
> ----------------------------------------------
>
> Key: HBASE-27572
> URL: https://issues.apache.org/jira/browse/HBASE-27572
> Project: HBase
> Issue Type: Bug
> Components: regionserver
> Affects Versions: 2.4.15
> Reporter: Mariusz Szpatuśko
> Priority: Blocker
>
> 2023-01-17 14:01:00,294 WARN [Close-WAL-Writer-3]
> asyncfs.FanOutOneBlockAsyncDFSOutputHelper: complete file
> /hbase/WALs/prod-storage-4,16020,1673962204907/prod-storage-4%2C16020%2C1673962204907.1673964006883
> not finished, retry = 0
> 2023-01-17 14:08:02,681 ERROR
> [regionserver/prod-storage-4:16020-shortCompactions-0]
> util.ResourceLeakDetector: iter(StoreFlusher.java:68)
>
> org.apache.hadoop.hbase.regionserver.DefaultStoreFlusher.flushSnapshot(DefaultStoreFlusher.java:75)
> org.apache.hadoop.hbase.regionserver.HStore.flushCache(HStore.java:992)
>
> org.apache.hadoop.hbase.regionserver.HStore$StoreFlusherImpl.flushCache(HStore.java:2358)
>
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushCacheAndCommit(HRegion.java:2837)
>
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2579)
>
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:2551)
> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:2421)
>
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:588)
>
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:558)
>
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher.access$1000(MemStoreFlusher.java:64)
>
> org.apache.hadoop.hbase.regionserver.MemStoreFlusher$FlushHandler.run(MemStoreFlusher.java:340)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
