[
https://issues.apache.org/jira/browse/HBASE-22502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Duo Zhang resolved HBASE-22502.
-------------------------------
Resolution: Fixed
Assignee: Duo Zhang
Hadoop Flags: Reviewed
Pushed to branch-2.2+.
Thanks [~openinx] for reviewing.
> Purge the logs when we reach the EOF for the last wal file when replication
> ---------------------------------------------------------------------------
>
> Key: HBASE-22502
> URL: https://issues.apache.org/jira/browse/HBASE-22502
> Project: HBase
> Issue Type: Bug
> Reporter: Duo Zhang
> Assignee: Duo Zhang
> Priority: Major
> Fix For: 3.0.0, 2.2.0, 2.3.0
>
>
> Now there will be strange a warn log
> {noformat}
> 2019-05-30 14:59:38,426 WARN
> [RS:1;zhangduo-ubuntu:39885.replicationSource.wal-reader.zhangduo-ubuntu%2C39885%2C1559199556433,2]
> wal.ProtobufLogReader(422): Encountered a malformed edit, seeking back to
> last good position in file, from 2459 to 2459
> java.io.EOFException: First byte is negative at offset 2459
> at
> org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.readNext(ProtobufLogReader.java:347)
> at
> org.apache.hadoop.hbase.regionserver.wal.ReaderBase.next(ReaderBase.java:98)
> at
> org.apache.hadoop.hbase.regionserver.wal.ReaderBase.next(ReaderBase.java:86)
> at
> org.apache.hadoop.hbase.replication.regionserver.WALEntryStream.readNextEntryAndRecordReaderPosition(WALEntryStream.java:263)
> at
> org.apache.hadoop.hbase.replication.regionserver.WALEntryStream.tryAdvanceEntry(WALEntryStream.java:176)
> at
> org.apache.hadoop.hbase.replication.regionserver.WALEntryStream.hasNext(WALEntryStream.java:101)
> at
> org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.readWALEntries(ReplicationSourceWALReader.java:195)
> at
> org.apache.hadoop.hbase.replication.regionserver.ReplicationSourceWALReader.run(ReplicationSourceWALReader.java:138)
> {noformat}
> And in TestReplicationStatus* UTs, we set the retry interval to 100ms, so the
> logs are flooded with these useless warns...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
