Bryan Beaudreault created HBASE-28400:
-----------------------------------------

             Summary: WAL readers treat any exception as EOFException, which 
can lead to data loss
                 Key: HBASE-28400
                 URL: https://issues.apache.org/jira/browse/HBASE-28400
             Project: HBase
          Issue Type: Bug
            Reporter: Bryan Beaudreault


In HBASE-28390, I found a bug in our WAL compression which manifests as an 
IllegalArgumentException or ArrayIndexOutOfBoundException. Even worse is that 
ProtobufLogReader.readNext catches any Exception and rethrows it as an 
EOFException. EOFException gets handled in a variety of ways by the readers of 
WALs, and not all of them make sense for an exception that isn't really EOF.

For example, WALInputFormat catches EOFException and returns false for 
nextKeyValue(), effectively skipping the rest of the WAL file but not failing 
the job.

ReplicationSourceWALReader has some much more complicated handling of 
EOFException.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to