ndimiduk commented on issue #1335: HBASE-24000 Simplify CommonFSUtils after upgrading to hadoop 2.10.0 URL: https://github.com/apache/hbase/pull/1335#issuecomment-603571315 `TestWALEntryStream` looks like it read partial data, ``` 2020-03-24 05:12:43,671 INFO [Listener at localhost/38169] wal.AbstractFSWAL(756): Rolled WAL /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1335/yetus-jdk8-hadoop2-check/src/hbase-server/target/test-data/8b31e9c5-e403-a068-d9ff-fc56f5c00237/WALs/testDifferentCounts/testDifferentCounts.1585026756453 with entries=1500, filesize=184.53 KB; new WAL /home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1335/yetus-jdk8-hadoop2-check/src/hbase-server/target/test-data/8b31e9c5-e403-a068-d9ff-fc56f5c00237/WALs/testDifferentCounts/testDifferentCounts.1585026763520 2020-03-24 05:12:43,672 DEBUG [Listener at localhost/38169] wal.AbstractFSWAL(845): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34733,DS-4271f034-e4f9-408c-9869-e101eb00f24c,DISK], DatanodeInfoWithStorage[127.0.0.1:43925,DS-4f6145c8-5eca-4ff4-afe6-b84495802210,DISK], DatanodeInfoWithStorage[127.0.0.1:40637,DS-e9928388-d36b-42de-bb16-1925e01cd86f,DISK]] 2020-03-24 05:12:44,270 WARN [Listener at localhost/38169] wal.ProtobufLogReader(426): Encountered a malformed edit, seeking back to last good position in file, from 188958 to 188957 java.io.EOFException: Partial PB while reading WAL, probably an unexpected EOF, ignoring. current offset=188958 at org.apache.hadoop.hbase.regionserver.wal.ProtobufLogReader.readNext(ProtobufLogReader.java:369) at org.apache.hadoop.hbase.regionserver.wal.ReaderBase.next(ReaderBase.java:98) at org.apache.hadoop.hbase.regionserver.wal.ReaderBase.next(ReaderBase.java:86) at org.apache.hadoop.hbase.replication.regionserver.WALEntryStream.readNextEntryAndRecordReaderPosition(WALEntryStream.java:263) at org.apache.hadoop.hbase.replication.regionserver.WALEntryStream.tryAdvanceEntry(WALEntryStream.java:176) at org.apache.hadoop.hbase.replication.regionserver.WALEntryStream.hasNext(WALEntryStream.java:101) at org.apache.hadoop.hbase.replication.regionserver.TestWALEntryStream.testDifferentCounts(TestWALEntryStream.java:169) ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
