fhan688 opened a new pull request, #13870:
URL: https://github.com/apache/hudi/pull/13870

   ### Change Logs
   
   Corrupt log files will be skipped when stream read, which may cause data 
loss(first data block with broken magic number while later data blocks are also 
skipped).
   
   This PR add metric totalCorruptLogFiles when stream read which indicates 
this potential data loss. 
   
   
   ### Impact
   
   hudi-common、hudi-flink
   
   ### Risk level (write none, low medium or high below)
   
   low
   
   ### Documentation Update
   
   none
   
   ### Contributor's checklist
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to