leesf commented on issue #2051: URL: https://github.com/apache/hudi/issues/2051#issuecomment-683213967
@jiegzhan hi, it is because hudi handles with small files automatically, after first insert, the file size would be less that 512000000, so it is a small file, so hudi will treat new records as updates to the exist small file. if you set small file size limit to 0, you would see the new records won't update the old records. however I think we should insert the record regardless of file size when using insert operation ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
