danny0405 commented on PR #6595: URL: https://github.com/apache/hudi/pull/6595#issuecomment-1241417330
> > > > I will fix give pr fix in spark side too， but in flink side, I think deduplicate should also open as default option for mor table , when duplicate write to log file, very hard for compact to read, also lead mor table not stable due to the duplicate record twice read into memory. The initial idea is to keep the details of the log records, such as in the cdc change log feed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
