yihua commented on PR #332: URL: https://github.com/apache/incubator-xtable/pull/332#issuecomment-1969875800
> > I want to understand why MoR tables are the only ones that fail. I am new to Hudi and curious about it. > > MoR tables are the only type of table with log files. Updates for existing record keys will be added to a log file for the given file groups. CoW (copy on write) does not produce log files since it copies the data to a new base file on each commit. Since we're only handling base files and not log files, we need to filter out these log files for now. Adding to what @the-other-tim-brown describes, the logic extracting files from the (delta)commit metadata and others excluding rollback and restore instants has already considered MOR tables and filtered out log files to process only base files. The rollback and restore instant metadata did not filter out log files, causing the failure mentioned in the PR description, thus this fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
