yihua commented on PR #332:
URL: https://github.com/apache/incubator-xtable/pull/332#issuecomment-1969875800

   > > I want to understand why MoR tables are the only ones that fail. I am 
new to Hudi and curious about it.
   > 
   > MoR tables are the only type of table with log files. Updates for existing 
record keys will be added to a log file for the given file groups. CoW (copy on 
write) does not produce log files since it copies the data to a new base file 
on each commit. Since we're only handling base files and not log files, we need 
to filter out these log files for now.
   
   Adding to what @the-other-tim-brown describes, the logic extracting files 
from the (delta)commit metadata and others excluding rollback and restore 
instants has already considered MOR tables and filtered out log files to 
process only base files.  The rollback and restore instant metadata did not 
filter out log files, causing the failure mentioned in the PR description, thus 
this fix.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to