parisni opened a new issue, #813:
URL: https://github.com/apache/incubator-xtable/issues/813

   ### Search before asking
   
   - [x] I had searched in the 
[issues](https://github.com/apache/incubator-xtable/issues?q=is%3Aissue) and 
found no similar issues.
   
   
   ### Please describe the bug 🐞
   
   turns out when `_delta_log` has checkpoint parquet files such 
`00000000000000000150.checkpoint.parquet`, then hudi fs backed metadata 
consider them as hudi partition and fails hard.
   
   In hudi the metadata table is not the source of truce and it sometimes gets 
corrupted. As a result one can rebuild but having delta logs folder leads 
corrupt the hudi, unable to read/write.
   
   I have mitigated the problem in our hudi fork by skipping both 
metadata/_delta_log folders, but i can't see any pure xtable mitigation so far, 
except take care of purging both _delta_log and metadata folder when recreating 
the MDT 
   
   ### Are you willing to submit PR?
   
   - [x] I am willing to submit a PR!
   - [ ] I am willing to submit a PR but need help getting started!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to