nsivabalan commented on issue #6367: URL: https://github.com/apache/hudi/issues/6367#issuecomment-1215134782
For col stats issue, we might need to find the root cause how did we end up updating two records w/ same key w/ metadata table. probably its a transient issue and if you restart your pipeline, likely it may go. But definitely would like to understand the root cause here and possible fix a gap if any. Next time, is it possible to collect debug logs and share what you see. wrt Cleaning up the metadata, yeah, erasing would work with 0.10.1 or 0.11.0. but from 0.12, we have added some additional constraints or coupling. Can you disable metadata explicitly in your write configs (hoodie.metadata.enable=false), and try restarting your pipeline. Once you get to see few commits (5 to 10) go through successfully, you can come back again to re-enable your metadata via configs. Or another option is to use hudi-cli to disable metadata for table fo interest. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
