xushiyan commented on issue #6259: URL: https://github.com/apache/hudi/issues/6259#issuecomment-1296232384
> if I am not wrong, hudi already has data quality validator that you can run before completing a commit. If the validation fails, the commit will abort. Would that work for your case? https://hudi.apache.org/releases/release-0.9.0#writer-side-improvements Check for "pre commit validator framework" in the above link. this is correct. If there is a need for a full-fledged data quality tool, feel free to raise an RFC discussion on the dev email list. Closing this as the write-audit-publish pattern can be fulfilled with the existing precommit validator feature. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
