nsivabalan commented on issue #4748: URL: https://github.com/apache/hudi/issues/4748#issuecomment-1030873277
you have to set concurrency.mode=optimistic_concurrency_control. more info can be found [here](https://hudi.apache.org/docs/0.8.0/concurrency_control/). if you set it to single writer, lock providers are not effective. So, may be its an issue w/ metadata table. w/o enabling metadata, does your pipeline run smoothly w/o any issues? Also, we have a command in hudi-cli in 0.10.1 or latest master "metadata validate-files" that you can try it out. It might give file mismatches between fs based listing and metadata based listing. If you wish to rebuild metadata, you can delete the metadata from hudi-cli and your next write will bootstrap the metadata table again. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
