SamarthRaval commented on issue #10468: URL: https://github.com/apache/hudi/issues/10468#issuecomment-1885013120
> @SamarthRaval OCC is not recommend to run lot of multi writer jobs together if they write to same file group. You may be seeing failures which will be resulting in rollbacks. > > The files will keep on failing and retried in case of conflict , so that's the reason you feel it may be running forever. I think that is what exactly happening. In future releases of hudi, are we addressing this by any chance ? Or something is in pipeline already for above scenario ? Asking this so in our future development I can keep this in consideration. Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
