asankadarshana007 commented on issue #6686: URL: https://github.com/apache/hudi/issues/6686#issuecomment-1250429188
Hey @xushiyan - thank you for your reply. At the time when I initially started developing these jobs (a long time back with the previous version of hudi connector - 0.5.x), I wasn't aware of the fact that s3 has strong consistency. I assumed it was eventual consistency. I can change the hudi config value to `'hoodie.consistency.check.enabled': 'false'` and test. But do you assume it might have a connection to this error ? I assume with `'hoodie.consistency.check.enabled': 'true'`, hudi would try to make sure that all files are available - as an extra check ? I have raised a support ticket with AWS. But it could take sometime to get some resolution out of them 😓 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
