migeruj commented on issue #11959: URL: https://github.com/apache/hudi/issues/11959#issuecomment-2359725070
Hi! I am another Hudi user like you, I'm not related directly with Hudi Project. Could you please format your write configurations as a copyable JSON? This will help make it easier to replicate. From what I can see, nothing stands out as an issue so far. Also, are you using the hudi-aws-bundle for your Glue Job? There was a breaking change introduced in version 0.13.0, which might affect your setup, though I’m not sure if it applies in your case. Check the breaking changes and behaviour changes of 0.13.0 versions and 0.14.0 versions: [0.14.0 Changes](https://hudi.apache.org/releases/release-0.14.0/#breaking-changes) [0.13.0 Changes](https://hudi.apache.org/releases/release-0.13.0/#migration-guide-breaking-changes) Also check known regressions, on 0.14.0 and 0.14.1 there is some regressions related to Duplicates for ComplexKeyGenerator. Based on that try to use 0.13.0 version instead until is solved. If you’ve tried everything else, I recommend the following steps: Compare the checkpoints before and after the Hudi upgrade to see if there is any behaviour that helps. Could you use the hudi-cli to check the commit history? This can help track down any issues with the data or commits. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
