ad1happy2go commented on issue #10587:
URL: https://github.com/apache/hudi/issues/10587#issuecomment-1928794959
Had a conversation with @SudhirSaxena on this and looked at his setup. He is
using emr-6.15 with OSS hudi 0.14.0.
1. With RLI enabled, the upsert job is getting stuck for hours, no progress.
Also no useful logs. No running stage in UI.
driver Logs - Above comment.
2. We tried with RLI disabled keeping everything else same, But similar
behaviour. So, RLI may not have any issue.
Next steps -
- Try creating a test script which do bulk insert and insert from quickstart
and see if its working.
- Try same setup with 0.14.1 version.
- Try degrading EMR version which supports spark 3.3. Try running hudi
0.14.0 if we see same behaviour.
- Then just degrade hudi version to 0..12.3 which was used before and
confirm if that works fine.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
