ammarchalifah commented on PR #16424: URL: https://github.com/apache/iceberg/pull/16424#issuecomment-4571794372
Agree on the not fixing this on Iceberg part. Unfortunately the Spark committer stated the changes will not be backported to earlier versions, and he clarified that the PR might not help with this particular bug. > Hi @ammarchalifah, no, those can't be backported to earlier versions. I doubt that the refactor or the other improvement would fix your issue, but there are many other SPJ fixes in the upcoming 4.2 so you should probably give it a try. However, the bug still exists, as demonstrated by the newly added test in this PR + the EMR repro script in the [issue](https://github.com/apache/iceberg/issues/15349). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
