DanielLeens commented on issue #10881: URL: https://github.com/apache/seatunnel/issues/10881#issuecomment-4931022128
Thanks for the follow-up here. There is now a concrete fix path in progress: PR #11393. I checked that new change against the original failure mode from this issue, and the direction matches the root cause we discussed earlier: the Spark starter should not carry embedded Scala runtime classes that can conflict with the cluster-side Spark / Scala distribution in YARN cluster mode. So at this point, this still looks like a confirmed bug, but it is no longer blocked only at the issue-analysis stage. We now have an active implementation path to review and verify. Until that PR is merged, the temporary workarounds you shared are still the right ones: - use client mode, or - strip the embedded `scala/*` classes from `seatunnel-spark-3-starter.jar` Please keep an eye on PR #11393. If you have a chance to verify that patch against your YARN cluster once a build is available, that would be very helpful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
