ulysses-you commented on issue #3940: URL: https://github.com/apache/paimon/issues/3940#issuecomment-2290889656
thank you @YannByron for the guide. I looked at Spark 4.0.0-preview, the main challenge is scala2.13. Others like JDK17, inferface changes are not big issues. For scala2.13, as far as I can see, Spark community paid a huge cost to support it and drop the scala2.12, and even for now there are some performance regression due to scala2.13, so I think it affects Paimon much. For my self, I perfer to copy `paimon-spark-common` to a new module `paimon-spark-4.0`, so that we did not need to touch previous Spark version code. We can focus on the support with Spark 4.0.0 and higher version (may create `paimon-spark-4-common` if necessary). cc @JingsongLi what do you think about? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@paimon.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
