GitHub user xumingming added a comment to the discussion: Support Spark 3.3/JDK8
@andygrove the main issues for upgrading Spark is that we are not justing using community Spark 3.3 directly, we have made many changes to support customized SQL grammar(to be compatible with another engine), to support customized data source etc. The upgrading itself involves a lot of coordination and work. Your advice of trying an old version of Comet that support Spark 3.3 is inspiring and I will try it to see if Comet gives a good perf result. @mbutrovich @andygrove I get that supporting JDK8 is a not easy thing and seems impossible to maintain for Comet. Adding support for Spark 3.3 + JDK11 alone is also desirable and would help a lot. GitHub link: https://github.com/apache/datafusion-comet/discussions/3043#discussioncomment-15453174 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
