GitHub user xumingming added a comment to the discussion: Support Spark 3.3/JDK8
@coderfender Thanks for offering help! Very kind of you! @andygrove After some research I think Comet is very a promising library and have active and friendly community. I am very likely going to add Spark 3.3 support back, since we are currently using Spark 3.3 and we want to try DataFusion Comet. Upgrading the Spark itself to newer version involves too much things to do, become a blocker to adopt DataFusion Comet. @andygrove @mbutrovich one more question, for "shift resources particularly for 3.5 and 4.0 support", the "resource" here means "developing/developer resource" right? If that is case, if I'd like to support spark 3.3 related developing/reviewing staff(After a glance at #1529, seems the main code is not too much), is it possible to add it back to Comet master? The thinking behind this is that, **I have concern that with separate fork to support Spark 3.3, there might be some issues/especially correctness issues might not be found without community review.** From community side, with Spark 3.3 support, comet can attract more users to use, Spark 3.3 is still widely used(Other Spark Native Library(Gluten, Auron) all support it). And of course, I completely understand if you prefer to decline this request; I’m just asking in case it’s possible :) GitHub link: https://github.com/apache/datafusion-comet/discussions/3043#discussioncomment-15440442 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
