Hi team, For our master branch a.k.a v1.6.0, we now test and build against multiple spark revisions, including spark 3.0.x/3.1.x/3.2.x/3.3.x running with java 8 and 11, and cross-version tests with a spark 3.2 compiled engine running on spark 3.0.x/3.1.x/3.3.x distributions.
Considering that spark 3.0 is EOL via spark community and the heavy workload on our CI, we'd better drop spark 3.0.x support step by step. Here are the options/steps I have been thinking of, O.1. drop the ci jobs for 3.0.x compile/build/test for java 8 and 11 only. O.2. drop the ci job for running the 3.2 complied engine on spark 3.0 distribution. + O.1 O.3. drop the spark-3.0 maven profile + O.2 Best Regards Kent