Based on the survey, there are still some users using the latest Kyuubi with Spark 3.1 (engine only), so I propose removing extension support for Spark 3.1 immediately while postponing the removal of support for Spark 3.1 for the engine to the next release.
Thanks, Cheng Pan > On Feb 26, 2024, at 17:22, Kent Yao <y...@apache.org> wrote: > > For engines or extension? > > Cheng Pan <pan3...@gmail.com> 于2024年2月26日周一 17:15写道： >> >> Hi, Kyuubi developers, >> >> The Spark 3.1 was EOL[1] on 02/18/2022 with the latest patch release 3.1.3. >> The Spark 3.2 was EOL[2] on 04/13/2023 with the latest patch release 3.2.4. >> The Spark 3.3 was EOL[2] on 08/21/2023 with the latest patch release 3.3.4. >> >> Given the fact that Spark 3.1 is the first widely adopted version of Spark >> 3.x series, we keep the support of it for a long time. >> >> Now, I propose to deprecate the support for Spark 3.1(or maybe include 3.2) >> in Kyuubi 1.9.0, in detail: >> >> - Remove support of Spark 3.1(or 3.1 and 3.2) in all extensions in 1.9.0 >> - Keep the support of Spark 3.1(or 3.1 and 3.2) in the Spark SQL engine in >> 1.9.0, and remove the support after 1.9.0 (maybe 1.10.0 or 2.0.0) >> >> Any thoughts? >> >> [1] https://github.com/apache/spark-website/pull/425 >> [2] https://github.com/apache/spark-website/pull/500 >> >> Thanks, >> Cheng Pan >> >>
