This is an automated email from the ASF dual-hosted git repository.
chengpan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/kyuubi.git
The following commit(s) were added to refs/heads/master by this push:
new 8b562953a9 [KYUUBI #7199] Deprecate support for Flink 1.17 and 1.18
8b562953a9 is described below
commit 8b562953a9bfe019ab9bc47e08d4541c7bd8b8e9
Author: Cheng Pan <[email protected]>
AuthorDate: Fri Sep 12 10:19:14 2025 +0800
[KYUUBI #7199] Deprecate support for Flink 1.17 and 1.18
### Why are the changes needed?
Discussion in mailing list:
https://lists.apache.org/thread/qrbknzjj3jcwjc9nd64qmtohrwfk1kjp
This PR proposes to deprecate support for Flink 1.17 and 1.18:
- Remove building support for Flink 1.17 and 1.18
- Still keeping the engine support for Flink 1.17 and 1.18, but the user is
going to see a deprecated message on engine startup.
### How was this patch tested?
Pass GHA.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #7199 from pan3793/deprecate-flink-1.17-1.18.
Closes #7199
64d580749 [Cheng Pan] fix
080d61689 [Cheng Pan] nit
9c3412b3d [Cheng Pan] restore profile
146a8aa52 [Cheng Pan] Deprecate support for Flink 1.17 and 1.18
Authored-by: Cheng Pan <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
---
.github/workflows/master.yml | 2 --
docs/deployment/migration-guide.md | 3 +--
.../main/scala/org/apache/kyuubi/engine/flink/FlinkEngineUtils.scala | 4 ++++
pom.xml | 3 +++
4 files changed, 8 insertions(+), 4 deletions(-)
diff --git a/.github/workflows/master.yml b/.github/workflows/master.yml
index 623932a4dd..4bc51d1a38 100644
--- a/.github/workflows/master.yml
+++ b/.github/workflows/master.yml
@@ -245,8 +245,6 @@ jobs:
java:
- 8
flink:
- - '1.17'
- - '1.18'
- '1.19'
- '1.20'
flink-archive: [ "" ]
diff --git a/docs/deployment/migration-guide.md
b/docs/deployment/migration-guide.md
index ff6449ee68..03d0093f3d 100644
--- a/docs/deployment/migration-guide.md
+++ b/docs/deployment/migration-guide.md
@@ -19,10 +19,9 @@
## Upgrading from Kyuubi 1.10 to 1.11
+* Since Kyuubi 1.11, the support of Flink engine for Flink 1.17 and 1.18 are
deprecated, and will be removed in the future.
* Since Kyuubi 1.11, the configuration
`spark.sql.watchdog.forcedMaxOutputRows` provided by Kyuubi Spark extension is
removed, consider using `kyuubi.operation.result.max.rows` instead. Note, the
latter works without requirement of installing Kyuubi Spark extension.
-
* Since Kyuubi 1.11, if the engine is running in cluster mode, Kyuubi will
respect the `kyuubi.session.engine.startup.waitCompletion` config to determine
whether to wait for the engine completion or not. If the engine is running in
client mode, Kyuubi will always wait for the engine completion. And for Spark
engine, Kyuubi will append the `spark.yarn.submit.waitAppCompletion` and
`spark.kubernetes.submission.waitAppCompletion` configs to the engine conf
based on the value of `kyuubi.sess [...]
-
* Since Kyuubi 1.11, the configuration
`kyuubi.session.engine.spark.initialize.sql` set by the client (via session
configuration) is now correctly applied to every session in shared engines
(USER, GROUP, SERVER). Previously, only the value set on the server side was
applied and only for the first session when the engine started. Now,
session-level settings provided by each client are respected.
## Upgrading from Kyuubi 1.9 to 1.10
diff --git
a/externals/kyuubi-flink-sql-engine/src/main/scala/org/apache/kyuubi/engine/flink/FlinkEngineUtils.scala
b/externals/kyuubi-flink-sql-engine/src/main/scala/org/apache/kyuubi/engine/flink/FlinkEngineUtils.scala
index 1f4e56920e..4a426edd61 100644
---
a/externals/kyuubi-flink-sql-engine/src/main/scala/org/apache/kyuubi/engine/flink/FlinkEngineUtils.scala
+++
b/externals/kyuubi-flink-sql-engine/src/main/scala/org/apache/kyuubi/engine/flink/FlinkEngineUtils.scala
@@ -55,6 +55,10 @@ object FlinkEngineUtils extends Logging {
val flinkVersion = EnvironmentInformation.getVersion
if (SUPPORTED_FLINK_VERSIONS.contains(FLINK_RUNTIME_VERSION)) {
info(s"The current Flink version is $flinkVersion")
+ if (FlinkEngineUtils.FLINK_RUNTIME_VERSION <= "1.18") {
+ warn("The support for Flink 1.17 and 1.18 are deprecated, and will be
removed " +
+ "in the next version.")
+ }
} else {
throw new UnsupportedOperationException(
s"You are using unsupported Flink version $flinkVersion, " +
diff --git a/pom.xml b/pom.xml
index 93476b5983..8efc5bf956 100644
--- a/pom.xml
+++ b/pom.xml
@@ -2105,6 +2105,9 @@
</repositories>
</profile>
+ <!-- The building support for Flink 1.17 and 1.18 is removed in
[KYUUBI #7199],
+ but we need to keep these profiles in order to run integration
tests for
+ cross-version verification. -->
<profile>
<id>flink-1.17</id>
<properties>