This is an automated email from the ASF dual-hosted git repository.
chengpan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/kyuubi-website.git
The following commit(s) were added to refs/heads/master by this push:
new 91f2288 Release 1.8.0 (#141)
91f2288 is described below
commit 91f22885837ef6aeeded7613669b238cdfbf7477
Author: Cheng Pan <[email protected]>
AuthorDate: Mon Nov 6 23:48:18 2023 -0600
Release 1.8.0 (#141)
---
hugo.toml | 2 +-
src/en/news/2023-11-07-release-1.8.0.md | 20 +
src/en/release/1.8.0.md | 713 ++++++++++++++++++++++++++++++++
src/zh/news/2023-11-07-release-1.8.0.md | 20 +
src/zh/release/1.8.0.md | 713 ++++++++++++++++++++++++++++++++
5 files changed, 1467 insertions(+), 1 deletion(-)
diff --git a/hugo.toml b/hugo.toml
index 2c46ceb..10ad595 100644
--- a/hugo.toml
+++ b/hugo.toml
@@ -337,6 +337,6 @@ defaultContentLanguage = 'en'
keepQuotes = true
[params]
- releases = [ 'v1.7.3', 'v1.6.1-incubating', 'v1.5.2-incubating',
'v1.4.1-incubating', 'v1.3.1-incubating' ]
+ releases = [ 'v1.8.0', 'v1.7.3', 'v1.6.1-incubating', 'v1.5.2-incubating',
'v1.4.1-incubating', 'v1.3.1-incubating' ]
downloadLink = 'https://www.apache.org/dyn/closer.lua/kyuubi/'
downloadLinkIncubator =
'https://www.apache.org/dyn/closer.lua/incubator/kyuubi/'
diff --git a/src/en/news/2023-11-07-release-1.8.0.md
b/src/en/news/2023-11-07-release-1.8.0.md
new file mode 100644
index 0000000..af294ec
--- /dev/null
+++ b/src/en/news/2023-11-07-release-1.8.0.md
@@ -0,0 +1,20 @@
+---
+title: Apache Kyuubi 1.8.0 released
+date: 2023-11-07
+linked: true
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+We are happy to announce the availability of [Apache Kyuubi
1.8.0](/release/1.8.0.html) ! Visit the [release notes](/release/1.8.0.html) to
read about the new features, or [download](/releases.html) the released today.
diff --git a/src/en/release/1.8.0.md b/src/en/release/1.8.0.md
new file mode 100644
index 0000000..68eb831
--- /dev/null
+++ b/src/en/release/1.8.0.md
@@ -0,0 +1,713 @@
+---
+title: Release Notes - 1.8.0
+date: 2023-11-07
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### Highlights
+
+- Fully verified with Java 8, 11, and 17, Scala 2.12, initial support Scala
2.13
+- Fully verified with Spark 3.1, 3.2, 3.3, and 3.4, initial support Spark 3.5
+- Fully verified with Flink 1.16, 1.17, and 1.18
+- New Web UI (experimental)
+- New Chat engine with OpenAI ChatGPT backend
+- Major improvements of Spark Batch API, optimized for large-scale job
submission (experimental)
+- Major improvements of Spark AuthZ plugin, including enhanced Iceberg and
DSv2 operators support
+- Major improvements of Flink engine, including YARN Application Mode support
+- Introducing Atlas hook support in Spark Lineage plugin
+- Continuously Kyuubi Helm Chart & Spark on K8s improvements
+
+### Spark Engine, Connectors and Plugins
+
+[[KYUUBI #1265](https://github.com/apache/kyuubi/pull/1265)] `OPTIMIZE` where
clause expression support
+[[KYUUBI #3420](https://github.com/apache/kyuubi/pull/3420)] Expose UI url on
registering engine service
+[[KYUUBI #3444](https://github.com/apache/kyuubi/pull/3444)] Support the
planOnly mode of kyuubi spark engine support SQL lineage
+[[KYUUBI #3929](https://github.com/apache/kyuubi/pull/3929)] Refactor lineage
plugin to add LineageDispatcher
+[[KYUUBI #4167](https://github.com/apache/kyuubi/pull/4167)] [AUTHZ] Introduce
function support in PrivilegeBuilder with Serde layers
+[[KYUUBI #4171](https://github.com/apache/kyuubi/pull/4171)] Support skip
retrieving table's properties to speed up GetTables operation
+[[KYUUBI #4186](https://github.com/apache/kyuubi/pull/4186)] Spark
showProgress with JobInfo
+[[KYUUBI #4330](https://github.com/apache/kyuubi/pull/4330)] Non-temporary
views do not resolve to a specific real table
+[[KYUUBI #4331](https://github.com/apache/kyuubi/pull/4331)] [[KYUUBI
#4431](https://github.com/apache/kyuubi/pull/4431)] Lineage supports `Union`
and `MergeInto`
+[[KYUUBI #4415](https://github.com/apache/kyuubi/pull/4415)] Align the
operation handle in server/engine for ExecuteScala, ExecutePython and
PlanOnlyStatement
+[[KYUUBI #4430](https://github.com/apache/kyuubi/pull/4430)] Lineage supports
the `lateral view explode` statement
+[[KYUUBI #4433](https://github.com/apache/kyuubi/pull/4433)] Fix the case with
`create a view from view`
+[[KYUUBI #4443](https://github.com/apache/kyuubi/pull/4443)] Do not set engine
session init sql for alive probe session
+[[KYUUBI #4450](https://github.com/apache/kyuubi/pull/4450)] Ignore unknown
fields `policyPriority` when reading policy json file
+[[KYUUBI #4488](https://github.com/apache/kyuubi/pull/4488)] [KSHC] Keep
object original name defined in HiveBridgeHelper
+[[KYUUBI #4493](https://github.com/apache/kyuubi/pull/4493)] [AUTHZ] Enable
Tests for Spark 3.1 with iceberg tables
+[[KYUUBI #4497](https://github.com/apache/kyuubi/pull/4497)] Add
RowFilteringTestBase to improve the test coverage
+[[KYUUBI #4504](https://github.com/apache/kyuubi/pull/4504)] [AUTHZ] Fix
source table privilege requirement when querying permanent view in Spark 3.1
and below
+[[KYUUBI #4525](https://github.com/apache/kyuubi/pull/4525)] [KSHC]
Partitioning predicates should take effect to filter data
+[[KYUUBI #4530](https://github.com/apache/kyuubi/pull/4530)] [AUTHZ] Support
non-English chars for MASK, MASK_SHOW_FIRST_4, and MASK_SHOW_FIRST_4
+[[KYUUBI #4532](https://github.com/apache/kyuubi/pull/4532)] [AUTHZ] Displays
the columns involved in extracting the aggregation operator
+[[KYUUBI #4541](https://github.com/apache/kyuubi/pull/4541)] Support to
customize the attributes to expose for Spark engine
+[[KYUUBI #4560](https://github.com/apache/kyuubi/pull/4560)] [KSHC] Support
Kerberized HMS in cluster mode w/o keytab
+[[KYUUBI #4585](https://github.com/apache/kyuubi/pull/4585)] [AUTHZ] Authz
policy file generation
+[[KYUUBI #4587](https://github.com/apache/kyuubi/pull/4587)] Take care of
table cache query stage
+[[KYUUBI #4592](https://github.com/apache/kyuubi/pull/4592)] Support eagerly
kill redundant executors
+[[KYUUBI #4615](https://github.com/apache/kyuubi/pull/4615)] Support stage
level schedule for final write stage
+[[KYUUBI #4617](https://github.com/apache/kyuubi/pull/4617)] [AUTHZ] Collect
results for filtered show objects ahead to prevent holding unserializable spark
plan
+[[KYUUBI #4620](https://github.com/apache/kyuubi/pull/4620)] [KSHC] Cut off
transitive dependencies
+[[KYUUBI #4636](https://github.com/apache/kyuubi/pull/4636)] Improve eagerly
kill redundant executors
+[[KYUUBI #4641](https://github.com/apache/kyuubi/pull/4641)] Add
MaxFileSizeStrategy to limit max scan file size
+[[KYUUBI #4644](https://github.com/apache/kyuubi/pull/4644)] Manually
terminate the Py4JServer during engine shutdown
+[[KYUUBI #4658](https://github.com/apache/kyuubi/pull/4658)] [AUTHZ] Fix
InsertIntoHiveDirCommand classname so that we can extract the query in it when
authorization.
+[[KYUUBI #4662](https://github.com/apache/kyuubi/pull/4662)] [ARROW] Arrow
serialization should not introduce extra shuffle for outermost limit
+[[KYUUBI #4664](https://github.com/apache/kyuubi/pull/4664)] Fix empty
relation when kill executors
+[[KYUUBI #4672](https://github.com/apache/kyuubi/pull/4672)] [AUTHZ] Remove
Support for Apache Ranger 0.6.0
+[[KYUUBI #4676](https://github.com/apache/kyuubi/pull/4676)] [AUTHZ] Reuse
users and namespaces in both tests and policy file generation
+[[KYUUBI #4677](https://github.com/apache/kyuubi/pull/4677)] [AUTHZ] Check
generated policy file in test suite
+[[KYUUBI #4678](https://github.com/apache/kyuubi/pull/4678)] Improve
FinalStageResourceManager kill executors
+[[KYUUBI #4681](https://github.com/apache/kyuubi/pull/4681)] Set thread
`CreateSparkTimeoutChecker` daemon
+[[KYUUBI #4683](https://github.com/apache/kyuubi/pull/4683)] Update
`spark.sql.finalWriteStage.resourceIsolation.enabled` version
+[[KYUUBI #4702](https://github.com/apache/kyuubi/pull/4702)] [ARROW]
CommandResultExec should not trigger job
+[[KYUUBI #4710](https://github.com/apache/kyuubi/pull/4710)] [ARROW]
LocalTableScanExec should not trigger job
+[[KYUUBI #4710](https://github.com/apache/kyuubi/pull/4710)] [ARROW] Post
driver-side metrics for LocalTableScanExec/CommandResultExec
+[[KYUUBI #4716](https://github.com/apache/kyuubi/pull/4716)] [[KYUUBI
#4715](https://github.com/apache/kyuubi/pull/4715)][AUTHZ] Fix the incorrect
class name of InsertIntoHiveDirCommand in table spec generator
+[[KYUUBI #4717](https://github.com/apache/kyuubi/pull/4717)] [AUTHZ] Check
Authz plugin's spec json files in UT
+[[KYUUBI #4720](https://github.com/apache/kyuubi/pull/4720)] [ARROW] Fix
java.lang.NoSuchFieldError: IpcOption.DEFAULT for Spark-3.1/3.2
+[[KYUUBI #4741](https://github.com/apache/kyuubi/pull/4741)] Kyuubi Spark
Engine/TPC connectors support Spark 3.4
+[[KYUUBI #4754](https://github.com/apache/kyuubi/pull/4754)] [ARROW] Use
`KyuubiArrowConverters#toBatchIterator` instead of
`ArrowConverters#toBatchIterator`
+[[KYUUBI #4797](https://github.com/apache/kyuubi/pull/4797)] [ARROW]
Reflective calls to the function `ArrowUtils#toArrowSchema`
+[[KYUUBI #4812](https://github.com/apache/kyuubi/pull/4812)] Generalize case
transformation method for string type config entry
+[[KYUUBI #4834](https://github.com/apache/kyuubi/pull/4834)] Reduce the scope
of method references in Authz plugin cleanup shutdown hook
+[[KYUUBI #4838](https://github.com/apache/kyuubi/pull/4838)] Fix spark
operation exception leak in `withLocalProperties` method
+[[KYUUBI #4866](https://github.com/apache/kyuubi/pull/4866)] Add annotation
for Iceberg tests in Authz plugin
+[[KYUUBI #4869](https://github.com/apache/kyuubi/pull/4869)] [AUTHZ] Introduce
table extractor for ResolvedIdentifier in Spark 3.4
+[[KYUUBI #4871](https://github.com/apache/kyuubi/pull/4871)] [AUTHZ] Adapt
plan changes for CreateNamespace and SetCatalogAndNamespace in Spark 3.4
+[[KYUUBI #4873](https://github.com/apache/kyuubi/pull/4873)] [AUTHZ] Refactor
Authz reflection with kyuubi-util's DynMethods
+[[KYUUBI #4874](https://github.com/apache/kyuubi/pull/4874)] [AUTHZ] Improve
methods in AuthzUtils
+[[KYUUBI #4875](https://github.com/apache/kyuubi/pull/4875)] [AUTHZ] Remove
checking Spark v2 in tests since Spark v2 not supported
+[[KYUUBI #4878](https://github.com/apache/kyuubi/pull/4878)] Delta support for
Spark-3.4
+[[KYUUBI #4880](https://github.com/apache/kyuubi/pull/4880)] [BUILD] Skip
compiling useless files when making distribution
+[[KYUUBI #4888](https://github.com/apache/kyuubi/pull/4888)] [AUTHZ] Remove
filtering results for ShowDatabasesCommand in Spark 2.x
+[[KYUUBI #4892](https://github.com/apache/kyuubi/pull/4892)] [AUTHZ] Make
identifier part name comparison case insensitive in tests of PrivilegeBuilder
+[[KYUUBI #4895](https://github.com/apache/kyuubi/pull/4895)] [ARROW]
Reflective calls to the function `ArrowConverters#fromBatchIterator`
+[[KYUUBI #4899](https://github.com/apache/kyuubi/pull/4899)] [AUTHZ] Extract
function from FunctionIdentifier for CreateFunction and DropFunction in Spark
3.4
+[[KYUUBI #4903](https://github.com/apache/kyuubi/pull/4903)] [AUTHZ] Fix
NoSuchElementException when listing database in CatalogImpl in Spark 3.4
+[[KYUUBI #4909](https://github.com/apache/kyuubi/pull/4909)] [AUTHZ] Enable
authz plugin tests for Spark 3.4
+[[KYUUBI #4910](https://github.com/apache/kyuubi/pull/4910)] Extract table
from ResolvedIdentifier for DropTable in Spark 3.4
+[[KYUUBI #4913](https://github.com/apache/kyuubi/pull/4913)] Eliminate
unnecessary output in ut "union an unmasked table"
+[[KYUUBI #4914](https://github.com/apache/kyuubi/pull/4914)] [AUTHZ] Reuse
extractor singleton instance with generalized getter for supported extractor
types
+[[KYUUBI #4915](https://github.com/apache/kyuubi/pull/4915)] Adapt database
not exist error message change for Spark 3.4
+[[KYUUBI #4916](https://github.com/apache/kyuubi/pull/4916)] [AUTHZ] Support
ReplaceData and compatible Spark 3.4 and 3.5
+[[KYUUBI #4916](https://github.com/apache/kyuubi/pull/4916)] Fix Iceberg merge
into UT
+[[KYUUBI #4917](https://github.com/apache/kyuubi/pull/4917)] [AUTHZ] Table
owner undefined in Iceberg 1.3.0 on Spark 3.4
+[[KYUUBI #4923](https://github.com/apache/kyuubi/pull/4923)] [ARROW] Update
arguments of `ArrowUtils#toArrowSchema` function
+[[KYUUBI #4925](https://github.com/apache/kyuubi/pull/4925)] Add default
catalog using `spark_catalog` with the lineage result
+[[KYUUBI #4935](https://github.com/apache/kyuubi/pull/4935)] More than target
num of executors may survive after FinalStageResourceManager did kill
+[[KYUUBI #4937](https://github.com/apache/kyuubi/pull/4937)] Cleanup spark
catalog shim and renamed to catalog utils
+[[KYUUBI #4952](https://github.com/apache/kyuubi/pull/4952)] Enhance AWS Glue
default database does not exist error message on opening session
+[[KYUUBI #4995](https://github.com/apache/kyuubi/pull/4995)] Use hadoop conf
and hive conf from catalog options
+[[KYUUBI #4999](https://github.com/apache/kyuubi/pull/4999)] [KSHC]
Kyuubi-Spark-Hive-Connector support Apache Spark 3.4
+[[KYUUBI #5002](https://github.com/apache/kyuubi/pull/5002)] Fail the engine
fast when no incoming connection in CONNECTION mode
+[[KYUUBI #5005](https://github.com/apache/kyuubi/pull/5005)] Remove default
settings `spark.sql.execution.topKSortFallbackThreshold`
+[[KYUUBI #5007](https://github.com/apache/kyuubi/pull/5007)] Remove blank
SparkSimpleStatsReportListener
+[[KYUUBI #5009](https://github.com/apache/kyuubi/pull/5009)] Pass Spark Engine
Log Path to Spark Conf
+[[KYUUBI #5017](https://github.com/apache/kyuubi/pull/5017)] [KSHC] Support
Parquet/Orc provider is splittable
+[[KYUUBI #5018](https://github.com/apache/kyuubi/pull/5018)] Make kyuubi spark
extension compatible with Spark 3.4
+[[KYUUBI #5022](https://github.com/apache/kyuubi/pull/5022)] [KSHC]
CreateTable should use the correct provider
+[[KYUUBI #5023](https://github.com/apache/kyuubi/pull/5023)] [KSHC]
TableIdentify don't attach catalog
+[[KYUUBI #5025](https://github.com/apache/kyuubi/pull/5025)] Use
formatDuration instead of formatDurationVerbose in Spark UI's engine tab
+[[KYUUBI #5028](https://github.com/apache/kyuubi/pull/5028)] Update session
hadoop conf to catalog hadoop conf
+[[KYUUBI #5030](https://github.com/apache/kyuubi/pull/5030)] Support get query
id in Spark engine
+[[KYUUBI #5035](https://github.com/apache/kyuubi/pull/5035)] Spark engine
session page display session end time and duration
+[[KYUUBI #5045](https://github.com/apache/kyuubi/pull/5045)] Initialize
EXECUTOR_POD_NAME_PREFIX_MAX_LENGTH before using
+[[KYUUBI #5055](https://github.com/apache/kyuubi/pull/5055)] [AUTHZ] Support
building function privileges in Spark 3.4
+[[KYUUBI #5073](https://github.com/apache/kyuubi/pull/5073)] Correct the
method name in SparkSQLLineageParserHelperSuite
+[[KYUUBI #5075](https://github.com/apache/kyuubi/pull/5075)] Refine tests to
adapt Spark 4.0
+[[KYUUBI #5076](https://github.com/apache/kyuubi/pull/5076)] Add KDF engine_url
+[[KYUUBI #5105](https://github.com/apache/kyuubi/pull/5105)] GetColumns gets
duplicate column names when Spark integrates with Iceberg
+[[KYUUBI #5136](https://github.com/apache/kyuubi/pull/5136)] Spark App may
hang forever if FinalStageResourceManager killed all executors
+[[KYUUBI #5148](https://github.com/apache/kyuubi/pull/5148)] Improve
spark.driver.host assignment in Spark on K8s client mode
+[[KYUUBI #5170](https://github.com/apache/kyuubi/pull/5170)] Identifier
compatible with Spark 3.4
+[[KYUUBI #5172](https://github.com/apache/kyuubi/pull/5172)] [AUTHZ] Check USE
permissions for DESCRIBE FUNCTION
+[[KYUUBI #5180](https://github.com/apache/kyuubi/pull/5180)] Replace
deprecated classes by equivalent in scala.tools.nsc.interpreter package
+[[KYUUBI #5184](https://github.com/apache/kyuubi/pull/5184)] Rename Kyuubi's
StageInfo to SparkStageInfo to fix class mismatch
+[[KYUUBI #5188](https://github.com/apache/kyuubi/pull/5188)] Make server
module and Spark sql engine module compilable on Scala 2.13
+[[KYUUBI #5189](https://github.com/apache/kyuubi/pull/5189)] [AUTHZ] Make
spark authz module compilable on Scala 2.13
+[[KYUUBI #5191](https://github.com/apache/kyuubi/pull/5191)] Make Spark
extension plugin compilable on Scala 2.13
+[[KYUUBI #5192](https://github.com/apache/kyuubi/pull/5192)] Make Spark sql
lineage plugin compilable on Scala 2.13
+[[KYUUBI #5193](https://github.com/apache/kyuubi/pull/5193)] Make Spark hive
connector plugin compilable on Scala 2.13
+[[KYUUBI #5195](https://github.com/apache/kyuubi/pull/5195)] Make Spark TPC-H
connector plugin compilable on Scala 2.13
+[[KYUUBI #5196](https://github.com/apache/kyuubi/pull/5196)] Enable CI Test on
Scala 2.13 and support custom or spark-core extracted Scala version for Spark's
engine
+[[KYUUBI #5196](https://github.com/apache/kyuubi/pull/5196)] Extract spark
core scala version lazily and respect engine env
+[[KYUUBI #5199](https://github.com/apache/kyuubi/pull/5199)] Read all columns
of metadata to prevent column missing
+[[KYUUBI #5202](https://github.com/apache/kyuubi/pull/5202)] Switch to Spark
3.4 by default
+[[KYUUBI #5224](https://github.com/apache/kyuubi/pull/5224)] Modify the README
file of authz to make spark 3.4 the default version
+[[KYUUBI #5225](https://github.com/apache/kyuubi/pull/5225)] [KSHC] Unify the
exception handling of v1 and v2 during dropDatabase
+[[KYUUBI #5232](https://github.com/apache/kyuubi/pull/5232)] In
SparkOperation#cleanup always calls cancelJobGroup even though it's in the
completed state
+[[KYUUBI #5257](https://github.com/apache/kyuubi/pull/5257)] [LINEAGE] Adapt
`CreateTableAsSelect` plan to Spark 3.5 changes
+[[KYUUBI #5268](https://github.com/apache/kyuubi/pull/5268)] [AUTHZ] Extract
method for enabling authorization in single call mode
+[[KYUUBI #5269](https://github.com/apache/kyuubi/pull/5269)] Duplicated
AnalyzesTablesCommand in kyuubi authz
+[[KYUUBI #5271](https://github.com/apache/kyuubi/pull/5271)]
AnalyzeTableCommand should also add table write privilege
+[[KYUUBI #5291](https://github.com/apache/kyuubi/pull/5291)] Verify Spark
engine is compatible with Spark 3.5.0
+[[KYUUBI #5317](https://github.com/apache/kyuubi/pull/5317)] [KSHC] Hive
Connector throws NotSerializableException on reading Hive Avro partitioned table
+[[KYUUBI #5336](https://github.com/apache/kyuubi/pull/5336)] Spark extension
supports Spark 3.5
+[[KYUUBI #5339](https://github.com/apache/kyuubi/pull/5339)] Avoid using
`kyuubi.session.engine.initialize.timeout` string
+[[KYUUBI #5414](https://github.com/apache/kyuubi/pull/5414)] [KSHC] Reader
should not pollute the global hiveConf instance
+[[KYUUBI #5426](https://github.com/apache/kyuubi/pull/5426)] [KSHC] Avoid use
class.newInstance directly
+[[KYUUBI #5550](https://github.com/apache/kyuubi/pull/5550)] Optimizing TPC-DS
dataset generation for 10x speedup
+
+### Flink Engine
+
+[[KYUUBI #1652](https://github.com/apache/kyuubi/pull/1652)] Support Flink
YARN application mode
+[[KYUUBI #4367](https://github.com/apache/kyuubi/pull/4367)] Support Flink 1.17
+[[KYUUBI #4387](https://github.com/apache/kyuubi/pull/4387)] Remove support
for Flink 1.14
+[[KYUUBI #4446](https://github.com/apache/kyuubi/pull/4446)] Fix connections
blocked by Flink insert statements
+[[KYUUBI #4495](https://github.com/apache/kyuubi/pull/4495)] Support Flink job
management statements
+[[KYUUBI #4517](https://github.com/apache/kyuubi/pull/4517)] Fix multiple
executions lead to abnormal results on Flink 1.14
+[[KYUUBI #4635](https://github.com/apache/kyuubi/pull/4635)] Support flink
time type in query operation
+[[KYUUBI #4666](https://github.com/apache/kyuubi/pull/4666)] Support flink
varbinary type in query operation
+[[KYUUBI #4745](https://github.com/apache/kyuubi/pull/4745)] Support Flink's
LocalZonedTimestamp DataType
+[[KYUUBI #4806](https://github.com/apache/kyuubi/pull/4806)] Support time-out
incremental result fetch for Flink engine
+[[KYUUBI #4861](https://github.com/apache/kyuubi/pull/4861)] Support Flink
session idleness
+[[KYUUBI #4938](https://github.com/apache/kyuubi/pull/4938)] Implement Kyuubi
UDF in Flink engine
+[[KYUUBI #5080](https://github.com/apache/kyuubi/pull/5080)] Fix
EmbeddedExecutorFactory not thread-safe during bootstrap
+[[KYUUBI #5106](https://github.com/apache/kyuubi/pull/5106)] Improve logs for
fatal errors
+[[KYUUBI #5108](https://github.com/apache/kyuubi/pull/5108)] Fix
FileNotFoundException during Flink engine bootstrap
+[[KYUUBI #5160](https://github.com/apache/kyuubi/pull/5160)] Refactor
getNextRowSetInternal to support fetch streaming data
+[[KYUUBI #5190](https://github.com/apache/kyuubi/pull/5190)] Explicitly name
Flink bootstrap SQL in application mode
+[[KYUUBI #5200](https://github.com/apache/kyuubi/pull/5200)] Optimize Flink
application name generating
+[[KYUUBI #5222](https://github.com/apache/kyuubi/pull/5222)] Remove unused
provided dependencies in Flink SQL engine
+[[KYUUBI #5238](https://github.com/apache/kyuubi/pull/5238)] Fix credentials
may break Flink engine launch command
+[[KYUUBI #5315](https://github.com/apache/kyuubi/pull/5315)] Propagate
HIVE_CONF_DIR on launching Flink engine
+[[KYUUBI #5405](https://github.com/apache/kyuubi/pull/5405)] Support Flink 1.18
+[[KYUUBI #5531](https://github.com/apache/kyuubi/pull/5531)] Fix flaky
FlinkOperationOnYarnSuite by enlarging the max rows setting
+
+### Other Engines
+
+[[KYUUBI #3374](https://github.com/apache/kyuubi/pull/3374)] Support password
authentication for Trino engine
+[[KYUUBI #4412](https://github.com/apache/kyuubi/pull/4412)] Align the
server/engine session handle for flink/hive/trino/jdbc engines
+[[KYUUBI #4491](https://github.com/apache/kyuubi/pull/4491)] Fix Trino typo
+[[KYUUBI #4522](https://github.com/apache/kyuubi/pull/4522)] `use:catalog`
should execute before than `use:database`
+[[KYUUBI #4544](https://github.com/apache/kyuubi/pull/4544)] Initial implement
Kyuubi Chat Engine
+[[KYUUBI #4548](https://github.com/apache/kyuubi/pull/4548)] Kyuubi Chat
Engine supports Chinese questions and HTTP proxy
+[[KYUUBI #4554](https://github.com/apache/kyuubi/pull/4554)] Code improvement
in ChatGPTProvider
+[[KYUUBI #4556](https://github.com/apache/kyuubi/pull/4556)] Refactor
ChatGPTProvider to use `openai-java` client
+[[KYUUBI #4558](https://github.com/apache/kyuubi/pull/4558)] Make ChatGPT
model ID configurable
+[[KYUUBI #4559](https://github.com/apache/kyuubi/pull/4559)] Pretty chat
engine launch command
+[[KYUUBI #4711](https://github.com/apache/kyuubi/pull/4711)] JDBC client
should catch task failed exception instead of NPE in the incremental mode
+[[KYUUBI #4809](https://github.com/apache/kyuubi/pull/4809)] Set session user
in ChatGPT request
+[[KYUUBI #4810](https://github.com/apache/kyuubi/pull/4810)] Request and use a
single choice for chat completion
+[[KYUUBI #4881](https://github.com/apache/kyuubi/pull/4881)] JDBCEngine
performs initialization sql
+[[KYUUBI #4940](https://github.com/apache/kyuubi/pull/4940)] Implement Kyuubi
UDF in Hive engine
+[[KYUUBI #5120](https://github.com/apache/kyuubi/pull/5120)] Allow using
session's user and password for connecting database in JDBC engine
+[[KYUUBI #5282](https://github.com/apache/kyuubi/pull/5282)] Support configure
Trino session conf in `kyuubi-default.conf`
+[[KYUUBI #5333](https://github.com/apache/kyuubi/pull/5333)] Adaptive call
fetchLaunchEngineResult
+[[KYUUBI #5570](https://github.com/apache/kyuubi/pull/5570)] Fix memory leak
when using incremental collect mode in JDBC engine
+
+### Server
+
+[[KYUUBI #3653](https://github.com/apache/kyuubi/pull/3653)] AdminResource add
list Kyuubi server api
+[[KYUUBI #3739](https://github.com/apache/kyuubi/pull/3739)] Remove unused
parameters in SessionsResource rest docs
+[[KYUUBI #3872](https://github.com/apache/kyuubi/pull/3872)] Skip setting
proxy user when keytab is provided on batch session
+[[KYUUBI #3876](https://github.com/apache/kyuubi/pull/3876)] Update the rest
api docs for open session response
+[[KYUUBI #3920](https://github.com/apache/kyuubi/pull/3920)] Fix flaky test -
distribute lock
+[[KYUUBI #3957](https://github.com/apache/kyuubi/pull/3957)] Rename the config
prefix from kyuubi.server.batch.limit to kyuubi.server.limit.batch
+[[KYUUBI #4325](https://github.com/apache/kyuubi/pull/4325)] Support replace
preparedStatement for Trino-jdbc
+[[KYUUBI #4344](https://github.com/apache/kyuubi/pull/4344)] Expose exec pool
work queue size metrics
+[[KYUUBI #4364](https://github.com/apache/kyuubi/pull/4364)] Add metrics for
user opened connections with session type
+[[KYUUBI #4376](https://github.com/apache/kyuubi/pull/4376)] Support to config
the Kyuubi service administrator with Kyuubi conf
+[[KYUUBI #4388](https://github.com/apache/kyuubi/pull/4388)] Limit the max
rows for get nextRowSet api
+[[KYUUBI #4404](https://github.com/apache/kyuubi/pull/4404)] Support to
list/close sessions in AdminResource
+[[KYUUBI #4407](https://github.com/apache/kyuubi/pull/4407)] Adapt SLF4J2
+[[KYUUBI #4424](https://github.com/apache/kyuubi/pull/4424)] Catch No Node
Exception, when list kyuubi engines
+[[KYUUBI #4439](https://github.com/apache/kyuubi/pull/4439)] Add list/close
operation method for AdminResource
+[[KYUUBI #4462](https://github.com/apache/kyuubi/pull/4462)] Fix variable
usage issue in `SessionManager#stop`
+[[KYUUBI #4464](https://github.com/apache/kyuubi/pull/4464)] Simplify and
improve log for JDBCMetadataStore
+[[KYUUBI #4467](https://github.com/apache/kyuubi/pull/4467)] Tolerate Driver
Pod ephemerally invisible after submitting
+[[KYUUBI #4472](https://github.com/apache/kyuubi/pull/4472)] add
session/operation methods in AdminRestApi
+[[KYUUBI #4480](https://github.com/apache/kyuubi/pull/4480)] Engine alive
probe should close thrift connection on engine lost
+[[KYUUBI #4482](https://github.com/apache/kyuubi/pull/4482)] Support to
disable batch resource upload function
+[[KYUUBI #4483](https://github.com/apache/kyuubi/pull/4483)] Enable REST
frontend protocol by default
+[[KYUUBI #4496](https://github.com/apache/kyuubi/pull/4496)] Call
`super.clusterManager()` when `batchConf` does not have `spark.master`
+[[KYUUBI #4498](https://github.com/apache/kyuubi/pull/4498)] Support to list
sessions/operations with conditions in AdminRestApi
+[[KYUUBI #4501](https://github.com/apache/kyuubi/pull/4501)] Allow
administrator to specify the user for engine admin
+[[KYUUBI #4506](https://github.com/apache/kyuubi/pull/4506)] Return
sessionType in session data
+[[KYUUBI #4516](https://github.com/apache/kyuubi/pull/4516)] Return kyuubi
instance in SessionData and OperationData
+[[KYUUBI #4518](https://github.com/apache/kyuubi/pull/4518)] Return engine id
in SessionData and post kyuubi instance in KyuubiOperationEvent
+[[KYUUBI #4519](https://github.com/apache/kyuubi/pull/4519)] Update metadata
when batch application state changed
+[[KYUUBI #4523](https://github.com/apache/kyuubi/pull/4523)] support close
engine session gracefully
+[[KYUUBI #4526](https://github.com/apache/kyuubi/pull/4526)] Defer evaluation
for GroupProvider
+[[KYUUBI #4540](https://github.com/apache/kyuubi/pull/4540)] Support to deny
some users to make connection
+[[KYUUBI #4540](https://github.com/apache/kyuubi/pull/4540)] Create session
limiter if user unlimited list or deny list nonempty
+[[KYUUBI #4563](https://github.com/apache/kyuubi/pull/4563)] Format error log
output in case of metrics json file not found
+[[KYUUBI #4575](https://github.com/apache/kyuubi/pull/4575)] Fix the empty
last line may causes the session to exit directly
+[[KYUUBI #4579](https://github.com/apache/kyuubi/pull/4579)] Fix the unstable
situation of test cases for Trino-Fronted-Service
+[[KYUUBI #4584](https://github.com/apache/kyuubi/pull/4584)] Post the session
exception to EventBus in time
+[[KYUUBI #4594](https://github.com/apache/kyuubi/pull/4594)] Support PUT
method in REST client
+[[KYUUBI #4611](https://github.com/apache/kyuubi/pull/4611)] support all
sessions api in SessionRestApi
+[[KYUUBI #4618](https://github.com/apache/kyuubi/pull/4618)] Admin Resource
list operations with sessionHandle filter
+[[KYUUBI #4623](https://github.com/apache/kyuubi/pull/4623)]
KubernetesApplicationOperation uses Informer instead of list
+[[KYUUBI #4639](https://github.com/apache/kyuubi/pull/4639)] Support to
specify confOverlay when executing statement with RESTful API
+[[KYUUBI #4652](https://github.com/apache/kyuubi/pull/4652)] Fix
JaasConfiguration ClassNotFoundException for Hadoop 3.3.4 and previous
+[[KYUUBI #4653](https://github.com/apache/kyuubi/pull/4653)] [KYUUBI 4650]
LogDivertAppender supports reading RollingFileAppender pattern
+[[KYUUBI #4669](https://github.com/apache/kyuubi/pull/4669)] LDAP
authentication allows auth user contains domain when bind.dn/pw enabled
+[[KYUUBI #4688](https://github.com/apache/kyuubi/pull/4688)] Fix the failure
to read the operation log after executing catalog and database operation
+[[KYUUBI #4691](https://github.com/apache/kyuubi/pull/4691)] Configure
FAIL_ON_UNKNOWN_PROPERTIES to false for KyuubiScalaObjectMapper
+[[KYUUBI #4713](https://github.com/apache/kyuubi/pull/4713)] Fix false
positive result in SchedulerPoolSuite
+[[KYUUBI #4719](https://github.com/apache/kyuubi/pull/4719)] Support
submission timeout for yarn application manager and get the applicationInfo
in-memory
+[[KYUUBI #4731](https://github.com/apache/kyuubi/pull/4731)] Support batch
session conf advisor
+[[KYUUBI #4733](https://github.com/apache/kyuubi/pull/4733)] Introduce Kafka
event logger for server events
+[[KYUUBI #4738](https://github.com/apache/kyuubi/pull/4738)]
`AdminResource.getEngineSpace` should use primary group name on GROUP share
level
+[[KYUUBI #4739](https://github.com/apache/kyuubi/pull/4739)] Add operation
lock instead of locking state Enumeration
+[[KYUUBI #4746](https://github.com/apache/kyuubi/pull/4746)] Do not recreate
async request executor if has been shutdown
+[[KYUUBI #4749](https://github.com/apache/kyuubi/pull/4749)] Fix flaky test
issues in SchedulerPoolSuite
+[[KYUUBI #4753](https://github.com/apache/kyuubi/pull/4753)] KyuubiConf.unset
should not log deprecation warning
+[[KYUUBI #4767](https://github.com/apache/kyuubi/pull/4767)] Correct the
submit time for BatchJobSubmission and check applicationInfo if submitted
application
+[[KYUUBI #4777](https://github.com/apache/kyuubi/pull/4777)] Deregister event
handlers when stopping server with event handler made auto-closeable
+[[KYUUBI #4780](https://github.com/apache/kyuubi/pull/4780)] Get engine
application info with interval to prevent frequent call to resource manager
+[[KYUUBI #4786](https://github.com/apache/kyuubi/pull/4786)] Support
yarn-client and yarn-cluster for YarnApplicationOperation
+[[KYUUBI #4790](https://github.com/apache/kyuubi/pull/4790)] Initial implement
Batch V2
+[[KYUUBI #4791](https://github.com/apache/kyuubi/pull/4791)] Add helper method
to simplify REST enabled judgment
+[[KYUUBI #4792](https://github.com/apache/kyuubi/pull/4792)] Enhance hardcode
session keywords and remove unused code
+[[KYUUBI #4796](https://github.com/apache/kyuubi/pull/4796)] Expose JVM
attributes to metrics
+[[KYUUBI #4798](https://github.com/apache/kyuubi/pull/4798)] Allows
BatchJobSubmission to run in sync mode
+[[KYUUBI #4801](https://github.com/apache/kyuubi/pull/4801)] Using different
engine submit timeout config for kubernetes and yarn
+[[KYUUBI #4807](https://github.com/apache/kyuubi/pull/4807)] Fix flaky test
"basic batch rest client"
+[[KYUUBI #4807](https://github.com/apache/kyuubi/pull/4807)] Retry more times
to fix flaky test "spnego batch rest client"
+[[KYUUBI #4811](https://github.com/apache/kyuubi/pull/4811)] Do not update app
info after batch or application terminated
+[[KYUUBI #4813](https://github.com/apache/kyuubi/pull/4813)] Add the fetch
orientation parameter to the /v1/operations/:operationId/log interface
+[[KYUUBI #4814](https://github.com/apache/kyuubi/pull/4814)] Introduce Apache
Atlas hook support in lineage plugin
+[[KYUUBI #4816](https://github.com/apache/kyuubi/pull/4816)] Correct the
implementation of cleanup K8s terminated appInfo
+[[KYUUBI #4829](https://github.com/apache/kyuubi/pull/4829)] Support to expose
operation metrics
+[[KYUUBI #4830](https://github.com/apache/kyuubi/pull/4830)] Fix flaky test
"support to interrupt the thrift request if remote engine is broken"
+[[KYUUBI #4835](https://github.com/apache/kyuubi/pull/4835)] Using hive conf
to check whether to apply HIVE_DELEGATION_TOKEN
+[[KYUUBI #4836](https://github.com/apache/kyuubi/pull/4836)] Set
UncaughtExceptionHandler for thread to log exception
+[[KYUUBI #4840](https://github.com/apache/kyuubi/pull/4840)] Return cached
appInfo iif both op and app are terminated
+[[KYUUBI #4841](https://github.com/apache/kyuubi/pull/4841)] Log more info for
closing session
+[[KYUUBI #4842](https://github.com/apache/kyuubi/pull/4842)] Fix typo in etcd
client config
+[[KYUUBI #4843](https://github.com/apache/kyuubi/pull/4843)] Support multiple
kubernetes contexts and namespaces
+[[KYUUBI #4847](https://github.com/apache/kyuubi/pull/4847)] Close the session
immediately when engine corrupt
+[[KYUUBI #4847](https://github.com/apache/kyuubi/pull/4847)] Close the session
immediately when engine connection closed
+[[KYUUBI #4850](https://github.com/apache/kyuubi/pull/4850)] Change default EC
spec to secp521r1 for internal session variable signature
+[[KYUUBI #4855](https://github.com/apache/kyuubi/pull/4855)] Change socket
"connection refused" message match pattern
+[[KYUUBI #4857](https://github.com/apache/kyuubi/pull/4857)] Fix flaky test
TFrontendServiceSuite
+[[KYUUBI #4858](https://github.com/apache/kyuubi/pull/4858)] Relax test
message assertion in "sync query causes engine crash"
+[[KYUUBI #4859](https://github.com/apache/kyuubi/pull/4859)] HttpException
message should not be null
+[[KYUUBI #4865](https://github.com/apache/kyuubi/pull/4865)] Fix flaky test
BackendServiceMetricSuite
+[[KYUUBI #4876](https://github.com/apache/kyuubi/pull/4876)] fix Flaky test
BackendServiceMetricSuite (#4924)
+[[KYUUBI #4889](https://github.com/apache/kyuubi/pull/4889)] Admin command
line supports list server command
+[[KYUUBI #4890](https://github.com/apache/kyuubi/pull/4890)] Return operation
metrics in OperationData and fix typo
+[[KYUUBI #4893](https://github.com/apache/kyuubi/pull/4893)] Prevent null
collection for rest dto
+[[KYUUBI #4898](https://github.com/apache/kyuubi/pull/4898)] Fix logOperation
multiple read with missing line
+[[KYUUBI #4919](https://github.com/apache/kyuubi/pull/4919)] Fix the flaky
tests in the "open batch session" functionality within the
"BatchesResourceSuite"
+[[KYUUBI #4920](https://github.com/apache/kyuubi/pull/4920)] Add
OperationRestApi
+[[KYUUBI #4946](https://github.com/apache/kyuubi/pull/4946)] Alter the order
of initLoggerEventHandler
+[[KYUUBI #4949](https://github.com/apache/kyuubi/pull/4949)] For operation
getNextRowSet method, with operation lock required
+[[KYUUBI #4950](https://github.com/apache/kyuubi/pull/4950)] Migrate Kyuubi
embedded database from Derby to SQLite
+[[KYUUBI #4950](https://github.com/apache/kyuubi/pull/4950)] Misc improvement
for usage of SQLite
+[[KYUUBI #4950](https://github.com/apache/kyuubi/pull/4950)] SQLite schema
files should start from 1.8.0
+[[KYUUBI #4951](https://github.com/apache/kyuubi/pull/4951)] Add reload4j
support
+[[KYUUBI #4977](https://github.com/apache/kyuubi/pull/4977)] Log error message
when REST API invocation error occurs
+[[KYUUBI #4978](https://github.com/apache/kyuubi/pull/4978)] Fix flaky test:
close expired operations
+[[KYUUBI #4978](https://github.com/apache/kyuubi/pull/4978)] Fix flaky test:
close expired operations
+[[KYUUBI #4979](https://github.com/apache/kyuubi/pull/4979)] Fix flaky test:
support to interrupt the thrift request if remote engine is broken
+[[KYUUBI #4981](https://github.com/apache/kyuubi/pull/4981)] Refactor code of
closeBatchSession
+[[KYUUBI #4985](https://github.com/apache/kyuubi/pull/4985)] Fix log level
restore behavior of `KyuubiFunSuite#withLogAppender`
+[[KYUUBI #4986](https://github.com/apache/kyuubi/pull/4986)] Always use
Files#deleteIfExists
+[[KYUUBI #4994](https://github.com/apache/kyuubi/pull/4994)] Respect the
engine type and share level for listing all engines
+[[KYUUBI #4994](https://github.com/apache/kyuubi/pull/4994)] Support listing
all engines
+[[KYUUBI #4996](https://github.com/apache/kyuubi/pull/4996)] Support to
refresh kubernetes configs dynamically
+[[KYUUBI #5004](https://github.com/apache/kyuubi/pull/5004)] Fix typo for
kubernetes allowed context and namespace check
+[[KYUUBI #5010](https://github.com/apache/kyuubi/pull/5010)] Make Kyuubi
server's connection URL configurable
+[[KYUUBI #5029](https://github.com/apache/kyuubi/pull/5029)] Close the alive
probe session after engine session closed
+[[KYUUBI #5036](https://github.com/apache/kyuubi/pull/5036)] Fix
Operation.close not update complete timestamp
+[[KYUUBI #5043](https://github.com/apache/kyuubi/pull/5043)] Destroy the build
process when waitCompletion is false and the engine is running in cluster mode
+[[KYUUBI #5050](https://github.com/apache/kyuubi/pull/5050)] Add admin
checking in `getProxyUser`
+[[KYUUBI #5056](https://github.com/apache/kyuubi/pull/5056)] Return more
helpful error message to http client
+[[KYUUBI #5063](https://github.com/apache/kyuubi/pull/5063)] Support to filter
batch with batch name
+[[KYUUBI #5065](https://github.com/apache/kyuubi/pull/5065)] Call destroy
first on killing Spark startup process to allows it release temp files
+[[KYUUBI #5065](https://github.com/apache/kyuubi/pull/5065)] Graceful close
the process when launch engine timeout
+[[KYUUBI #5078](https://github.com/apache/kyuubi/pull/5078)] Make
`kyuubi_instance` nullable in metadata table schema
+[[KYUUBI #5081](https://github.com/apache/kyuubi/pull/5081)] Minor refactor
JDBCMetadataStore
+[[KYUUBI #5089](https://github.com/apache/kyuubi/pull/5089)] Limit maximum
engine startup concurrency of kyuubi server
+[[KYUUBI #5130](https://github.com/apache/kyuubi/pull/5130)] Allow setting
Zookeeper SPN using Kyuubi configuration
+[[KYUUBI #5131](https://github.com/apache/kyuubi/pull/5131)] Create index on
`metastore`.`create_time`
+[[KYUUBI #5138](https://github.com/apache/kyuubi/pull/5138)] Fix flaky test
BatchesResourceSuite - get batch session list
+[[KYUUBI #5145](https://github.com/apache/kyuubi/pull/5145)] Change embedded
Zookeeper server to method-local variable
+[[KYUUBI #5158](https://github.com/apache/kyuubi/pull/5158)] Allow embedded
Zookeeper binding IP address
+[[KYUUBI #5165](https://github.com/apache/kyuubi/pull/5165)] Build Spark
Driver/Executor Pod Name(Prefix) in process
+[[KYUUBI #5185](https://github.com/apache/kyuubi/pull/5185)] Use Set
collection for order-insensitive configs
+[[KYUUBI #5187](https://github.com/apache/kyuubi/pull/5187)] Fix info message
in UserFilter
+[[KYUUBI #5196](https://github.com/apache/kyuubi/pull/5196)] Extract spark
core scala version lazily and respect engine env
+[[KYUUBI #5201](https://github.com/apache/kyuubi/pull/5201)] Allow disabling
batch impl v2 on globally
+[[KYUUBI #5204](https://github.com/apache/kyuubi/pull/5204)] Thrift HTTP FE
checks req conf nullable before evaluating proxy user
+[[KYUUBI #5206](https://github.com/apache/kyuubi/pull/5206)] Try to kill pod
with label if no ApplicationInfo found to prevent pod leak
+[[KYUUBI #5210](https://github.com/apache/kyuubi/pull/5210)] Cancel operation
will cause the log file node to leak
+[[KYUUBI #5213](https://github.com/apache/kyuubi/pull/5213)] Check config
value by enum values
+[[KYUUBI #5216](https://github.com/apache/kyuubi/pull/5216)] Workaround for
negative counter in SessionLimiter
+[[KYUUBI #5218](https://github.com/apache/kyuubi/pull/5218)] Improve logs of
KubernetesApplicationOperation
+[[KYUUBI #5220](https://github.com/apache/kyuubi/pull/5220)] Batch submitter
should only block submitting stage
+[[KYUUBI #5220](https://github.com/apache/kyuubi/pull/5220)] Batch submitted
considers application state
+[[KYUUBI #5243](https://github.com/apache/kyuubi/pull/5243)] Distinguish
metadata between batch impl v2 and recovery
+[[KYUUBI #5289](https://github.com/apache/kyuubi/pull/5289)] RESTful API
should always print audit log
+[[KYUUBI #5290](https://github.com/apache/kyuubi/pull/5290)] Batch impl v2
should pick batch jobs in FIFO
+[[KYUUBI #5300](https://github.com/apache/kyuubi/pull/5300)] Batch v2 should
not update kyuubi_instance when open session
+[[KYUUBI #5305](https://github.com/apache/kyuubi/pull/5305)] Return dummy log
when batch job before being added to session manager
+[[KYUUBI #5306](https://github.com/apache/kyuubi/pull/5306)]
YarnApplicationOperation supports proxy user
+[[KYUUBI #5310](https://github.com/apache/kyuubi/pull/5310)] Batch session
recovery should start after HTTP server getting started
+[[KYUUBI #5327](https://github.com/apache/kyuubi/pull/5327)] Add priority
field in batch session metadata table definition
+[[KYUUBI #5328](https://github.com/apache/kyuubi/pull/5328)] Batch supports
priority scheduling
+[[KYUUBI #5340](https://github.com/apache/kyuubi/pull/5340)]
AdminResourceSuite make engine idle time 3min
+[[KYUUBI #5380](https://github.com/apache/kyuubi/pull/5380)] Create PySpark
batch jobs tests for RESTful API
+[[KYUUBI #5381](https://github.com/apache/kyuubi/pull/5381)] Change the
default metrics reporter to Prometheus
+[[KYUUBI #5391](https://github.com/apache/kyuubi/pull/5391)] Close batch
session after batch operation completion for idle timeout
+[[KYUUBI #5392](https://github.com/apache/kyuubi/pull/5392)] Add query timeout
monitor on server-side in ExecuteStatement
+[[KYUUBI #5408](https://github.com/apache/kyuubi/pull/5408)] MetadataManager
tries MySQL 8 driver class first
+[[KYUUBI #5412](https://github.com/apache/kyuubi/pull/5412)] Resolve the
relative zk configuration dir based on KYUUBI_HOME
+[[KYUUBI #5441](https://github.com/apache/kyuubi/pull/5441)] Make the
configuration kyuubi.zookeeper.embedded.data.log.dir effective
+[[KYUUBI #5451](https://github.com/apache/kyuubi/pull/5451)] Ignore
NoSuchFileException during OperationLog.close()
+[[KYUUBI #5499](https://github.com/apache/kyuubi/pull/5499)] [[KYUUBI
#2503](https://github.com/apache/kyuubi/pull/2503)] Catch any exception when
closing idle session
+[[KYUUBI #5513](https://github.com/apache/kyuubi/pull/5513)] Always redirect
delete batch request to Kyuubi instance that owns batch session
+[[KYUUBI #5522](https://github.com/apache/kyuubi/pull/5522)] Ignore main class
for PySpark batch job submission
+[[KYUUBI #5528](https://github.com/apache/kyuubi/pull/5528)] Remove duplicate
properties tag and respect KYUUBI_LOG_DIR
+[[KYUUBI #5566](https://github.com/apache/kyuubi/pull/5566)]
InternalRestClient respects `kyuubi.engine.security.enabled` to add HTTP auth
header
+[[KYUUBI #5566](https://github.com/apache/kyuubi/pull/5566)] Check
InternalSecurityAccessor is initialized only when
`kyuubi.engine.security.enabled` is true
+[[KYUUBI #5568](https://github.com/apache/kyuubi/pull/5568)] Check
administrator only when security is enabled
+[[KYUUBI #5568](https://github.com/apache/kyuubi/pull/5568)] Fix security
enabled judgement
+[[KYUUBI #5606](https://github.com/apache/kyuubi/pull/5606)] Handle engine
listing request properly for users who have not created engine
+
+### Client
+
+[[KYUUBI #3887](https://github.com/apache/kyuubi/pull/3887)] Fix
kyuubiServerPrincipal logic in KyuubiCommands
+[[KYUUBI #4305](https://github.com/apache/kyuubi/pull/4305)] Backport
HIVE-15820: comment at the head of beeline -e
+[[KYUUBI #4438](https://github.com/apache/kyuubi/pull/4438)] Render the batch
info map in kyuubi-ctl
+[[KYUUBI #4439](https://github.com/apache/kyuubi/pull/4439)] Add dto class for
operation data
+[[KYUUBI #4452](https://github.com/apache/kyuubi/pull/4452)] Strip the
redundant leading and tailing slash of getZooKeeperNamespace.
+[[KYUUBI #4479](https://github.com/apache/kyuubi/pull/4479)] Restore JDBC
Kerberos authentication behavior for UGI.doAs
+[[KYUUBI #4489](https://github.com/apache/kyuubi/pull/4489)] Fix missing
`org.apache.commons.logging` by including `jcl-over-slf4j` dependency in REST
client
+[[KYUUBI #4492](https://github.com/apache/kyuubi/pull/4492)] Correct engine
subdomain calculation in `kyuubi-ctl`
+[[KYUUBI #4508](https://github.com/apache/kyuubi/pull/4508)] Beeline should
reset stdin after consuming init SQL file
+[[KYUUBI #4581](https://github.com/apache/kyuubi/pull/4581)] Add
KyuubiCommands parse python snippets unit test
+[[KYUUBI #4609](https://github.com/apache/kyuubi/pull/4609)] get engineRefId
in KyuubiConnection
+[[KYUUBI #4619](https://github.com/apache/kyuubi/pull/4619)] Fix beeline with
-e when there are other SQL statements before the source statement, the source
statement cannot be executed normally
+[[KYUUBI #4657](https://github.com/apache/kyuubi/pull/4657)] Building rest
client to kyuubi instance including original host urls
+[[KYUUBI #4962](https://github.com/apache/kyuubi/pull/4962)] Backport
HIVE-19048: init script errors are ignored
+[[KYUUBI #4965](https://github.com/apache/kyuubi/pull/4965)] Beeline supports
`--python-mode` option and remove comments for non-python mode
+[[KYUUBI #4969](https://github.com/apache/kyuubi/pull/4969)] Run JUnit tests
on beeline module
+[[KYUUBI #5054](https://github.com/apache/kyuubi/pull/5054)] Refine the kyuubi
client version properties file to prevent conflicts
+[[KYUUBI #5100](https://github.com/apache/kyuubi/pull/5100)] Fix unpaired
quote in message pattern
+[[KYUUBI #5101](https://github.com/apache/kyuubi/pull/5101)] Remove unused
StringBuilders in ResultSets
+[[KYUUBI #5129](https://github.com/apache/kyuubi/pull/5129)] KyuubiBeeline
should redirect JDK logging
+[[KYUUBI #5179](https://github.com/apache/kyuubi/pull/5179)] Use Iterable
instead of Seq in kyuubi-ctl commands
+[[KYUUBI #5297](https://github.com/apache/kyuubi/pull/5297)] New
RetryableClient get http://null server uri from metadata.kyuubiInstance
+[[KYUUBI #5480](https://github.com/apache/kyuubi/pull/5480)] Support setting
kyuubi hive jdbc client protocol version
+[[KYUUBI #5564](https://github.com/apache/kyuubi/pull/5564)] Support to config
ticket cache location in JDBC URL
+
+### Web UI
+
+[[KYUUBI #3420](https://github.com/apache/kyuubi/pull/3420)] Kyuubi Server
Proxy Engine UI
+[[KYUUBI #3646](https://github.com/apache/kyuubi/pull/3646)] Front-end style
should bracket same line
+[[KYUUBI #3646](https://github.com/apache/kyuubi/pull/3646)] Init Session
Statistic Page
+[[KYUUBI #3648](https://github.com/apache/kyuubi/pull/3648)] Add Session
Detail Page
+[[KYUUBI #3650](https://github.com/apache/kyuubi/pull/3650)] Add Operation
Statistics Page
+[[KYUUBI #3652](https://github.com/apache/kyuubi/pull/3652)] Add Kyuubi Server
Management page
+[[KYUUBI #3654](https://github.com/apache/kyuubi/pull/3654)] Add Engine
Manager Page
+[[KYUUBI #4537](https://github.com/apache/kyuubi/pull/4537)] Enable Vite proxy
server for web ui development
+[[KYUUBI #4565](https://github.com/apache/kyuubi/pull/4565)] Fix out-date
`README.md` about `Development Project`
+[[KYUUBI #4622](https://github.com/apache/kyuubi/pull/4622)] Session api use
admin api for security
+[[KYUUBI #4626](https://github.com/apache/kyuubi/pull/4626)] Fix Web UI CI
check fail with pnpm the lockfile needs updates
+[[KYUUBI #4757](https://github.com/apache/kyuubi/pull/4757)] Move Statistics
to Management Menu
+[[KYUUBI #4982](https://github.com/apache/kyuubi/pull/4982)] Add query string
to forward requests to Engine UI
+[[KYUUBI #5259](https://github.com/apache/kyuubi/pull/5259)] Web UI supports
Swagger pages
+[[KYUUBI #5463](https://github.com/apache/kyuubi/pull/5463)] Adjust the file
directory structure
+[[KYUUBI #5484](https://github.com/apache/kyuubi/pull/5484)] Remove legacy Web
UI
+[[KYUUBI #5573](https://github.com/apache/kyuubi/pull/5573)] Delete parts of
the Kyuubi Web UI that are not useful
+[[KYUUBI #5586](https://github.com/apache/kyuubi/pull/5586)] Kyuubi Web UI
show current version
+[[KYUUBI #5608](https://github.com/apache/kyuubi/pull/5608)] Kyuubi version
should always use the light color
+[[KYUUBI #5620](https://github.com/apache/kyuubi/pull/5620)] Remove dummy
information card from Overview page
+
+### Documentation
+
+[[KYUUBI #4308](https://github.com/apache/kyuubi/pull/4308)] Make README more
welcoming
+[[KYUUBI #4312](https://github.com/apache/kyuubi/pull/4312)] Fix over-matched
README pattern for markdown styling
+[[KYUUBI #4367](https://github.com/apache/kyuubi/pull/4367)] Kyuubi requires
Flink 1.16/1.17
+[[KYUUBI #4387](https://github.com/apache/kyuubi/pull/4387)] Update Flink
version requirements
+[[KYUUBI #4568](https://github.com/apache/kyuubi/pull/4568)] Make kyuubi-ctl
doc enable variable 'release' automatic substitution
+[[KYUUBI #4583](https://github.com/apache/kyuubi/pull/4583)] Rename Flink
Table Store to Apache Paimon (Incubating)
+[[KYUUBI #4593](https://github.com/apache/kyuubi/pull/4593)] Keep promote the
release step update-to-date
+[[KYUUBI #4599](https://github.com/apache/kyuubi/pull/4599)] Simplify project
version evaluation
+[[KYUUBI #4607](https://github.com/apache/kyuubi/pull/4607)] Rename Flink
Table Store to Apache Paimon (Incubating) in docs `Connectors for Hive SQL
Query Engine`
+[[KYUUBI #4608](https://github.com/apache/kyuubi/pull/4608)] Rename Flink
Table Store to Apache Paimon (Incubating) in docs `Connectors for Trino SQL
Query Engine`
+[[KYUUBI #4614](https://github.com/apache/kyuubi/pull/4614)] Rename Flink
Table Store to Apache Paimon (Incubating) in docs `Connectors for Flink SQL
Query Engine`
+[[KYUUBI #4624](https://github.com/apache/kyuubi/pull/4624)] Fix table headers
in kyuubi_vs_hive.md
+[[KYUUBI #4627](https://github.com/apache/kyuubi/pull/4627)] Fix a typo in
rest_api.md.
+[[KYUUBI #4655](https://github.com/apache/kyuubi/pull/4655)] Enrich docs for
Kyuubi Hive JDBC driver
+[[KYUUBI #4655](https://github.com/apache/kyuubi/pull/4655)] Recover the
missing JDBC URL
+[[KYUUBI #4722](https://github.com/apache/kyuubi/pull/4722)] Kyuubi requires
Spark 3.1 and above now
+[[KYUUBI #4727](https://github.com/apache/kyuubi/pull/4727)]
kyuubi-spark-lineage has no transitive deps
+[[KYUUBI #4734](https://github.com/apache/kyuubi/pull/4734)] Fix typo in docs
of custom event handler
+[[KYUUBI #4742](https://github.com/apache/kyuubi/pull/4742)] Add docs for
Flink application mode
+[[KYUUBI #4763](https://github.com/apache/kyuubi/pull/4763)] Fix the Kyuubi
JDBC kerberos parameters
+[[KYUUBI #4800](https://github.com/apache/kyuubi/pull/4800)] Update
readthedocs.yaml
+[[KYUUBI #4864](https://github.com/apache/kyuubi/pull/4864)] Fix grammar in HA
section
+[[KYUUBI #4933](https://github.com/apache/kyuubi/pull/4933)] Mark
`spark.sql.optimizer.insertRepartitionNum` config for Spark 3.1 only
+[[KYUUBI #4954](https://github.com/apache/kyuubi/pull/4954)] Fix variable
reference in quick_start_with_jdbc
+[[KYUUBI #4960](https://github.com/apache/kyuubi/pull/4960)] Fix doc for
pyhive client.
+[[KYUUBI #5049](https://github.com/apache/kyuubi/pull/5049)] PyHive Kerberos
usage doc
+[[KYUUBI #5083](https://github.com/apache/kyuubi/pull/5083)] Add LDAP document
+[[KYUUBI #5085](https://github.com/apache/kyuubi/pull/5085)] Update config
section of deploy on kubernetes
+[[KYUUBI #5094](https://github.com/apache/kyuubi/pull/5094)] Add Python
JayDeBeApi doc
+[[KYUUBI #5099](https://github.com/apache/kyuubi/pull/5099)] Document link
failure
+[[KYUUBI #5118](https://github.com/apache/kyuubi/pull/5118)] Add Flink KDF doc
+[[KYUUBI #5122](https://github.com/apache/kyuubi/pull/5122)] Hive KDF usage
+[[KYUUBI #5127](https://github.com/apache/kyuubi/pull/5127)] Improvements for
markdown builder
+[[KYUUBI #5146](https://github.com/apache/kyuubi/pull/5146)] Fix link of
IntelliJ IDEA Setup Guide
+[[KYUUBI #5153](https://github.com/apache/kyuubi/pull/5153)] Minor change w/
to with
+[[KYUUBI #5154](https://github.com/apache/kyuubi/pull/5154)] Move
configuration docs to the top level
+[[KYUUBI #5162](https://github.com/apache/kyuubi/pull/5162)] Add statements
about contributions co-authored with AIGC in developer guide page
+[[KYUUBI #5178](https://github.com/apache/kyuubi/pull/5178)] Make
MarkdownBuilder not extending Growable
+[[KYUUBI #5227](https://github.com/apache/kyuubi/pull/5227)] Added deploy mode
info
+[[KYUUBI #5247](https://github.com/apache/kyuubi/pull/5247)] Correct building
command for Spark authz/lineage plugins
+[[KYUUBI #5273](https://github.com/apache/kyuubi/pull/5273)] Update release
docs
+[[KYUUBI #5275](https://github.com/apache/kyuubi/pull/5275)] Improve and fix
comparison and regeneration for golden files
+[[KYUUBI #5294](https://github.com/apache/kyuubi/pull/5294)] Update supported
dialects for JDBC engine
+[[KYUUBI #5335](https://github.com/apache/kyuubi/pull/5335)] Set markdown file
EOL
+[[KYUUBI #5345](https://github.com/apache/kyuubi/pull/5345)] Fix
non-kerberized code description in quick_start_with_jdbc
+[[KYUUBI #5347](https://github.com/apache/kyuubi/pull/5347)] Fix java code
errors in quick_start_with_jdbc
+[[KYUUBI #5409](https://github.com/apache/kyuubi/pull/5409)] Update config
docs regeneration hints in developer guide
+[[KYUUBI #5432](https://github.com/apache/kyuubi/pull/5432)] Fix typo in
README.md
+[[KYUUBI #5523](https://github.com/apache/kyuubi/pull/5523)] Update the Kyuubi
supported components version
+
+### Building, Infrastructure and Dependency
+
+[[KYUUBI #4078](https://github.com/apache/kyuubi/pull/4078)] Fix shellcheck
violations in scripts of /bin folder
+[[KYUUBI #4187](https://github.com/apache/kyuubi/pull/4187)] Windows
build-info script supports revision time
+[[KYUUBI #4278](https://github.com/apache/kyuubi/pull/4278)] Use new Apache
'closer.lua' syntax to obtain Maven
+[[KYUUBI #4295](https://github.com/apache/kyuubi/pull/4295)] Introduce
`super-linter` action for linting JSON, XML, ENV files and bash_exec
+[[KYUUBI #4299](https://github.com/apache/kyuubi/pull/4299)] Bump JUnit to
4.13.2
+[[KYUUBI #4299](https://github.com/apache/kyuubi/pull/4299)] Bump MySQL JDBC
driver to 8.0.32
+[[KYUUBI #4315](https://github.com/apache/kyuubi/pull/4315)] Check modules
available before build step in dependency workflow
+[[KYUUBI #4347](https://github.com/apache/kyuubi/pull/4347)] Bump maven
download plugin from 1.6.6 to 1.6.8
+[[KYUUBI #4348](https://github.com/apache/kyuubi/pull/4348)] Cache engine
archives in CI jobs for maven download plugin
+[[KYUUBI #4397](https://github.com/apache/kyuubi/pull/4397)] `build/dist`
supports `--web-ui`
+[[KYUUBI #4413](https://github.com/apache/kyuubi/pull/4413)] Build docker
image should include web UI
+[[KYUUBI #4447](https://github.com/apache/kyuubi/pull/4447)] Bump log4j from
2.19.0 to 2.20.0
+[[KYUUBI #4448](https://github.com/apache/kyuubi/pull/4448)] Bump Netty from
4.1.87.Final to 4.1.89.Final
+[[KYUUBI #4451](https://github.com/apache/kyuubi/pull/4451)] Skip etcd test if
no docker env
+[[KYUUBI #4453](https://github.com/apache/kyuubi/pull/4453)] Bump Kubernetes
Client Version to 6.4.1
+[[KYUUBI #4461](https://github.com/apache/kyuubi/pull/4461)] Add `Kyuubi
Kubernetes IT` Module to CI style check
+[[KYUUBI #4466](https://github.com/apache/kyuubi/pull/4466)] Use bitnami/minio
docker image
+[[KYUUBI #4471](https://github.com/apache/kyuubi/pull/4471)] Prompted command
for docs generation should skip Java tests
+[[KYUUBI #4484](https://github.com/apache/kyuubi/pull/4484)] [K8S][HELM] Set
specific Kyuubi version to the chart appVersion
+[[KYUUBI #4494](https://github.com/apache/kyuubi/pull/4494)] `bin/kyuubi`
should use `exec` to run Kyuubi server
+[[KYUUBI #4513](https://github.com/apache/kyuubi/pull/4513)] Bump Kyuubi 1.7.0
in Playground
+[[KYUUBI #4546](https://github.com/apache/kyuubi/pull/4546)] Fully exclude
`metrics` dir from git
+[[KYUUBI #4557](https://github.com/apache/kyuubi/pull/4557)] [K8S][HELM]
Kyuubi server should bind Pod IP by default
+[[KYUUBI #4572](https://github.com/apache/kyuubi/pull/4572)] Bump Iceberg from
1.1.0 to 1.2.0
+[[KYUUBI #4576](https://github.com/apache/kyuubi/pull/4576)] Multi arch build
for ARM support in Docker Hub
+[[KYUUBI #4589](https://github.com/apache/kyuubi/pull/4589)] [K8S][HELM]
Update template on port-forward usage guide NOTES.txt
+[[KYUUBI #4590](https://github.com/apache/kyuubi/pull/4590)] Bump delta from
2.2.0 to 2.3.0
+[[KYUUBI #4598](https://github.com/apache/kyuubi/pull/4598)] Bump Flink-1.15
from 1.15.3 to 1.15.4
+[[KYUUBI #4600](https://github.com/apache/kyuubi/pull/4600)] Bump Iceberg
1.2.0 for playground
+[[KYUUBI #4601](https://github.com/apache/kyuubi/pull/4601)] Bump Hadoop 3.3.5
for playground
+[[KYUUBI #4605](https://github.com/apache/kyuubi/pull/4605)] [K8S][HELM] Set
IfNotPresent pullPolicy by default
+[[KYUUBI #4606](https://github.com/apache/kyuubi/pull/4606)] [K8S][HELM] Add
command and args configuration support
+[[KYUUBI #4615](https://github.com/apache/kyuubi/pull/4615)] Bump Ranger from
2.3.0 to 2.4.0
+[[KYUUBI #4628](https://github.com/apache/kyuubi/pull/4628)] Add Dependency
management ISSUE_TEMPLATE
+[[KYUUBI #4632](https://github.com/apache/kyuubi/pull/4632)] Add rule for
labeler to tag `module:ui`
+[[KYUUBI #4638](https://github.com/apache/kyuubi/pull/4638)] Update
dependency.yml as label in not permitted in markdown block
+[[KYUUBI #4652](https://github.com/apache/kyuubi/pull/4652)] Upgrade Hadoop
from 3.3.4 to 3.3.5
+[[KYUUBI #4695](https://github.com/apache/kyuubi/pull/4695)] Bump super-linter
action from v4 to v5
+[[KYUUBI #4696](https://github.com/apache/kyuubi/pull/4696)] Upgrade scalafmt
from 3.7.1 to 3.7.3
+[[KYUUBI #4697](https://github.com/apache/kyuubi/pull/4697)] [K8S][HELM] Add
template rendering info to README
+[[KYUUBI #4698](https://github.com/apache/kyuubi/pull/4698)] [K8S][HELM]
Centralize Kyuubi labels definition
+[[KYUUBI #4706](https://github.com/apache/kyuubi/pull/4706)] [K8S][HELM] Use
template comments for the chart license header
+[[KYUUBI #4707](https://github.com/apache/kyuubi/pull/4707)] [K8S][HELM] Fix
README typo and minor reformatting
+[[KYUUBI #4712](https://github.com/apache/kyuubi/pull/4712)] Bump Spark from
3.2.3 to 3.2.4
+[[KYUUBI #4737](https://github.com/apache/kyuubi/pull/4737)] Restore Project &
Community Status in README.md
+[[KYUUBI #4744](https://github.com/apache/kyuubi/pull/4744)] Remove Hudi
integration tests
+[[KYUUBI #4747](https://github.com/apache/kyuubi/pull/4747)] Install and cache
build/mvn in CI builds
+[[KYUUBI #4768](https://github.com/apache/kyuubi/pull/4768)] Guidelines for
Document and Code contributions
+[[KYUUBI #4772](https://github.com/apache/kyuubi/pull/4772)] Bump Jersey from
2.39 to 2.39.1
+[[KYUUBI #4783](https://github.com/apache/kyuubi/pull/4783)] Use pnpm v8 and
update pnpm lockfile to v6 schema
+[[KYUUBI #4784](https://github.com/apache/kyuubi/pull/4784)] Use nodejs v18 in
CI builds and maven web-ui builds
+[[KYUUBI #4788](https://github.com/apache/kyuubi/pull/4788)] [K8S][HELM] Use
StatefulSet instead of Deployment
+[[KYUUBI #4805](https://github.com/apache/kyuubi/pull/4805)] Bump openai-java
from 0.11.1 to 0.12.0
+[[KYUUBI #4808](https://github.com/apache/kyuubi/pull/4808)] Bump Jetty from
9.4.50 to 9.4.51
+[[KYUUBI #4818](https://github.com/apache/kyuubi/pull/4818)] [K8S][HELM]
Update default Kyuubi version to 1.7.1
+[[KYUUBI #4819](https://github.com/apache/kyuubi/pull/4819)] [K8S][HELM]
Refactor liveliness and readiness probes
+[[KYUUBI #4824](https://github.com/apache/kyuubi/pull/4824)] Bump Jackson from
2.14.2 to 2.15.0
+[[KYUUBI #4827](https://github.com/apache/kyuubi/pull/4827)] Bump Apache Arrow
from 11.0.0 to 12.0.0
+[[KYUUBI #4828](https://github.com/apache/kyuubi/pull/4828)] Exclude macOS tar
extended metadata in build/dist
+[[KYUUBI #4849](https://github.com/apache/kyuubi/pull/4849)] Open modules to
enable JDK 17 support
+[[KYUUBI #4851](https://github.com/apache/kyuubi/pull/4851)] Bump Maven 3.8.8
+[[KYUUBI #4852](https://github.com/apache/kyuubi/pull/4852)] Switch to Kyuubi
Shaded Zookeeper
+[[KYUUBI #4856](https://github.com/apache/kyuubi/pull/4856)] Add
`restore-keys` for `action/cache`
+[[KYUUBI #4870](https://github.com/apache/kyuubi/pull/4870)] Add kyuubi-util
and kyuubi-util-scala modules
+[[KYUUBI #4877](https://github.com/apache/kyuubi/pull/4877)] Bump Flink 1.17
to 1.17.1
+[[KYUUBI #4879](https://github.com/apache/kyuubi/pull/4879)] Refactor and
promote reflection utils and cleanup similar reflection methods
+[[KYUUBI #4883](https://github.com/apache/kyuubi/pull/4883)] Bump Iceberg 1.3.0
+[[KYUUBI #4887](https://github.com/apache/kyuubi/pull/4887)] Refactor and add
ut for ClassUtils
+[[KYUUBI #4891](https://github.com/apache/kyuubi/pull/4891)] Bump Flink 1.16.2
+[[KYUUBI #4894](https://github.com/apache/kyuubi/pull/4894)] Bump Mockito from
4.9.0 to 4.11.0 and ScalaTest from 3.2.15 to 3.2.16
+[[KYUUBI #4904](https://github.com/apache/kyuubi/pull/4904)] Move
AssertionUtils to kyuubi-util-scala module
+[[KYUUBI #4905](https://github.com/apache/kyuubi/pull/4905)] Generalize util
method for loading class from service loader
+[[KYUUBI #4907](https://github.com/apache/kyuubi/pull/4907)] Add a maven
profile 'remote-debug'
+[[KYUUBI #4908](https://github.com/apache/kyuubi/pull/4908)] Bump scalafmt
from 3.7.3 to 3.7.4
+[[KYUUBI #4911](https://github.com/apache/kyuubi/pull/4911)] Remove duplicate
test annotations `org.apache.kyuubi.tags.*` in kyuubi-common
+[[KYUUBI #4912](https://github.com/apache/kyuubi/pull/4912)] Replace Scala's
assert in tests with scalatest's for prettified error message
+[[KYUUBI #4931](https://github.com/apache/kyuubi/pull/4931)] Bump vite from
3.0.0 to 4.2.3 and vitest from 0.22.0 to 0.32.0
+[[KYUUBI #4937](https://github.com/apache/kyuubi/pull/4937)] Remove redundant
quoteIfNeeded method
+[[KYUUBI #4943](https://github.com/apache/kyuubi/pull/4943)] Bump Guava from
31.1 to 32.0.1
+[[KYUUBI #4944](https://github.com/apache/kyuubi/pull/4944)] Code improvement
for Java
+[[KYUUBI #4947](https://github.com/apache/kyuubi/pull/4947)] Bump pnpm version
in maven's frontend plugin to 8.6.1 for lockfileVersion 6.1
+[[KYUUBI #4948](https://github.com/apache/kyuubi/pull/4948)] Reuse versions of
NodeJS and pnpm from maven properties
+[[KYUUBI #4959](https://github.com/apache/kyuubi/pull/4959)] Code improvements
for Scala
+[[KYUUBI #4966](https://github.com/apache/kyuubi/pull/4966)] Bump Apache
parent pom from 29 to 30
+[[KYUUBI #4968](https://github.com/apache/kyuubi/pull/4968)] Simplify Option
conversion
+[[KYUUBI #4970](https://github.com/apache/kyuubi/pull/4970)] Unified
reflection methods invokeAs and getField
+[[KYUUBI #4974](https://github.com/apache/kyuubi/pull/4974)] Eliminate
raw-types compilation warning in KyuubiBeeLine
+[[KYUUBI #4975](https://github.com/apache/kyuubi/pull/4975)] Fixed run test
link in PR template
+[[KYUUBI #4990](https://github.com/apache/kyuubi/pull/4990)] Bump Spark 3.4.1
+[[KYUUBI #4992](https://github.com/apache/kyuubi/pull/4992)] Bump Netty
4.1.93.Final
+[[KYUUBI #5001](https://github.com/apache/kyuubi/pull/5001)] Bump Scala from
2.12.17 to 2.12.18
+[[KYUUBI #5003](https://github.com/apache/kyuubi/pull/5003)] [K8S][HELM] Add
doc strings to the chart values.yaml
+[[KYUUBI #5007](https://github.com/apache/kyuubi/pull/5007)] Bump scalafmt
from 3.7.4 to 3.7.5
+[[KYUUBI #5019](https://github.com/apache/kyuubi/pull/5019)] Shows details of
compilation info in SparkUI's engine tab
+[[KYUUBI #5024](https://github.com/apache/kyuubi/pull/5024)] Bump
grpc-protobuf from 1.48.0 to 1.53.0
+[[KYUUBI #5034](https://github.com/apache/kyuubi/pull/5034)] Bump tough-cookie
from 4.0.0 to 4.1.3 in /kyuubi-server/web-ui
+[[KYUUBI #5039](https://github.com/apache/kyuubi/pull/5039)] Use semantic
versions and remove redundant version comparison methods
+[[KYUUBI #5058](https://github.com/apache/kyuubi/pull/5058)] [K8S][HELM] Allow
the user to set the priorityClass used by Kyuubi server Pod
+[[KYUUBI #5059](https://github.com/apache/kyuubi/pull/5059)] Upgrade
kubernetes client version to 6.7.2
+[[KYUUBI #5064](https://github.com/apache/kyuubi/pull/5064)] Audit kubernetes
application state change in separate log files
+[[KYUUBI #5068](https://github.com/apache/kyuubi/pull/5068)] Bump Spark in
spark-master profile from 3.5.0-SNAPSHOT to 4.0.0-SNAPSHOT
+[[KYUUBI #5070](https://github.com/apache/kyuubi/pull/5070)] Bump word-wrap
from 1.2.3 to 1.2.4 in web UI
+[[KYUUBI #5072](https://github.com/apache/kyuubi/pull/5072)] Fix
KyuubiOperationWithEngineSecuritySuite and related issues
+[[KYUUBI #5090](https://github.com/apache/kyuubi/pull/5090)] Fix
AllKyuubiConfiguration to generate redundant blank lines in Windows
+[[KYUUBI #5113](https://github.com/apache/kyuubi/pull/5113)] Remove dummy
Spark Kudu connector module
+[[KYUUBI #5116](https://github.com/apache/kyuubi/pull/5116)] Bump Hadoop 3.3.6
+[[KYUUBI #5117](https://github.com/apache/kyuubi/pull/5117)] Code improvements
for Java and Scala code
+[[KYUUBI #5121](https://github.com/apache/kyuubi/pull/5121)] Extract dev
scripts for regenerating the golden files
+[[KYUUBI #5132](https://github.com/apache/kyuubi/pull/5132)] [K8S][HELM]
Kyuubi add server metrics monitor
+[[KYUUBI #5135](https://github.com/apache/kyuubi/pull/5135)] Exclude web-ui
coverage reports in rat plugins
+[[KYUUBI #5149](https://github.com/apache/kyuubi/pull/5149)] Correct error
message of ReflectUtils's invokeAs when method not found
+[[KYUUBI #5150](https://github.com/apache/kyuubi/pull/5150)] Bump Spark 3.3.3
+[[KYUUBI #5152](https://github.com/apache/kyuubi/pull/5152)] Check milestone
and assignees when merging pull request
+[[KYUUBI #5177](https://github.com/apache/kyuubi/pull/5177)] Use Scala binary
version placeholder in Maven module's artifactId suffix
+[[KYUUBI #5183](https://github.com/apache/kyuubi/pull/5183)] Introducing
profile scala-2.13 for development use
+[[KYUUBI #5196](https://github.com/apache/kyuubi/pull/5196)] Enable CI Test on
Scala 2.13 and support custom or spark-core extracted Scala version for Spark's
engine
+[[KYUUBI #5202](https://github.com/apache/kyuubi/pull/5202)] Update
upload_nexus_staging
+[[KYUUBI #5205](https://github.com/apache/kyuubi/pull/5205)] Upgrade
`kubernetes-client` to 6.8.1
+[[KYUUBI #5209](https://github.com/apache/kyuubi/pull/5209)] Reformat Scala
source code crossing versions
+[[KYUUBI #5212](https://github.com/apache/kyuubi/pull/5212)] Fix configuration
errors causing by helm charts of prometheus services
+[[KYUUBI #5214](https://github.com/apache/kyuubi/pull/5214)] Correct file path
for scala tests in util-scala module
+[[KYUUBI #5234](https://github.com/apache/kyuubi/pull/5234)] Upgrade Jetty
version from 9.4.51.v20230217 to 9.4.52.v20230823
+[[KYUUBI #5235](https://github.com/apache/kyuubi/pull/5235)] Daily deploy
snapshot version on master and branch-1.7
+[[KYUUBI #5250](https://github.com/apache/kyuubi/pull/5250)] Bump Iceberg from
1.3.0 to 1.3.1
+[[KYUUBI #5252](https://github.com/apache/kyuubi/pull/5252)] Remove incubator
link
+[[KYUUBI #5253](https://github.com/apache/kyuubi/pull/5253)] Upgrade
testcontainers-scala from 0.40.12 to 0.41.0
+[[KYUUBI #5253](https://github.com/apache/kyuubi/pull/5253)] Supply
testcontainers-scala-scalatest deps
+[[KYUUBI #5293](https://github.com/apache/kyuubi/pull/5293)] Upgrade snakeyaml
from 1.33 to 2.2
+[[KYUUBI #5305](https://github.com/apache/kyuubi/pull/5305)] Fix get local log
UT
+[[KYUUBI #5308](https://github.com/apache/kyuubi/pull/5308)] Ensure release
using Java 8
+[[KYUUBI #5318](https://github.com/apache/kyuubi/pull/5318)] Pin
maven-source-plugin 3.2.1
+[[KYUUBI #5358](https://github.com/apache/kyuubi/pull/5358)] Bump iceberg 1.4.0
+[[KYUUBI #5365](https://github.com/apache/kyuubi/pull/5365)] Don't use
Log4j2's extended throwable conversion pattern in default logging configurations
+[[KYUUBI #5425](https://github.com/apache/kyuubi/pull/5425)] Add thread name
and ID to log4j2-defaults.xml
+[[KYUUBI #5435](https://github.com/apache/kyuubi/pull/5435)] Improve Kyuubi On
Kubernetes IT
+[[KYUUBI #5443](https://github.com/apache/kyuubi/pull/5443)] Add
kyuubi-kubernetes-it module to reformat script
+[[KYUUBI #5444](https://github.com/apache/kyuubi/pull/5444)] Check style with
profiles of Spark 3.4 and 3.5
+[[KYUUBI #5483](https://github.com/apache/kyuubi/pull/5483)] Fix deploy
command for Scala 2.13 TPC-DS/H connectors
+[[KYUUBI #5483](https://github.com/apache/kyuubi/pull/5483)] Release Spark
TPC-H/DS Connectors with Scala 2.13
+[[KYUUBI #5486](https://github.com/apache/kyuubi/pull/5486)] Bump Kafka client
version from 3.4.0 to 3.5.1
+[[KYUUBI #5508](https://github.com/apache/kyuubi/pull/5508)] Upgrade
download-maven-plugin from 1.6.8 to 1.7.1
+[[KYUUBI #5544](https://github.com/apache/kyuubi/pull/5544)] Release contains
Spark 3.5 extension
+[[KYUUBI #5561](https://github.com/apache/kyuubi/pull/5561)] Binary
distribution artifact ships database schema scripts
+[[KYUUBI #5561](https://github.com/apache/kyuubi/pull/5561)] Rename folder to
db-scripts
+[[KYUUBI #5569](https://github.com/apache/kyuubi/pull/5569)] Fix pnpm-lock
file version
+
+### Credits
+
+Last but not least, this release would not have been possible without the
following contributors:
+
+* Alex Zou
+* Anurag Rajawat
+* Binjie Yang
+* Bowen Liang
+* Bruce Wong
+* CavemanIV
+* Chao Chen
+* Cheng Pan
+* Chenliang Lu
+* David Yuan
+* Deng An
+* Denis Krivenko
+* Derick Cypho
+* Drake Youngkun Min
+* Fei Wang
+* FourSpaces
+* Fu Chen
+* GitHub Bot
+* Guanhua Li
+* Hanna Liashchuk
+* He Zhao
+* Junjie Zu
+* Kaifei Yi
+* Kang Wang
+* Karsonnel
+* Kent Yao
+* Kyofin
+* Miao Wang
+* Min Zhao
+* Naijie Liu
+* Omkar Makhare
+* Paul Lin
+* Peiyue Liu
+* Pengqi Li
+* Qiang Zhang
+* QianyongY
+* Remzi Yang
+* Rojin Raju
+* Ruguo Yu
+* Ruilei Ma
+* Senmiao Liu
+* Shaoyun Chen
+* Sidhant Nagpal
+* Tianlin Liao
+* Xianxun Ye
+* Xiduo You
+* Xieming Li
+* XorSum
+* Xu Guo
+* Yang Du
+* Yangming Zhao
+* Yaodong Zhang
+* Yaogai Zhu
+* Yi Zhu
+* Yifan Zhou
+* Zhen Wang
+* biangjuang
+* camper42
+* fantasticKe
+* huangzhir
+* huapan123456
+* liaoyt
+* mans2singh
+* mrtisttt
+* phyyou
+* rhh777
+* runzhliu
+* touchida
+* uicosp
+* wangyepeng2
+* weixi62961
+* yehere
diff --git a/src/zh/news/2023-11-07-release-1.8.0.md
b/src/zh/news/2023-11-07-release-1.8.0.md
new file mode 100644
index 0000000..dbd6290
--- /dev/null
+++ b/src/zh/news/2023-11-07-release-1.8.0.md
@@ -0,0 +1,20 @@
+---
+title: Apache Kyuubi 1.8.0 released
+date: 2023-11-07
+linked: true
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+我们很高兴地宣布 [Apache Kyuubi 1.8.0](/zh/release/1.8.0.html) 发布了! 查看
[发布记录](/zh/release/1.8.0.html) 阅读有关新功能的信息，或者马上 [下载](/zh/releases.html) 体验吧。
diff --git a/src/zh/release/1.8.0.md b/src/zh/release/1.8.0.md
new file mode 100644
index 0000000..98823de
--- /dev/null
+++ b/src/zh/release/1.8.0.md
@@ -0,0 +1,713 @@
+---
+title: 发布记录 - 1.8.0
+date: 2023-11-07
+linked: true
+meta:
+_edit_last: '4'
+_wpas_done_all: '1'
+---
+<!---
+ Licensed under the Apache License, Version 2.0 (the "License");
+ you may not use this file except in compliance with the License.
+ You may obtain a copy of the License at
+
+ http://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License. See accompanying LICENSE file.
+-->
+
+### 重要变更
+
+- 基于 Java 8, 11 和 17，Scala 2.12 做了充分验证，初步支持 Scala 2.13
+- 基于 Spark 3.1, 3.2, 3.3 和 3.4 做了充分验证, 初步支持 Spark 3.5
+- 基于 Flink 1.16, 1.17 和 1.18 做了充分验证
+- 全新 Web UI (实验特性)
+- 新增以 OpenAI ChatGPT 作为后端的 Chat 引擎
+- Spark Batch API 重大改进，针对大规模作业提交进行了优化 (实验特性)
+- Spark AuthZ 插件重大改进，包括增强了对 Iceberg 和 DSv2 算子的支持
+- Flink 引擎重大改进，包括 YARN Application Mode 的支持
+- Spark 血缘插件引入 Atlas hook 支持
+- 持续改进 Kyuubi Helm Chart 和 Spark on K8s
+
+### Spark Engine, Connectors and Plugins
+
+[[KYUUBI #1265](https://github.com/apache/kyuubi/pull/1265)] `OPTIMIZE` where
clause expression support
+[[KYUUBI #3420](https://github.com/apache/kyuubi/pull/3420)] Expose UI url on
registering engine service
+[[KYUUBI #3444](https://github.com/apache/kyuubi/pull/3444)] Support the
planOnly mode of kyuubi spark engine support SQL lineage
+[[KYUUBI #3929](https://github.com/apache/kyuubi/pull/3929)] Refactor lineage
plugin to add LineageDispatcher
+[[KYUUBI #4167](https://github.com/apache/kyuubi/pull/4167)] [AUTHZ] Introduce
function support in PrivilegeBuilder with Serde layers
+[[KYUUBI #4171](https://github.com/apache/kyuubi/pull/4171)] Support skip
retrieving table's properties to speed up GetTables operation
+[[KYUUBI #4186](https://github.com/apache/kyuubi/pull/4186)] Spark
showProgress with JobInfo
+[[KYUUBI #4330](https://github.com/apache/kyuubi/pull/4330)] Non-temporary
views do not resolve to a specific real table
+[[KYUUBI #4331](https://github.com/apache/kyuubi/pull/4331)] [[KYUUBI
#4431](https://github.com/apache/kyuubi/pull/4431)] Lineage supports `Union`
and `MergeInto`
+[[KYUUBI #4415](https://github.com/apache/kyuubi/pull/4415)] Align the
operation handle in server/engine for ExecuteScala, ExecutePython and
PlanOnlyStatement
+[[KYUUBI #4430](https://github.com/apache/kyuubi/pull/4430)] Lineage supports
the `lateral view explode` statement
+[[KYUUBI #4433](https://github.com/apache/kyuubi/pull/4433)] Fix the case with
`create a view from view`
+[[KYUUBI #4443](https://github.com/apache/kyuubi/pull/4443)] Do not set engine
session init sql for alive probe session
+[[KYUUBI #4450](https://github.com/apache/kyuubi/pull/4450)] Ignore unknown
fields `policyPriority` when reading policy json file
+[[KYUUBI #4488](https://github.com/apache/kyuubi/pull/4488)] [KSHC] Keep
object original name defined in HiveBridgeHelper
+[[KYUUBI #4493](https://github.com/apache/kyuubi/pull/4493)] [AUTHZ] Enable
Tests for Spark 3.1 with iceberg tables
+[[KYUUBI #4497](https://github.com/apache/kyuubi/pull/4497)] Add
RowFilteringTestBase to improve the test coverage
+[[KYUUBI #4504](https://github.com/apache/kyuubi/pull/4504)] [AUTHZ] Fix
source table privilege requirement when querying permanent view in Spark 3.1
and below
+[[KYUUBI #4525](https://github.com/apache/kyuubi/pull/4525)] [KSHC]
Partitioning predicates should take effect to filter data
+[[KYUUBI #4530](https://github.com/apache/kyuubi/pull/4530)] [AUTHZ] Support
non-English chars for MASK, MASK_SHOW_FIRST_4, and MASK_SHOW_FIRST_4
+[[KYUUBI #4532](https://github.com/apache/kyuubi/pull/4532)] [AUTHZ] Displays
the columns involved in extracting the aggregation operator
+[[KYUUBI #4541](https://github.com/apache/kyuubi/pull/4541)] Support to
customize the attributes to expose for Spark engine
+[[KYUUBI #4560](https://github.com/apache/kyuubi/pull/4560)] [KSHC] Support
Kerberized HMS in cluster mode w/o keytab
+[[KYUUBI #4585](https://github.com/apache/kyuubi/pull/4585)] [AUTHZ] Authz
policy file generation
+[[KYUUBI #4587](https://github.com/apache/kyuubi/pull/4587)] Take care of
table cache query stage
+[[KYUUBI #4592](https://github.com/apache/kyuubi/pull/4592)] Support eagerly
kill redundant executors
+[[KYUUBI #4615](https://github.com/apache/kyuubi/pull/4615)] Support stage
level schedule for final write stage
+[[KYUUBI #4617](https://github.com/apache/kyuubi/pull/4617)] [AUTHZ] Collect
results for filtered show objects ahead to prevent holding unserializable spark
plan
+[[KYUUBI #4620](https://github.com/apache/kyuubi/pull/4620)] [KSHC] Cut off
transitive dependencies
+[[KYUUBI #4636](https://github.com/apache/kyuubi/pull/4636)] Improve eagerly
kill redundant executors
+[[KYUUBI #4641](https://github.com/apache/kyuubi/pull/4641)] Add
MaxFileSizeStrategy to limit max scan file size
+[[KYUUBI #4644](https://github.com/apache/kyuubi/pull/4644)] Manually
terminate the Py4JServer during engine shutdown
+[[KYUUBI #4658](https://github.com/apache/kyuubi/pull/4658)] [AUTHZ] Fix
InsertIntoHiveDirCommand classname so that we can extract the query in it when
authorization.
+[[KYUUBI #4662](https://github.com/apache/kyuubi/pull/4662)] [ARROW] Arrow
serialization should not introduce extra shuffle for outermost limit
+[[KYUUBI #4664](https://github.com/apache/kyuubi/pull/4664)] Fix empty
relation when kill executors
+[[KYUUBI #4672](https://github.com/apache/kyuubi/pull/4672)] [AUTHZ] Remove
Support for Apache Ranger 0.6.0
+[[KYUUBI #4676](https://github.com/apache/kyuubi/pull/4676)] [AUTHZ] Reuse
users and namespaces in both tests and policy file generation
+[[KYUUBI #4677](https://github.com/apache/kyuubi/pull/4677)] [AUTHZ] Check
generated policy file in test suite
+[[KYUUBI #4678](https://github.com/apache/kyuubi/pull/4678)] Improve
FinalStageResourceManager kill executors
+[[KYUUBI #4681](https://github.com/apache/kyuubi/pull/4681)] Set thread
`CreateSparkTimeoutChecker` daemon
+[[KYUUBI #4683](https://github.com/apache/kyuubi/pull/4683)] Update
`spark.sql.finalWriteStage.resourceIsolation.enabled` version
+[[KYUUBI #4702](https://github.com/apache/kyuubi/pull/4702)] [ARROW]
CommandResultExec should not trigger job
+[[KYUUBI #4710](https://github.com/apache/kyuubi/pull/4710)] [ARROW]
LocalTableScanExec should not trigger job
+[[KYUUBI #4710](https://github.com/apache/kyuubi/pull/4710)] [ARROW] Post
driver-side metrics for LocalTableScanExec/CommandResultExec
+[[KYUUBI #4716](https://github.com/apache/kyuubi/pull/4716)] [[KYUUBI
#4715](https://github.com/apache/kyuubi/pull/4715)][AUTHZ] Fix the incorrect
class name of InsertIntoHiveDirCommand in table spec generator
+[[KYUUBI #4717](https://github.com/apache/kyuubi/pull/4717)] [AUTHZ] Check
Authz plugin's spec json files in UT
+[[KYUUBI #4720](https://github.com/apache/kyuubi/pull/4720)] [ARROW] Fix
java.lang.NoSuchFieldError: IpcOption.DEFAULT for Spark-3.1/3.2
+[[KYUUBI #4741](https://github.com/apache/kyuubi/pull/4741)] Kyuubi Spark
Engine/TPC connectors support Spark 3.4
+[[KYUUBI #4754](https://github.com/apache/kyuubi/pull/4754)] [ARROW] Use
`KyuubiArrowConverters#toBatchIterator` instead of
`ArrowConverters#toBatchIterator`
+[[KYUUBI #4797](https://github.com/apache/kyuubi/pull/4797)] [ARROW]
Reflective calls to the function `ArrowUtils#toArrowSchema`
+[[KYUUBI #4812](https://github.com/apache/kyuubi/pull/4812)] Generalize case
transformation method for string type config entry
+[[KYUUBI #4834](https://github.com/apache/kyuubi/pull/4834)] Reduce the scope
of method references in Authz plugin cleanup shutdown hook
+[[KYUUBI #4838](https://github.com/apache/kyuubi/pull/4838)] Fix spark
operation exception leak in `withLocalProperties` method
+[[KYUUBI #4866](https://github.com/apache/kyuubi/pull/4866)] Add annotation
for Iceberg tests in Authz plugin
+[[KYUUBI #4869](https://github.com/apache/kyuubi/pull/4869)] [AUTHZ] Introduce
table extractor for ResolvedIdentifier in Spark 3.4
+[[KYUUBI #4871](https://github.com/apache/kyuubi/pull/4871)] [AUTHZ] Adapt
plan changes for CreateNamespace and SetCatalogAndNamespace in Spark 3.4
+[[KYUUBI #4873](https://github.com/apache/kyuubi/pull/4873)] [AUTHZ] Refactor
Authz reflection with kyuubi-util's DynMethods
+[[KYUUBI #4874](https://github.com/apache/kyuubi/pull/4874)] [AUTHZ] Improve
methods in AuthzUtils
+[[KYUUBI #4875](https://github.com/apache/kyuubi/pull/4875)] [AUTHZ] Remove
checking Spark v2 in tests since Spark v2 not supported
+[[KYUUBI #4878](https://github.com/apache/kyuubi/pull/4878)] Delta support for
Spark-3.4
+[[KYUUBI #4880](https://github.com/apache/kyuubi/pull/4880)] [BUILD] Skip
compiling useless files when making distribution
+[[KYUUBI #4888](https://github.com/apache/kyuubi/pull/4888)] [AUTHZ] Remove
filtering results for ShowDatabasesCommand in Spark 2.x
+[[KYUUBI #4892](https://github.com/apache/kyuubi/pull/4892)] [AUTHZ] Make
identifier part name comparison case insensitive in tests of PrivilegeBuilder
+[[KYUUBI #4895](https://github.com/apache/kyuubi/pull/4895)] [ARROW]
Reflective calls to the function `ArrowConverters#fromBatchIterator`
+[[KYUUBI #4899](https://github.com/apache/kyuubi/pull/4899)] [AUTHZ] Extract
function from FunctionIdentifier for CreateFunction and DropFunction in Spark
3.4
+[[KYUUBI #4903](https://github.com/apache/kyuubi/pull/4903)] [AUTHZ] Fix
NoSuchElementException when listing database in CatalogImpl in Spark 3.4
+[[KYUUBI #4909](https://github.com/apache/kyuubi/pull/4909)] [AUTHZ] Enable
authz plugin tests for Spark 3.4
+[[KYUUBI #4910](https://github.com/apache/kyuubi/pull/4910)] Extract table
from ResolvedIdentifier for DropTable in Spark 3.4
+[[KYUUBI #4913](https://github.com/apache/kyuubi/pull/4913)] Eliminate
unnecessary output in ut "union an unmasked table"
+[[KYUUBI #4914](https://github.com/apache/kyuubi/pull/4914)] [AUTHZ] Reuse
extractor singleton instance with generalized getter for supported extractor
types
+[[KYUUBI #4915](https://github.com/apache/kyuubi/pull/4915)] Adapt database
not exist error message change for Spark 3.4
+[[KYUUBI #4916](https://github.com/apache/kyuubi/pull/4916)] [AUTHZ] Support
ReplaceData and compatible Spark 3.4 and 3.5
+[[KYUUBI #4916](https://github.com/apache/kyuubi/pull/4916)] Fix Iceberg merge
into UT
+[[KYUUBI #4917](https://github.com/apache/kyuubi/pull/4917)] [AUTHZ] Table
owner undefined in Iceberg 1.3.0 on Spark 3.4
+[[KYUUBI #4923](https://github.com/apache/kyuubi/pull/4923)] [ARROW] Update
arguments of `ArrowUtils#toArrowSchema` function
+[[KYUUBI #4925](https://github.com/apache/kyuubi/pull/4925)] Add default
catalog using `spark_catalog` with the lineage result
+[[KYUUBI #4935](https://github.com/apache/kyuubi/pull/4935)] More than target
num of executors may survive after FinalStageResourceManager did kill
+[[KYUUBI #4937](https://github.com/apache/kyuubi/pull/4937)] Cleanup spark
catalog shim and renamed to catalog utils
+[[KYUUBI #4952](https://github.com/apache/kyuubi/pull/4952)] Enhance AWS Glue
default database does not exist error message on opening session
+[[KYUUBI #4995](https://github.com/apache/kyuubi/pull/4995)] Use hadoop conf
and hive conf from catalog options
+[[KYUUBI #4999](https://github.com/apache/kyuubi/pull/4999)] [KSHC]
Kyuubi-Spark-Hive-Connector support Apache Spark 3.4
+[[KYUUBI #5002](https://github.com/apache/kyuubi/pull/5002)] Fail the engine
fast when no incoming connection in CONNECTION mode
+[[KYUUBI #5005](https://github.com/apache/kyuubi/pull/5005)] Remove default
settings `spark.sql.execution.topKSortFallbackThreshold`
+[[KYUUBI #5007](https://github.com/apache/kyuubi/pull/5007)] Remove blank
SparkSimpleStatsReportListener
+[[KYUUBI #5009](https://github.com/apache/kyuubi/pull/5009)] Pass Spark Engine
Log Path to Spark Conf
+[[KYUUBI #5017](https://github.com/apache/kyuubi/pull/5017)] [KSHC] Support
Parquet/Orc provider is splittable
+[[KYUUBI #5018](https://github.com/apache/kyuubi/pull/5018)] Make kyuubi spark
extension compatible with Spark 3.4
+[[KYUUBI #5022](https://github.com/apache/kyuubi/pull/5022)] [KSHC]
CreateTable should use the correct provider
+[[KYUUBI #5023](https://github.com/apache/kyuubi/pull/5023)] [KSHC]
TableIdentify don't attach catalog
+[[KYUUBI #5025](https://github.com/apache/kyuubi/pull/5025)] Use
formatDuration instead of formatDurationVerbose in Spark UI's engine tab
+[[KYUUBI #5028](https://github.com/apache/kyuubi/pull/5028)] Update session
hadoop conf to catalog hadoop conf
+[[KYUUBI #5030](https://github.com/apache/kyuubi/pull/5030)] Support get query
id in Spark engine
+[[KYUUBI #5035](https://github.com/apache/kyuubi/pull/5035)] Spark engine
session page display session end time and duration
+[[KYUUBI #5045](https://github.com/apache/kyuubi/pull/5045)] Initialize
EXECUTOR_POD_NAME_PREFIX_MAX_LENGTH before using
+[[KYUUBI #5055](https://github.com/apache/kyuubi/pull/5055)] [AUTHZ] Support
building function privileges in Spark 3.4
+[[KYUUBI #5073](https://github.com/apache/kyuubi/pull/5073)] Correct the
method name in SparkSQLLineageParserHelperSuite
+[[KYUUBI #5075](https://github.com/apache/kyuubi/pull/5075)] Refine tests to
adapt Spark 4.0
+[[KYUUBI #5076](https://github.com/apache/kyuubi/pull/5076)] Add KDF engine_url
+[[KYUUBI #5105](https://github.com/apache/kyuubi/pull/5105)] GetColumns gets
duplicate column names when Spark integrates with Iceberg
+[[KYUUBI #5136](https://github.com/apache/kyuubi/pull/5136)] Spark App may
hang forever if FinalStageResourceManager killed all executors
+[[KYUUBI #5148](https://github.com/apache/kyuubi/pull/5148)] Improve
spark.driver.host assignment in Spark on K8s client mode
+[[KYUUBI #5170](https://github.com/apache/kyuubi/pull/5170)] Identifier
compatible with Spark 3.4
+[[KYUUBI #5172](https://github.com/apache/kyuubi/pull/5172)] [AUTHZ] Check USE
permissions for DESCRIBE FUNCTION
+[[KYUUBI #5180](https://github.com/apache/kyuubi/pull/5180)] Replace
deprecated classes by equivalent in scala.tools.nsc.interpreter package
+[[KYUUBI #5184](https://github.com/apache/kyuubi/pull/5184)] Rename Kyuubi's
StageInfo to SparkStageInfo to fix class mismatch
+[[KYUUBI #5188](https://github.com/apache/kyuubi/pull/5188)] Make server
module and Spark sql engine module compilable on Scala 2.13
+[[KYUUBI #5189](https://github.com/apache/kyuubi/pull/5189)] [AUTHZ] Make
spark authz module compilable on Scala 2.13
+[[KYUUBI #5191](https://github.com/apache/kyuubi/pull/5191)] Make Spark
extension plugin compilable on Scala 2.13
+[[KYUUBI #5192](https://github.com/apache/kyuubi/pull/5192)] Make Spark sql
lineage plugin compilable on Scala 2.13
+[[KYUUBI #5193](https://github.com/apache/kyuubi/pull/5193)] Make Spark hive
connector plugin compilable on Scala 2.13
+[[KYUUBI #5195](https://github.com/apache/kyuubi/pull/5195)] Make Spark TPC-H
connector plugin compilable on Scala 2.13
+[[KYUUBI #5196](https://github.com/apache/kyuubi/pull/5196)] Enable CI Test on
Scala 2.13 and support custom or spark-core extracted Scala version for Spark's
engine
+[[KYUUBI #5196](https://github.com/apache/kyuubi/pull/5196)] Extract spark
core scala version lazily and respect engine env
+[[KYUUBI #5199](https://github.com/apache/kyuubi/pull/5199)] Read all columns
of metadata to prevent column missing
+[[KYUUBI #5202](https://github.com/apache/kyuubi/pull/5202)] Switch to Spark
3.4 by default
+[[KYUUBI #5224](https://github.com/apache/kyuubi/pull/5224)] Modify the README
file of authz to make spark 3.4 the default version
+[[KYUUBI #5225](https://github.com/apache/kyuubi/pull/5225)] [KSHC] Unify the
exception handling of v1 and v2 during dropDatabase
+[[KYUUBI #5232](https://github.com/apache/kyuubi/pull/5232)] In
SparkOperation#cleanup always calls cancelJobGroup even though it's in the
completed state
+[[KYUUBI #5257](https://github.com/apache/kyuubi/pull/5257)] [LINEAGE] Adapt
`CreateTableAsSelect` plan to Spark 3.5 changes
+[[KYUUBI #5268](https://github.com/apache/kyuubi/pull/5268)] [AUTHZ] Extract
method for enabling authorization in single call mode
+[[KYUUBI #5269](https://github.com/apache/kyuubi/pull/5269)] Duplicated
AnalyzesTablesCommand in kyuubi authz
+[[KYUUBI #5271](https://github.com/apache/kyuubi/pull/5271)]
AnalyzeTableCommand should also add table write privilege
+[[KYUUBI #5291](https://github.com/apache/kyuubi/pull/5291)] Verify Spark
engine is compatible with Spark 3.5.0
+[[KYUUBI #5317](https://github.com/apache/kyuubi/pull/5317)] [KSHC] Hive
Connector throws NotSerializableException on reading Hive Avro partitioned table
+[[KYUUBI #5336](https://github.com/apache/kyuubi/pull/5336)] Spark extension
supports Spark 3.5
+[[KYUUBI #5339](https://github.com/apache/kyuubi/pull/5339)] Avoid using
`kyuubi.session.engine.initialize.timeout` string
+[[KYUUBI #5414](https://github.com/apache/kyuubi/pull/5414)] [KSHC] Reader
should not pollute the global hiveConf instance
+[[KYUUBI #5426](https://github.com/apache/kyuubi/pull/5426)] [KSHC] Avoid use
class.newInstance directly
+[[KYUUBI #5550](https://github.com/apache/kyuubi/pull/5550)] Optimizing TPC-DS
dataset generation for 10x speedup
+
+### Flink Engine
+
+[[KYUUBI #1652](https://github.com/apache/kyuubi/pull/1652)] Support Flink
YARN application mode
+[[KYUUBI #4367](https://github.com/apache/kyuubi/pull/4367)] Support Flink 1.17
+[[KYUUBI #4387](https://github.com/apache/kyuubi/pull/4387)] Remove support
for Flink 1.14
+[[KYUUBI #4446](https://github.com/apache/kyuubi/pull/4446)] Fix connections
blocked by Flink insert statements
+[[KYUUBI #4495](https://github.com/apache/kyuubi/pull/4495)] Support Flink job
management statements
+[[KYUUBI #4517](https://github.com/apache/kyuubi/pull/4517)] Fix multiple
executions lead to abnormal results on Flink 1.14
+[[KYUUBI #4635](https://github.com/apache/kyuubi/pull/4635)] Support flink
time type in query operation
+[[KYUUBI #4666](https://github.com/apache/kyuubi/pull/4666)] Support flink
varbinary type in query operation
+[[KYUUBI #4745](https://github.com/apache/kyuubi/pull/4745)] Support Flink's
LocalZonedTimestamp DataType
+[[KYUUBI #4806](https://github.com/apache/kyuubi/pull/4806)] Support time-out
incremental result fetch for Flink engine
+[[KYUUBI #4861](https://github.com/apache/kyuubi/pull/4861)] Support Flink
session idleness
+[[KYUUBI #4938](https://github.com/apache/kyuubi/pull/4938)] Implement Kyuubi
UDF in Flink engine
+[[KYUUBI #5080](https://github.com/apache/kyuubi/pull/5080)] Fix
EmbeddedExecutorFactory not thread-safe during bootstrap
+[[KYUUBI #5106](https://github.com/apache/kyuubi/pull/5106)] Improve logs for
fatal errors
+[[KYUUBI #5108](https://github.com/apache/kyuubi/pull/5108)] Fix
FileNotFoundException during Flink engine bootstrap
+[[KYUUBI #5160](https://github.com/apache/kyuubi/pull/5160)] Refactor
getNextRowSetInternal to support fetch streaming data
+[[KYUUBI #5190](https://github.com/apache/kyuubi/pull/5190)] Explicitly name
Flink bootstrap SQL in application mode
+[[KYUUBI #5200](https://github.com/apache/kyuubi/pull/5200)] Optimize Flink
application name generating
+[[KYUUBI #5222](https://github.com/apache/kyuubi/pull/5222)] Remove unused
provided dependencies in Flink SQL engine
+[[KYUUBI #5238](https://github.com/apache/kyuubi/pull/5238)] Fix credentials
may break Flink engine launch command
+[[KYUUBI #5315](https://github.com/apache/kyuubi/pull/5315)] Propagate
HIVE_CONF_DIR on launching Flink engine
+[[KYUUBI #5405](https://github.com/apache/kyuubi/pull/5405)] Support Flink 1.18
+[[KYUUBI #5531](https://github.com/apache/kyuubi/pull/5531)] Fix flaky
FlinkOperationOnYarnSuite by enlarging the max rows setting
+
+### Other Engines
+
+[[KYUUBI #3374](https://github.com/apache/kyuubi/pull/3374)] Support password
authentication for Trino engine
+[[KYUUBI #4412](https://github.com/apache/kyuubi/pull/4412)] Align the
server/engine session handle for flink/hive/trino/jdbc engines
+[[KYUUBI #4491](https://github.com/apache/kyuubi/pull/4491)] Fix Trino typo
+[[KYUUBI #4522](https://github.com/apache/kyuubi/pull/4522)] `use:catalog`
should execute before than `use:database`
+[[KYUUBI #4544](https://github.com/apache/kyuubi/pull/4544)] Initial implement
Kyuubi Chat Engine
+[[KYUUBI #4548](https://github.com/apache/kyuubi/pull/4548)] Kyuubi Chat
Engine supports Chinese questions and HTTP proxy
+[[KYUUBI #4554](https://github.com/apache/kyuubi/pull/4554)] Code improvement
in ChatGPTProvider
+[[KYUUBI #4556](https://github.com/apache/kyuubi/pull/4556)] Refactor
ChatGPTProvider to use `openai-java` client
+[[KYUUBI #4558](https://github.com/apache/kyuubi/pull/4558)] Make ChatGPT
model ID configurable
+[[KYUUBI #4559](https://github.com/apache/kyuubi/pull/4559)] Pretty chat
engine launch command
+[[KYUUBI #4711](https://github.com/apache/kyuubi/pull/4711)] JDBC client
should catch task failed exception instead of NPE in the incremental mode
+[[KYUUBI #4809](https://github.com/apache/kyuubi/pull/4809)] Set session user
in ChatGPT request
+[[KYUUBI #4810](https://github.com/apache/kyuubi/pull/4810)] Request and use a
single choice for chat completion
+[[KYUUBI #4881](https://github.com/apache/kyuubi/pull/4881)] JDBCEngine
performs initialization sql
+[[KYUUBI #4940](https://github.com/apache/kyuubi/pull/4940)] Implement Kyuubi
UDF in Hive engine
+[[KYUUBI #5120](https://github.com/apache/kyuubi/pull/5120)] Allow using
session's user and password for connecting database in JDBC engine
+[[KYUUBI #5282](https://github.com/apache/kyuubi/pull/5282)] Support configure
Trino session conf in `kyuubi-default.conf`
+[[KYUUBI #5333](https://github.com/apache/kyuubi/pull/5333)] Adaptive call
fetchLaunchEngineResult
+[[KYUUBI #5570](https://github.com/apache/kyuubi/pull/5570)] Fix memory leak
when using incremental collect mode in JDBC engine
+
+### Server
+
+[[KYUUBI #3653](https://github.com/apache/kyuubi/pull/3653)] AdminResource add
list Kyuubi server api
+[[KYUUBI #3739](https://github.com/apache/kyuubi/pull/3739)] Remove unused
parameters in SessionsResource rest docs
+[[KYUUBI #3872](https://github.com/apache/kyuubi/pull/3872)] Skip setting
proxy user when keytab is provided on batch session
+[[KYUUBI #3876](https://github.com/apache/kyuubi/pull/3876)] Update the rest
api docs for open session response
+[[KYUUBI #3920](https://github.com/apache/kyuubi/pull/3920)] Fix flaky test -
distribute lock
+[[KYUUBI #3957](https://github.com/apache/kyuubi/pull/3957)] Rename the config
prefix from kyuubi.server.batch.limit to kyuubi.server.limit.batch
+[[KYUUBI #4325](https://github.com/apache/kyuubi/pull/4325)] Support replace
preparedStatement for Trino-jdbc
+[[KYUUBI #4344](https://github.com/apache/kyuubi/pull/4344)] Expose exec pool
work queue size metrics
+[[KYUUBI #4364](https://github.com/apache/kyuubi/pull/4364)] Add metrics for
user opened connections with session type
+[[KYUUBI #4376](https://github.com/apache/kyuubi/pull/4376)] Support to config
the Kyuubi service administrator with Kyuubi conf
+[[KYUUBI #4388](https://github.com/apache/kyuubi/pull/4388)] Limit the max
rows for get nextRowSet api
+[[KYUUBI #4404](https://github.com/apache/kyuubi/pull/4404)] Support to
list/close sessions in AdminResource
+[[KYUUBI #4407](https://github.com/apache/kyuubi/pull/4407)] Adapt SLF4J2
+[[KYUUBI #4424](https://github.com/apache/kyuubi/pull/4424)] Catch No Node
Exception, when list kyuubi engines
+[[KYUUBI #4439](https://github.com/apache/kyuubi/pull/4439)] Add list/close
operation method for AdminResource
+[[KYUUBI #4462](https://github.com/apache/kyuubi/pull/4462)] Fix variable
usage issue in `SessionManager#stop`
+[[KYUUBI #4464](https://github.com/apache/kyuubi/pull/4464)] Simplify and
improve log for JDBCMetadataStore
+[[KYUUBI #4467](https://github.com/apache/kyuubi/pull/4467)] Tolerate Driver
Pod ephemerally invisible after submitting
+[[KYUUBI #4472](https://github.com/apache/kyuubi/pull/4472)] add
session/operation methods in AdminRestApi
+[[KYUUBI #4480](https://github.com/apache/kyuubi/pull/4480)] Engine alive
probe should close thrift connection on engine lost
+[[KYUUBI #4482](https://github.com/apache/kyuubi/pull/4482)] Support to
disable batch resource upload function
+[[KYUUBI #4483](https://github.com/apache/kyuubi/pull/4483)] Enable REST
frontend protocol by default
+[[KYUUBI #4496](https://github.com/apache/kyuubi/pull/4496)] Call
`super.clusterManager()` when `batchConf` does not have `spark.master`
+[[KYUUBI #4498](https://github.com/apache/kyuubi/pull/4498)] Support to list
sessions/operations with conditions in AdminRestApi
+[[KYUUBI #4501](https://github.com/apache/kyuubi/pull/4501)] Allow
administrator to specify the user for engine admin
+[[KYUUBI #4506](https://github.com/apache/kyuubi/pull/4506)] Return
sessionType in session data
+[[KYUUBI #4516](https://github.com/apache/kyuubi/pull/4516)] Return kyuubi
instance in SessionData and OperationData
+[[KYUUBI #4518](https://github.com/apache/kyuubi/pull/4518)] Return engine id
in SessionData and post kyuubi instance in KyuubiOperationEvent
+[[KYUUBI #4519](https://github.com/apache/kyuubi/pull/4519)] Update metadata
when batch application state changed
+[[KYUUBI #4523](https://github.com/apache/kyuubi/pull/4523)] support close
engine session gracefully
+[[KYUUBI #4526](https://github.com/apache/kyuubi/pull/4526)] Defer evaluation
for GroupProvider
+[[KYUUBI #4540](https://github.com/apache/kyuubi/pull/4540)] Support to deny
some users to make connection
+[[KYUUBI #4540](https://github.com/apache/kyuubi/pull/4540)] Create session
limiter if user unlimited list or deny list nonempty
+[[KYUUBI #4563](https://github.com/apache/kyuubi/pull/4563)] Format error log
output in case of metrics json file not found
+[[KYUUBI #4575](https://github.com/apache/kyuubi/pull/4575)] Fix the empty
last line may causes the session to exit directly
+[[KYUUBI #4579](https://github.com/apache/kyuubi/pull/4579)] Fix the unstable
situation of test cases for Trino-Fronted-Service
+[[KYUUBI #4584](https://github.com/apache/kyuubi/pull/4584)] Post the session
exception to EventBus in time
+[[KYUUBI #4594](https://github.com/apache/kyuubi/pull/4594)] Support PUT
method in REST client
+[[KYUUBI #4611](https://github.com/apache/kyuubi/pull/4611)] support all
sessions api in SessionRestApi
+[[KYUUBI #4618](https://github.com/apache/kyuubi/pull/4618)] Admin Resource
list operations with sessionHandle filter
+[[KYUUBI #4623](https://github.com/apache/kyuubi/pull/4623)]
KubernetesApplicationOperation uses Informer instead of list
+[[KYUUBI #4639](https://github.com/apache/kyuubi/pull/4639)] Support to
specify confOverlay when executing statement with RESTful API
+[[KYUUBI #4652](https://github.com/apache/kyuubi/pull/4652)] Fix
JaasConfiguration ClassNotFoundException for Hadoop 3.3.4 and previous
+[[KYUUBI #4653](https://github.com/apache/kyuubi/pull/4653)] [KYUUBI 4650]
LogDivertAppender supports reading RollingFileAppender pattern
+[[KYUUBI #4669](https://github.com/apache/kyuubi/pull/4669)] LDAP
authentication allows auth user contains domain when bind.dn/pw enabled
+[[KYUUBI #4688](https://github.com/apache/kyuubi/pull/4688)] Fix the failure
to read the operation log after executing catalog and database operation
+[[KYUUBI #4691](https://github.com/apache/kyuubi/pull/4691)] Configure
FAIL_ON_UNKNOWN_PROPERTIES to false for KyuubiScalaObjectMapper
+[[KYUUBI #4713](https://github.com/apache/kyuubi/pull/4713)] Fix false
positive result in SchedulerPoolSuite
+[[KYUUBI #4719](https://github.com/apache/kyuubi/pull/4719)] Support
submission timeout for yarn application manager and get the applicationInfo
in-memory
+[[KYUUBI #4731](https://github.com/apache/kyuubi/pull/4731)] Support batch
session conf advisor
+[[KYUUBI #4733](https://github.com/apache/kyuubi/pull/4733)] Introduce Kafka
event logger for server events
+[[KYUUBI #4738](https://github.com/apache/kyuubi/pull/4738)]
`AdminResource.getEngineSpace` should use primary group name on GROUP share
level
+[[KYUUBI #4739](https://github.com/apache/kyuubi/pull/4739)] Add operation
lock instead of locking state Enumeration
+[[KYUUBI #4746](https://github.com/apache/kyuubi/pull/4746)] Do not recreate
async request executor if has been shutdown
+[[KYUUBI #4749](https://github.com/apache/kyuubi/pull/4749)] Fix flaky test
issues in SchedulerPoolSuite
+[[KYUUBI #4753](https://github.com/apache/kyuubi/pull/4753)] KyuubiConf.unset
should not log deprecation warning
+[[KYUUBI #4767](https://github.com/apache/kyuubi/pull/4767)] Correct the
submit time for BatchJobSubmission and check applicationInfo if submitted
application
+[[KYUUBI #4777](https://github.com/apache/kyuubi/pull/4777)] Deregister event
handlers when stopping server with event handler made auto-closeable
+[[KYUUBI #4780](https://github.com/apache/kyuubi/pull/4780)] Get engine
application info with interval to prevent frequent call to resource manager
+[[KYUUBI #4786](https://github.com/apache/kyuubi/pull/4786)] Support
yarn-client and yarn-cluster for YarnApplicationOperation
+[[KYUUBI #4790](https://github.com/apache/kyuubi/pull/4790)] Initial implement
Batch V2
+[[KYUUBI #4791](https://github.com/apache/kyuubi/pull/4791)] Add helper method
to simplify REST enabled judgment
+[[KYUUBI #4792](https://github.com/apache/kyuubi/pull/4792)] Enhance hardcode
session keywords and remove unused code
+[[KYUUBI #4796](https://github.com/apache/kyuubi/pull/4796)] Expose JVM
attributes to metrics
+[[KYUUBI #4798](https://github.com/apache/kyuubi/pull/4798)] Allows
BatchJobSubmission to run in sync mode
+[[KYUUBI #4801](https://github.com/apache/kyuubi/pull/4801)] Using different
engine submit timeout config for kubernetes and yarn
+[[KYUUBI #4807](https://github.com/apache/kyuubi/pull/4807)] Fix flaky test
"basic batch rest client"
+[[KYUUBI #4807](https://github.com/apache/kyuubi/pull/4807)] Retry more times
to fix flaky test "spnego batch rest client"
+[[KYUUBI #4811](https://github.com/apache/kyuubi/pull/4811)] Do not update app
info after batch or application terminated
+[[KYUUBI #4813](https://github.com/apache/kyuubi/pull/4813)] Add the fetch
orientation parameter to the /v1/operations/:operationId/log interface
+[[KYUUBI #4814](https://github.com/apache/kyuubi/pull/4814)] Introduce Apache
Atlas hook support in lineage plugin
+[[KYUUBI #4816](https://github.com/apache/kyuubi/pull/4816)] Correct the
implementation of cleanup K8s terminated appInfo
+[[KYUUBI #4829](https://github.com/apache/kyuubi/pull/4829)] Support to expose
operation metrics
+[[KYUUBI #4830](https://github.com/apache/kyuubi/pull/4830)] Fix flaky test
"support to interrupt the thrift request if remote engine is broken"
+[[KYUUBI #4835](https://github.com/apache/kyuubi/pull/4835)] Using hive conf
to check whether to apply HIVE_DELEGATION_TOKEN
+[[KYUUBI #4836](https://github.com/apache/kyuubi/pull/4836)] Set
UncaughtExceptionHandler for thread to log exception
+[[KYUUBI #4840](https://github.com/apache/kyuubi/pull/4840)] Return cached
appInfo iif both op and app are terminated
+[[KYUUBI #4841](https://github.com/apache/kyuubi/pull/4841)] Log more info for
closing session
+[[KYUUBI #4842](https://github.com/apache/kyuubi/pull/4842)] Fix typo in etcd
client config
+[[KYUUBI #4843](https://github.com/apache/kyuubi/pull/4843)] Support multiple
kubernetes contexts and namespaces
+[[KYUUBI #4847](https://github.com/apache/kyuubi/pull/4847)] Close the session
immediately when engine corrupt
+[[KYUUBI #4847](https://github.com/apache/kyuubi/pull/4847)] Close the session
immediately when engine connection closed
+[[KYUUBI #4850](https://github.com/apache/kyuubi/pull/4850)] Change default EC
spec to secp521r1 for internal session variable signature
+[[KYUUBI #4855](https://github.com/apache/kyuubi/pull/4855)] Change socket
"connection refused" message match pattern
+[[KYUUBI #4857](https://github.com/apache/kyuubi/pull/4857)] Fix flaky test
TFrontendServiceSuite
+[[KYUUBI #4858](https://github.com/apache/kyuubi/pull/4858)] Relax test
message assertion in "sync query causes engine crash"
+[[KYUUBI #4859](https://github.com/apache/kyuubi/pull/4859)] HttpException
message should not be null
+[[KYUUBI #4865](https://github.com/apache/kyuubi/pull/4865)] Fix flaky test
BackendServiceMetricSuite
+[[KYUUBI #4876](https://github.com/apache/kyuubi/pull/4876)] fix Flaky test
BackendServiceMetricSuite (#4924)
+[[KYUUBI #4889](https://github.com/apache/kyuubi/pull/4889)] Admin command
line supports list server command
+[[KYUUBI #4890](https://github.com/apache/kyuubi/pull/4890)] Return operation
metrics in OperationData and fix typo
+[[KYUUBI #4893](https://github.com/apache/kyuubi/pull/4893)] Prevent null
collection for rest dto
+[[KYUUBI #4898](https://github.com/apache/kyuubi/pull/4898)] Fix logOperation
multiple read with missing line
+[[KYUUBI #4919](https://github.com/apache/kyuubi/pull/4919)] Fix the flaky
tests in the "open batch session" functionality within the
"BatchesResourceSuite"
+[[KYUUBI #4920](https://github.com/apache/kyuubi/pull/4920)] Add
OperationRestApi
+[[KYUUBI #4946](https://github.com/apache/kyuubi/pull/4946)] Alter the order
of initLoggerEventHandler
+[[KYUUBI #4949](https://github.com/apache/kyuubi/pull/4949)] For operation
getNextRowSet method, with operation lock required
+[[KYUUBI #4950](https://github.com/apache/kyuubi/pull/4950)] Migrate Kyuubi
embedded database from Derby to SQLite
+[[KYUUBI #4950](https://github.com/apache/kyuubi/pull/4950)] Misc improvement
for usage of SQLite
+[[KYUUBI #4950](https://github.com/apache/kyuubi/pull/4950)] SQLite schema
files should start from 1.8.0
+[[KYUUBI #4951](https://github.com/apache/kyuubi/pull/4951)] Add reload4j
support
+[[KYUUBI #4977](https://github.com/apache/kyuubi/pull/4977)] Log error message
when REST API invocation error occurs
+[[KYUUBI #4978](https://github.com/apache/kyuubi/pull/4978)] Fix flaky test:
close expired operations
+[[KYUUBI #4978](https://github.com/apache/kyuubi/pull/4978)] Fix flaky test:
close expired operations
+[[KYUUBI #4979](https://github.com/apache/kyuubi/pull/4979)] Fix flaky test:
support to interrupt the thrift request if remote engine is broken
+[[KYUUBI #4981](https://github.com/apache/kyuubi/pull/4981)] Refactor code of
closeBatchSession
+[[KYUUBI #4985](https://github.com/apache/kyuubi/pull/4985)] Fix log level
restore behavior of `KyuubiFunSuite#withLogAppender`
+[[KYUUBI #4986](https://github.com/apache/kyuubi/pull/4986)] Always use
Files#deleteIfExists
+[[KYUUBI #4994](https://github.com/apache/kyuubi/pull/4994)] Respect the
engine type and share level for listing all engines
+[[KYUUBI #4994](https://github.com/apache/kyuubi/pull/4994)] Support listing
all engines
+[[KYUUBI #4996](https://github.com/apache/kyuubi/pull/4996)] Support to
refresh kubernetes configs dynamically
+[[KYUUBI #5004](https://github.com/apache/kyuubi/pull/5004)] Fix typo for
kubernetes allowed context and namespace check
+[[KYUUBI #5010](https://github.com/apache/kyuubi/pull/5010)] Make Kyuubi
server's connection URL configurable
+[[KYUUBI #5029](https://github.com/apache/kyuubi/pull/5029)] Close the alive
probe session after engine session closed
+[[KYUUBI #5036](https://github.com/apache/kyuubi/pull/5036)] Fix
Operation.close not update complete timestamp
+[[KYUUBI #5043](https://github.com/apache/kyuubi/pull/5043)] Destroy the build
process when waitCompletion is false and the engine is running in cluster mode
+[[KYUUBI #5050](https://github.com/apache/kyuubi/pull/5050)] Add admin
checking in `getProxyUser`
+[[KYUUBI #5056](https://github.com/apache/kyuubi/pull/5056)] Return more
helpful error message to http client
+[[KYUUBI #5063](https://github.com/apache/kyuubi/pull/5063)] Support to filter
batch with batch name
+[[KYUUBI #5065](https://github.com/apache/kyuubi/pull/5065)] Call destroy
first on killing Spark startup process to allows it release temp files
+[[KYUUBI #5065](https://github.com/apache/kyuubi/pull/5065)] Graceful close
the process when launch engine timeout
+[[KYUUBI #5078](https://github.com/apache/kyuubi/pull/5078)] Make
`kyuubi_instance` nullable in metadata table schema
+[[KYUUBI #5081](https://github.com/apache/kyuubi/pull/5081)] Minor refactor
JDBCMetadataStore
+[[KYUUBI #5089](https://github.com/apache/kyuubi/pull/5089)] Limit maximum
engine startup concurrency of kyuubi server
+[[KYUUBI #5130](https://github.com/apache/kyuubi/pull/5130)] Allow setting
Zookeeper SPN using Kyuubi configuration
+[[KYUUBI #5131](https://github.com/apache/kyuubi/pull/5131)] Create index on
`metastore`.`create_time`
+[[KYUUBI #5138](https://github.com/apache/kyuubi/pull/5138)] Fix flaky test
BatchesResourceSuite - get batch session list
+[[KYUUBI #5145](https://github.com/apache/kyuubi/pull/5145)] Change embedded
Zookeeper server to method-local variable
+[[KYUUBI #5158](https://github.com/apache/kyuubi/pull/5158)] Allow embedded
Zookeeper binding IP address
+[[KYUUBI #5165](https://github.com/apache/kyuubi/pull/5165)] Build Spark
Driver/Executor Pod Name(Prefix) in process
+[[KYUUBI #5185](https://github.com/apache/kyuubi/pull/5185)] Use Set
collection for order-insensitive configs
+[[KYUUBI #5187](https://github.com/apache/kyuubi/pull/5187)] Fix info message
in UserFilter
+[[KYUUBI #5196](https://github.com/apache/kyuubi/pull/5196)] Extract spark
core scala version lazily and respect engine env
+[[KYUUBI #5201](https://github.com/apache/kyuubi/pull/5201)] Allow disabling
batch impl v2 on globally
+[[KYUUBI #5204](https://github.com/apache/kyuubi/pull/5204)] Thrift HTTP FE
checks req conf nullable before evaluating proxy user
+[[KYUUBI #5206](https://github.com/apache/kyuubi/pull/5206)] Try to kill pod
with label if no ApplicationInfo found to prevent pod leak
+[[KYUUBI #5210](https://github.com/apache/kyuubi/pull/5210)] Cancel operation
will cause the log file node to leak
+[[KYUUBI #5213](https://github.com/apache/kyuubi/pull/5213)] Check config
value by enum values
+[[KYUUBI #5216](https://github.com/apache/kyuubi/pull/5216)] Workaround for
negative counter in SessionLimiter
+[[KYUUBI #5218](https://github.com/apache/kyuubi/pull/5218)] Improve logs of
KubernetesApplicationOperation
+[[KYUUBI #5220](https://github.com/apache/kyuubi/pull/5220)] Batch submitter
should only block submitting stage
+[[KYUUBI #5220](https://github.com/apache/kyuubi/pull/5220)] Batch submitted
considers application state
+[[KYUUBI #5243](https://github.com/apache/kyuubi/pull/5243)] Distinguish
metadata between batch impl v2 and recovery
+[[KYUUBI #5289](https://github.com/apache/kyuubi/pull/5289)] RESTful API
should always print audit log
+[[KYUUBI #5290](https://github.com/apache/kyuubi/pull/5290)] Batch impl v2
should pick batch jobs in FIFO
+[[KYUUBI #5300](https://github.com/apache/kyuubi/pull/5300)] Batch v2 should
not update kyuubi_instance when open session
+[[KYUUBI #5305](https://github.com/apache/kyuubi/pull/5305)] Return dummy log
when batch job before being added to session manager
+[[KYUUBI #5306](https://github.com/apache/kyuubi/pull/5306)]
YarnApplicationOperation supports proxy user
+[[KYUUBI #5310](https://github.com/apache/kyuubi/pull/5310)] Batch session
recovery should start after HTTP server getting started
+[[KYUUBI #5327](https://github.com/apache/kyuubi/pull/5327)] Add priority
field in batch session metadata table definition
+[[KYUUBI #5328](https://github.com/apache/kyuubi/pull/5328)] Batch supports
priority scheduling
+[[KYUUBI #5340](https://github.com/apache/kyuubi/pull/5340)]
AdminResourceSuite make engine idle time 3min
+[[KYUUBI #5380](https://github.com/apache/kyuubi/pull/5380)] Create PySpark
batch jobs tests for RESTful API
+[[KYUUBI #5381](https://github.com/apache/kyuubi/pull/5381)] Change the
default metrics reporter to Prometheus
+[[KYUUBI #5391](https://github.com/apache/kyuubi/pull/5391)] Close batch
session after batch operation completion for idle timeout
+[[KYUUBI #5392](https://github.com/apache/kyuubi/pull/5392)] Add query timeout
monitor on server-side in ExecuteStatement
+[[KYUUBI #5408](https://github.com/apache/kyuubi/pull/5408)] MetadataManager
tries MySQL 8 driver class first
+[[KYUUBI #5412](https://github.com/apache/kyuubi/pull/5412)] Resolve the
relative zk configuration dir based on KYUUBI_HOME
+[[KYUUBI #5441](https://github.com/apache/kyuubi/pull/5441)] Make the
configuration kyuubi.zookeeper.embedded.data.log.dir effective
+[[KYUUBI #5451](https://github.com/apache/kyuubi/pull/5451)] Ignore
NoSuchFileException during OperationLog.close()
+[[KYUUBI #5499](https://github.com/apache/kyuubi/pull/5499)] [[KYUUBI
#2503](https://github.com/apache/kyuubi/pull/2503)] Catch any exception when
closing idle session
+[[KYUUBI #5513](https://github.com/apache/kyuubi/pull/5513)] Always redirect
delete batch request to Kyuubi instance that owns batch session
+[[KYUUBI #5522](https://github.com/apache/kyuubi/pull/5522)] Ignore main class
for PySpark batch job submission
+[[KYUUBI #5528](https://github.com/apache/kyuubi/pull/5528)] Remove duplicate
properties tag and respect KYUUBI_LOG_DIR
+[[KYUUBI #5566](https://github.com/apache/kyuubi/pull/5566)]
InternalRestClient respects `kyuubi.engine.security.enabled` to add HTTP auth
header
+[[KYUUBI #5566](https://github.com/apache/kyuubi/pull/5566)] Check
InternalSecurityAccessor is initialized only when
`kyuubi.engine.security.enabled` is true
+[[KYUUBI #5568](https://github.com/apache/kyuubi/pull/5568)] Check
administrator only when security is enabled
+[[KYUUBI #5568](https://github.com/apache/kyuubi/pull/5568)] Fix security
enabled judgement
+[[KYUUBI #5606](https://github.com/apache/kyuubi/pull/5606)] Handle engine
listing request properly for users who have not created engine
+
+### Client
+
+[[KYUUBI #3887](https://github.com/apache/kyuubi/pull/3887)] Fix
kyuubiServerPrincipal logic in KyuubiCommands
+[[KYUUBI #4305](https://github.com/apache/kyuubi/pull/4305)] Backport
HIVE-15820: comment at the head of beeline -e
+[[KYUUBI #4438](https://github.com/apache/kyuubi/pull/4438)] Render the batch
info map in kyuubi-ctl
+[[KYUUBI #4439](https://github.com/apache/kyuubi/pull/4439)] Add dto class for
operation data
+[[KYUUBI #4452](https://github.com/apache/kyuubi/pull/4452)] Strip the
redundant leading and tailing slash of getZooKeeperNamespace.
+[[KYUUBI #4479](https://github.com/apache/kyuubi/pull/4479)] Restore JDBC
Kerberos authentication behavior for UGI.doAs
+[[KYUUBI #4489](https://github.com/apache/kyuubi/pull/4489)] Fix missing
`org.apache.commons.logging` by including `jcl-over-slf4j` dependency in REST
client
+[[KYUUBI #4492](https://github.com/apache/kyuubi/pull/4492)] Correct engine
subdomain calculation in `kyuubi-ctl`
+[[KYUUBI #4508](https://github.com/apache/kyuubi/pull/4508)] Beeline should
reset stdin after consuming init SQL file
+[[KYUUBI #4581](https://github.com/apache/kyuubi/pull/4581)] Add
KyuubiCommands parse python snippets unit test
+[[KYUUBI #4609](https://github.com/apache/kyuubi/pull/4609)] get engineRefId
in KyuubiConnection
+[[KYUUBI #4619](https://github.com/apache/kyuubi/pull/4619)] Fix beeline with
-e when there are other SQL statements before the source statement, the source
statement cannot be executed normally
+[[KYUUBI #4657](https://github.com/apache/kyuubi/pull/4657)] Building rest
client to kyuubi instance including original host urls
+[[KYUUBI #4962](https://github.com/apache/kyuubi/pull/4962)] Backport
HIVE-19048: init script errors are ignored
+[[KYUUBI #4965](https://github.com/apache/kyuubi/pull/4965)] Beeline supports
`--python-mode` option and remove comments for non-python mode
+[[KYUUBI #4969](https://github.com/apache/kyuubi/pull/4969)] Run JUnit tests
on beeline module
+[[KYUUBI #5054](https://github.com/apache/kyuubi/pull/5054)] Refine the kyuubi
client version properties file to prevent conflicts
+[[KYUUBI #5100](https://github.com/apache/kyuubi/pull/5100)] Fix unpaired
quote in message pattern
+[[KYUUBI #5101](https://github.com/apache/kyuubi/pull/5101)] Remove unused
StringBuilders in ResultSets
+[[KYUUBI #5129](https://github.com/apache/kyuubi/pull/5129)] KyuubiBeeline
should redirect JDK logging
+[[KYUUBI #5179](https://github.com/apache/kyuubi/pull/5179)] Use Iterable
instead of Seq in kyuubi-ctl commands
+[[KYUUBI #5297](https://github.com/apache/kyuubi/pull/5297)] New
RetryableClient get http://null server uri from metadata.kyuubiInstance
+[[KYUUBI #5480](https://github.com/apache/kyuubi/pull/5480)] Support setting
kyuubi hive jdbc client protocol version
+[[KYUUBI #5564](https://github.com/apache/kyuubi/pull/5564)] Support to config
ticket cache location in JDBC URL
+
+### Web UI
+
+[[KYUUBI #3420](https://github.com/apache/kyuubi/pull/3420)] Kyuubi Server
Proxy Engine UI
+[[KYUUBI #3646](https://github.com/apache/kyuubi/pull/3646)] Front-end style
should bracket same line
+[[KYUUBI #3646](https://github.com/apache/kyuubi/pull/3646)] Init Session
Statistic Page
+[[KYUUBI #3648](https://github.com/apache/kyuubi/pull/3648)] Add Session
Detail Page
+[[KYUUBI #3650](https://github.com/apache/kyuubi/pull/3650)] Add Operation
Statistics Page
+[[KYUUBI #3652](https://github.com/apache/kyuubi/pull/3652)] Add Kyuubi Server
Management page
+[[KYUUBI #3654](https://github.com/apache/kyuubi/pull/3654)] Add Engine
Manager Page
+[[KYUUBI #4537](https://github.com/apache/kyuubi/pull/4537)] Enable Vite proxy
server for web ui development
+[[KYUUBI #4565](https://github.com/apache/kyuubi/pull/4565)] Fix out-date
`README.md` about `Development Project`
+[[KYUUBI #4622](https://github.com/apache/kyuubi/pull/4622)] Session api use
admin api for security
+[[KYUUBI #4626](https://github.com/apache/kyuubi/pull/4626)] Fix Web UI CI
check fail with pnpm the lockfile needs updates
+[[KYUUBI #4757](https://github.com/apache/kyuubi/pull/4757)] Move Statistics
to Management Menu
+[[KYUUBI #4982](https://github.com/apache/kyuubi/pull/4982)] Add query string
to forward requests to Engine UI
+[[KYUUBI #5259](https://github.com/apache/kyuubi/pull/5259)] Web UI supports
Swagger pages
+[[KYUUBI #5463](https://github.com/apache/kyuubi/pull/5463)] Adjust the file
directory structure
+[[KYUUBI #5484](https://github.com/apache/kyuubi/pull/5484)] Remove legacy Web
UI
+[[KYUUBI #5573](https://github.com/apache/kyuubi/pull/5573)] Delete parts of
the Kyuubi Web UI that are not useful
+[[KYUUBI #5586](https://github.com/apache/kyuubi/pull/5586)] Kyuubi Web UI
show current version
+[[KYUUBI #5608](https://github.com/apache/kyuubi/pull/5608)] Kyuubi version
should always use the light color
+[[KYUUBI #5620](https://github.com/apache/kyuubi/pull/5620)] Remove dummy
information card from Overview page
+
+### Documentation
+
+[[KYUUBI #4308](https://github.com/apache/kyuubi/pull/4308)] Make README more
welcoming
+[[KYUUBI #4312](https://github.com/apache/kyuubi/pull/4312)] Fix over-matched
README pattern for markdown styling
+[[KYUUBI #4367](https://github.com/apache/kyuubi/pull/4367)] Kyuubi requires
Flink 1.16/1.17
+[[KYUUBI #4387](https://github.com/apache/kyuubi/pull/4387)] Update Flink
version requirements
+[[KYUUBI #4568](https://github.com/apache/kyuubi/pull/4568)] Make kyuubi-ctl
doc enable variable 'release' automatic substitution
+[[KYUUBI #4583](https://github.com/apache/kyuubi/pull/4583)] Rename Flink
Table Store to Apache Paimon (Incubating)
+[[KYUUBI #4593](https://github.com/apache/kyuubi/pull/4593)] Keep promote the
release step update-to-date
+[[KYUUBI #4599](https://github.com/apache/kyuubi/pull/4599)] Simplify project
version evaluation
+[[KYUUBI #4607](https://github.com/apache/kyuubi/pull/4607)] Rename Flink
Table Store to Apache Paimon (Incubating) in docs `Connectors for Hive SQL
Query Engine`
+[[KYUUBI #4608](https://github.com/apache/kyuubi/pull/4608)] Rename Flink
Table Store to Apache Paimon (Incubating) in docs `Connectors for Trino SQL
Query Engine`
+[[KYUUBI #4614](https://github.com/apache/kyuubi/pull/4614)] Rename Flink
Table Store to Apache Paimon (Incubating) in docs `Connectors for Flink SQL
Query Engine`
+[[KYUUBI #4624](https://github.com/apache/kyuubi/pull/4624)] Fix table headers
in kyuubi_vs_hive.md
+[[KYUUBI #4627](https://github.com/apache/kyuubi/pull/4627)] Fix a typo in
rest_api.md.
+[[KYUUBI #4655](https://github.com/apache/kyuubi/pull/4655)] Enrich docs for
Kyuubi Hive JDBC driver
+[[KYUUBI #4655](https://github.com/apache/kyuubi/pull/4655)] Recover the
missing JDBC URL
+[[KYUUBI #4722](https://github.com/apache/kyuubi/pull/4722)] Kyuubi requires
Spark 3.1 and above now
+[[KYUUBI #4727](https://github.com/apache/kyuubi/pull/4727)]
kyuubi-spark-lineage has no transitive deps
+[[KYUUBI #4734](https://github.com/apache/kyuubi/pull/4734)] Fix typo in docs
of custom event handler
+[[KYUUBI #4742](https://github.com/apache/kyuubi/pull/4742)] Add docs for
Flink application mode
+[[KYUUBI #4763](https://github.com/apache/kyuubi/pull/4763)] Fix the Kyuubi
JDBC kerberos parameters
+[[KYUUBI #4800](https://github.com/apache/kyuubi/pull/4800)] Update
readthedocs.yaml
+[[KYUUBI #4864](https://github.com/apache/kyuubi/pull/4864)] Fix grammar in HA
section
+[[KYUUBI #4933](https://github.com/apache/kyuubi/pull/4933)] Mark
`spark.sql.optimizer.insertRepartitionNum` config for Spark 3.1 only
+[[KYUUBI #4954](https://github.com/apache/kyuubi/pull/4954)] Fix variable
reference in quick_start_with_jdbc
+[[KYUUBI #4960](https://github.com/apache/kyuubi/pull/4960)] Fix doc for
pyhive client.
+[[KYUUBI #5049](https://github.com/apache/kyuubi/pull/5049)] PyHive Kerberos
usage doc
+[[KYUUBI #5083](https://github.com/apache/kyuubi/pull/5083)] Add LDAP document
+[[KYUUBI #5085](https://github.com/apache/kyuubi/pull/5085)] Update config
section of deploy on kubernetes
+[[KYUUBI #5094](https://github.com/apache/kyuubi/pull/5094)] Add Python
JayDeBeApi doc
+[[KYUUBI #5099](https://github.com/apache/kyuubi/pull/5099)] Document link
failure
+[[KYUUBI #5118](https://github.com/apache/kyuubi/pull/5118)] Add Flink KDF doc
+[[KYUUBI #5122](https://github.com/apache/kyuubi/pull/5122)] Hive KDF usage
+[[KYUUBI #5127](https://github.com/apache/kyuubi/pull/5127)] Improvements for
markdown builder
+[[KYUUBI #5146](https://github.com/apache/kyuubi/pull/5146)] Fix link of
IntelliJ IDEA Setup Guide
+[[KYUUBI #5153](https://github.com/apache/kyuubi/pull/5153)] Minor change w/
to with
+[[KYUUBI #5154](https://github.com/apache/kyuubi/pull/5154)] Move
configuration docs to the top level
+[[KYUUBI #5162](https://github.com/apache/kyuubi/pull/5162)] Add statements
about contributions co-authored with AIGC in developer guide page
+[[KYUUBI #5178](https://github.com/apache/kyuubi/pull/5178)] Make
MarkdownBuilder not extending Growable
+[[KYUUBI #5227](https://github.com/apache/kyuubi/pull/5227)] Added deploy mode
info
+[[KYUUBI #5247](https://github.com/apache/kyuubi/pull/5247)] Correct building
command for Spark authz/lineage plugins
+[[KYUUBI #5273](https://github.com/apache/kyuubi/pull/5273)] Update release
docs
+[[KYUUBI #5275](https://github.com/apache/kyuubi/pull/5275)] Improve and fix
comparison and regeneration for golden files
+[[KYUUBI #5294](https://github.com/apache/kyuubi/pull/5294)] Update supported
dialects for JDBC engine
+[[KYUUBI #5335](https://github.com/apache/kyuubi/pull/5335)] Set markdown file
EOL
+[[KYUUBI #5345](https://github.com/apache/kyuubi/pull/5345)] Fix
non-kerberized code description in quick_start_with_jdbc
+[[KYUUBI #5347](https://github.com/apache/kyuubi/pull/5347)] Fix java code
errors in quick_start_with_jdbc
+[[KYUUBI #5409](https://github.com/apache/kyuubi/pull/5409)] Update config
docs regeneration hints in developer guide
+[[KYUUBI #5432](https://github.com/apache/kyuubi/pull/5432)] Fix typo in
README.md
+[[KYUUBI #5523](https://github.com/apache/kyuubi/pull/5523)] Update the Kyuubi
supported components version
+
+### Building, Infrastructure and Dependency
+
+[[KYUUBI #4078](https://github.com/apache/kyuubi/pull/4078)] Fix shellcheck
violations in scripts of /bin folder
+[[KYUUBI #4187](https://github.com/apache/kyuubi/pull/4187)] Windows
build-info script supports revision time
+[[KYUUBI #4278](https://github.com/apache/kyuubi/pull/4278)] Use new Apache
'closer.lua' syntax to obtain Maven
+[[KYUUBI #4295](https://github.com/apache/kyuubi/pull/4295)] Introduce
`super-linter` action for linting JSON, XML, ENV files and bash_exec
+[[KYUUBI #4299](https://github.com/apache/kyuubi/pull/4299)] Bump JUnit to
4.13.2
+[[KYUUBI #4299](https://github.com/apache/kyuubi/pull/4299)] Bump MySQL JDBC
driver to 8.0.32
+[[KYUUBI #4315](https://github.com/apache/kyuubi/pull/4315)] Check modules
available before build step in dependency workflow
+[[KYUUBI #4347](https://github.com/apache/kyuubi/pull/4347)] Bump maven
download plugin from 1.6.6 to 1.6.8
+[[KYUUBI #4348](https://github.com/apache/kyuubi/pull/4348)] Cache engine
archives in CI jobs for maven download plugin
+[[KYUUBI #4397](https://github.com/apache/kyuubi/pull/4397)] `build/dist`
supports `--web-ui`
+[[KYUUBI #4413](https://github.com/apache/kyuubi/pull/4413)] Build docker
image should include web UI
+[[KYUUBI #4447](https://github.com/apache/kyuubi/pull/4447)] Bump log4j from
2.19.0 to 2.20.0
+[[KYUUBI #4448](https://github.com/apache/kyuubi/pull/4448)] Bump Netty from
4.1.87.Final to 4.1.89.Final
+[[KYUUBI #4451](https://github.com/apache/kyuubi/pull/4451)] Skip etcd test if
no docker env
+[[KYUUBI #4453](https://github.com/apache/kyuubi/pull/4453)] Bump Kubernetes
Client Version to 6.4.1
+[[KYUUBI #4461](https://github.com/apache/kyuubi/pull/4461)] Add `Kyuubi
Kubernetes IT` Module to CI style check
+[[KYUUBI #4466](https://github.com/apache/kyuubi/pull/4466)] Use bitnami/minio
docker image
+[[KYUUBI #4471](https://github.com/apache/kyuubi/pull/4471)] Prompted command
for docs generation should skip Java tests
+[[KYUUBI #4484](https://github.com/apache/kyuubi/pull/4484)] [K8S][HELM] Set
specific Kyuubi version to the chart appVersion
+[[KYUUBI #4494](https://github.com/apache/kyuubi/pull/4494)] `bin/kyuubi`
should use `exec` to run Kyuubi server
+[[KYUUBI #4513](https://github.com/apache/kyuubi/pull/4513)] Bump Kyuubi 1.7.0
in Playground
+[[KYUUBI #4546](https://github.com/apache/kyuubi/pull/4546)] Fully exclude
`metrics` dir from git
+[[KYUUBI #4557](https://github.com/apache/kyuubi/pull/4557)] [K8S][HELM]
Kyuubi server should bind Pod IP by default
+[[KYUUBI #4572](https://github.com/apache/kyuubi/pull/4572)] Bump Iceberg from
1.1.0 to 1.2.0
+[[KYUUBI #4576](https://github.com/apache/kyuubi/pull/4576)] Multi arch build
for ARM support in Docker Hub
+[[KYUUBI #4589](https://github.com/apache/kyuubi/pull/4589)] [K8S][HELM]
Update template on port-forward usage guide NOTES.txt
+[[KYUUBI #4590](https://github.com/apache/kyuubi/pull/4590)] Bump delta from
2.2.0 to 2.3.0
+[[KYUUBI #4598](https://github.com/apache/kyuubi/pull/4598)] Bump Flink-1.15
from 1.15.3 to 1.15.4
+[[KYUUBI #4600](https://github.com/apache/kyuubi/pull/4600)] Bump Iceberg
1.2.0 for playground
+[[KYUUBI #4601](https://github.com/apache/kyuubi/pull/4601)] Bump Hadoop 3.3.5
for playground
+[[KYUUBI #4605](https://github.com/apache/kyuubi/pull/4605)] [K8S][HELM] Set
IfNotPresent pullPolicy by default
+[[KYUUBI #4606](https://github.com/apache/kyuubi/pull/4606)] [K8S][HELM] Add
command and args configuration support
+[[KYUUBI #4615](https://github.com/apache/kyuubi/pull/4615)] Bump Ranger from
2.3.0 to 2.4.0
+[[KYUUBI #4628](https://github.com/apache/kyuubi/pull/4628)] Add Dependency
management ISSUE_TEMPLATE
+[[KYUUBI #4632](https://github.com/apache/kyuubi/pull/4632)] Add rule for
labeler to tag `module:ui`
+[[KYUUBI #4638](https://github.com/apache/kyuubi/pull/4638)] Update
dependency.yml as label in not permitted in markdown block
+[[KYUUBI #4652](https://github.com/apache/kyuubi/pull/4652)] Upgrade Hadoop
from 3.3.4 to 3.3.5
+[[KYUUBI #4695](https://github.com/apache/kyuubi/pull/4695)] Bump super-linter
action from v4 to v5
+[[KYUUBI #4696](https://github.com/apache/kyuubi/pull/4696)] Upgrade scalafmt
from 3.7.1 to 3.7.3
+[[KYUUBI #4697](https://github.com/apache/kyuubi/pull/4697)] [K8S][HELM] Add
template rendering info to README
+[[KYUUBI #4698](https://github.com/apache/kyuubi/pull/4698)] [K8S][HELM]
Centralize Kyuubi labels definition
+[[KYUUBI #4706](https://github.com/apache/kyuubi/pull/4706)] [K8S][HELM] Use
template comments for the chart license header
+[[KYUUBI #4707](https://github.com/apache/kyuubi/pull/4707)] [K8S][HELM] Fix
README typo and minor reformatting
+[[KYUUBI #4712](https://github.com/apache/kyuubi/pull/4712)] Bump Spark from
3.2.3 to 3.2.4
+[[KYUUBI #4737](https://github.com/apache/kyuubi/pull/4737)] Restore Project &
Community Status in README.md
+[[KYUUBI #4744](https://github.com/apache/kyuubi/pull/4744)] Remove Hudi
integration tests
+[[KYUUBI #4747](https://github.com/apache/kyuubi/pull/4747)] Install and cache
build/mvn in CI builds
+[[KYUUBI #4768](https://github.com/apache/kyuubi/pull/4768)] Guidelines for
Document and Code contributions
+[[KYUUBI #4772](https://github.com/apache/kyuubi/pull/4772)] Bump Jersey from
2.39 to 2.39.1
+[[KYUUBI #4783](https://github.com/apache/kyuubi/pull/4783)] Use pnpm v8 and
update pnpm lockfile to v6 schema
+[[KYUUBI #4784](https://github.com/apache/kyuubi/pull/4784)] Use nodejs v18 in
CI builds and maven web-ui builds
+[[KYUUBI #4788](https://github.com/apache/kyuubi/pull/4788)] [K8S][HELM] Use
StatefulSet instead of Deployment
+[[KYUUBI #4805](https://github.com/apache/kyuubi/pull/4805)] Bump openai-java
from 0.11.1 to 0.12.0
+[[KYUUBI #4808](https://github.com/apache/kyuubi/pull/4808)] Bump Jetty from
9.4.50 to 9.4.51
+[[KYUUBI #4818](https://github.com/apache/kyuubi/pull/4818)] [K8S][HELM]
Update default Kyuubi version to 1.7.1
+[[KYUUBI #4819](https://github.com/apache/kyuubi/pull/4819)] [K8S][HELM]
Refactor liveliness and readiness probes
+[[KYUUBI #4824](https://github.com/apache/kyuubi/pull/4824)] Bump Jackson from
2.14.2 to 2.15.0
+[[KYUUBI #4827](https://github.com/apache/kyuubi/pull/4827)] Bump Apache Arrow
from 11.0.0 to 12.0.0
+[[KYUUBI #4828](https://github.com/apache/kyuubi/pull/4828)] Exclude macOS tar
extended metadata in build/dist
+[[KYUUBI #4849](https://github.com/apache/kyuubi/pull/4849)] Open modules to
enable JDK 17 support
+[[KYUUBI #4851](https://github.com/apache/kyuubi/pull/4851)] Bump Maven 3.8.8
+[[KYUUBI #4852](https://github.com/apache/kyuubi/pull/4852)] Switch to Kyuubi
Shaded Zookeeper
+[[KYUUBI #4856](https://github.com/apache/kyuubi/pull/4856)] Add
`restore-keys` for `action/cache`
+[[KYUUBI #4870](https://github.com/apache/kyuubi/pull/4870)] Add kyuubi-util
and kyuubi-util-scala modules
+[[KYUUBI #4877](https://github.com/apache/kyuubi/pull/4877)] Bump Flink 1.17
to 1.17.1
+[[KYUUBI #4879](https://github.com/apache/kyuubi/pull/4879)] Refactor and
promote reflection utils and cleanup similar reflection methods
+[[KYUUBI #4883](https://github.com/apache/kyuubi/pull/4883)] Bump Iceberg 1.3.0
+[[KYUUBI #4887](https://github.com/apache/kyuubi/pull/4887)] Refactor and add
ut for ClassUtils
+[[KYUUBI #4891](https://github.com/apache/kyuubi/pull/4891)] Bump Flink 1.16.2
+[[KYUUBI #4894](https://github.com/apache/kyuubi/pull/4894)] Bump Mockito from
4.9.0 to 4.11.0 and ScalaTest from 3.2.15 to 3.2.16
+[[KYUUBI #4904](https://github.com/apache/kyuubi/pull/4904)] Move
AssertionUtils to kyuubi-util-scala module
+[[KYUUBI #4905](https://github.com/apache/kyuubi/pull/4905)] Generalize util
method for loading class from service loader
+[[KYUUBI #4907](https://github.com/apache/kyuubi/pull/4907)] Add a maven
profile 'remote-debug'
+[[KYUUBI #4908](https://github.com/apache/kyuubi/pull/4908)] Bump scalafmt
from 3.7.3 to 3.7.4
+[[KYUUBI #4911](https://github.com/apache/kyuubi/pull/4911)] Remove duplicate
test annotations `org.apache.kyuubi.tags.*` in kyuubi-common
+[[KYUUBI #4912](https://github.com/apache/kyuubi/pull/4912)] Replace Scala's
assert in tests with scalatest's for prettified error message
+[[KYUUBI #4931](https://github.com/apache/kyuubi/pull/4931)] Bump vite from
3.0.0 to 4.2.3 and vitest from 0.22.0 to 0.32.0
+[[KYUUBI #4937](https://github.com/apache/kyuubi/pull/4937)] Remove redundant
quoteIfNeeded method
+[[KYUUBI #4943](https://github.com/apache/kyuubi/pull/4943)] Bump Guava from
31.1 to 32.0.1
+[[KYUUBI #4944](https://github.com/apache/kyuubi/pull/4944)] Code improvement
for Java
+[[KYUUBI #4947](https://github.com/apache/kyuubi/pull/4947)] Bump pnpm version
in maven's frontend plugin to 8.6.1 for lockfileVersion 6.1
+[[KYUUBI #4948](https://github.com/apache/kyuubi/pull/4948)] Reuse versions of
NodeJS and pnpm from maven properties
+[[KYUUBI #4959](https://github.com/apache/kyuubi/pull/4959)] Code improvements
for Scala
+[[KYUUBI #4966](https://github.com/apache/kyuubi/pull/4966)] Bump Apache
parent pom from 29 to 30
+[[KYUUBI #4968](https://github.com/apache/kyuubi/pull/4968)] Simplify Option
conversion
+[[KYUUBI #4970](https://github.com/apache/kyuubi/pull/4970)] Unified
reflection methods invokeAs and getField
+[[KYUUBI #4974](https://github.com/apache/kyuubi/pull/4974)] Eliminate
raw-types compilation warning in KyuubiBeeLine
+[[KYUUBI #4975](https://github.com/apache/kyuubi/pull/4975)] Fixed run test
link in PR template
+[[KYUUBI #4990](https://github.com/apache/kyuubi/pull/4990)] Bump Spark 3.4.1
+[[KYUUBI #4992](https://github.com/apache/kyuubi/pull/4992)] Bump Netty
4.1.93.Final
+[[KYUUBI #5001](https://github.com/apache/kyuubi/pull/5001)] Bump Scala from
2.12.17 to 2.12.18
+[[KYUUBI #5003](https://github.com/apache/kyuubi/pull/5003)] [K8S][HELM] Add
doc strings to the chart values.yaml
+[[KYUUBI #5007](https://github.com/apache/kyuubi/pull/5007)] Bump scalafmt
from 3.7.4 to 3.7.5
+[[KYUUBI #5019](https://github.com/apache/kyuubi/pull/5019)] Shows details of
compilation info in SparkUI's engine tab
+[[KYUUBI #5024](https://github.com/apache/kyuubi/pull/5024)] Bump
grpc-protobuf from 1.48.0 to 1.53.0
+[[KYUUBI #5034](https://github.com/apache/kyuubi/pull/5034)] Bump tough-cookie
from 4.0.0 to 4.1.3 in /kyuubi-server/web-ui
+[[KYUUBI #5039](https://github.com/apache/kyuubi/pull/5039)] Use semantic
versions and remove redundant version comparison methods
+[[KYUUBI #5058](https://github.com/apache/kyuubi/pull/5058)] [K8S][HELM] Allow
the user to set the priorityClass used by Kyuubi server Pod
+[[KYUUBI #5059](https://github.com/apache/kyuubi/pull/5059)] Upgrade
kubernetes client version to 6.7.2
+[[KYUUBI #5064](https://github.com/apache/kyuubi/pull/5064)] Audit kubernetes
application state change in separate log files
+[[KYUUBI #5068](https://github.com/apache/kyuubi/pull/5068)] Bump Spark in
spark-master profile from 3.5.0-SNAPSHOT to 4.0.0-SNAPSHOT
+[[KYUUBI #5070](https://github.com/apache/kyuubi/pull/5070)] Bump word-wrap
from 1.2.3 to 1.2.4 in web UI
+[[KYUUBI #5072](https://github.com/apache/kyuubi/pull/5072)] Fix
KyuubiOperationWithEngineSecuritySuite and related issues
+[[KYUUBI #5090](https://github.com/apache/kyuubi/pull/5090)] Fix
AllKyuubiConfiguration to generate redundant blank lines in Windows
+[[KYUUBI #5113](https://github.com/apache/kyuubi/pull/5113)] Remove dummy
Spark Kudu connector module
+[[KYUUBI #5116](https://github.com/apache/kyuubi/pull/5116)] Bump Hadoop 3.3.6
+[[KYUUBI #5117](https://github.com/apache/kyuubi/pull/5117)] Code improvements
for Java and Scala code
+[[KYUUBI #5121](https://github.com/apache/kyuubi/pull/5121)] Extract dev
scripts for regenerating the golden files
+[[KYUUBI #5132](https://github.com/apache/kyuubi/pull/5132)] [K8S][HELM]
Kyuubi add server metrics monitor
+[[KYUUBI #5135](https://github.com/apache/kyuubi/pull/5135)] Exclude web-ui
coverage reports in rat plugins
+[[KYUUBI #5149](https://github.com/apache/kyuubi/pull/5149)] Correct error
message of ReflectUtils's invokeAs when method not found
+[[KYUUBI #5150](https://github.com/apache/kyuubi/pull/5150)] Bump Spark 3.3.3
+[[KYUUBI #5152](https://github.com/apache/kyuubi/pull/5152)] Check milestone
and assignees when merging pull request
+[[KYUUBI #5177](https://github.com/apache/kyuubi/pull/5177)] Use Scala binary
version placeholder in Maven module's artifactId suffix
+[[KYUUBI #5183](https://github.com/apache/kyuubi/pull/5183)] Introducing
profile scala-2.13 for development use
+[[KYUUBI #5196](https://github.com/apache/kyuubi/pull/5196)] Enable CI Test on
Scala 2.13 and support custom or spark-core extracted Scala version for Spark's
engine
+[[KYUUBI #5202](https://github.com/apache/kyuubi/pull/5202)] Update
upload_nexus_staging
+[[KYUUBI #5205](https://github.com/apache/kyuubi/pull/5205)] Upgrade
`kubernetes-client` to 6.8.1
+[[KYUUBI #5209](https://github.com/apache/kyuubi/pull/5209)] Reformat Scala
source code crossing versions
+[[KYUUBI #5212](https://github.com/apache/kyuubi/pull/5212)] Fix configuration
errors causing by helm charts of prometheus services
+[[KYUUBI #5214](https://github.com/apache/kyuubi/pull/5214)] Correct file path
for scala tests in util-scala module
+[[KYUUBI #5234](https://github.com/apache/kyuubi/pull/5234)] Upgrade Jetty
version from 9.4.51.v20230217 to 9.4.52.v20230823
+[[KYUUBI #5235](https://github.com/apache/kyuubi/pull/5235)] Daily deploy
snapshot version on master and branch-1.7
+[[KYUUBI #5250](https://github.com/apache/kyuubi/pull/5250)] Bump Iceberg from
1.3.0 to 1.3.1
+[[KYUUBI #5252](https://github.com/apache/kyuubi/pull/5252)] Remove incubator
link
+[[KYUUBI #5253](https://github.com/apache/kyuubi/pull/5253)] Upgrade
testcontainers-scala from 0.40.12 to 0.41.0
+[[KYUUBI #5253](https://github.com/apache/kyuubi/pull/5253)] Supply
testcontainers-scala-scalatest deps
+[[KYUUBI #5293](https://github.com/apache/kyuubi/pull/5293)] Upgrade snakeyaml
from 1.33 to 2.2
+[[KYUUBI #5305](https://github.com/apache/kyuubi/pull/5305)] Fix get local log
UT
+[[KYUUBI #5308](https://github.com/apache/kyuubi/pull/5308)] Ensure release
using Java 8
+[[KYUUBI #5318](https://github.com/apache/kyuubi/pull/5318)] Pin
maven-source-plugin 3.2.1
+[[KYUUBI #5358](https://github.com/apache/kyuubi/pull/5358)] Bump iceberg 1.4.0
+[[KYUUBI #5365](https://github.com/apache/kyuubi/pull/5365)] Don't use
Log4j2's extended throwable conversion pattern in default logging configurations
+[[KYUUBI #5425](https://github.com/apache/kyuubi/pull/5425)] Add thread name
and ID to log4j2-defaults.xml
+[[KYUUBI #5435](https://github.com/apache/kyuubi/pull/5435)] Improve Kyuubi On
Kubernetes IT
+[[KYUUBI #5443](https://github.com/apache/kyuubi/pull/5443)] Add
kyuubi-kubernetes-it module to reformat script
+[[KYUUBI #5444](https://github.com/apache/kyuubi/pull/5444)] Check style with
profiles of Spark 3.4 and 3.5
+[[KYUUBI #5483](https://github.com/apache/kyuubi/pull/5483)] Fix deploy
command for Scala 2.13 TPC-DS/H connectors
+[[KYUUBI #5483](https://github.com/apache/kyuubi/pull/5483)] Release Spark
TPC-H/DS Connectors with Scala 2.13
+[[KYUUBI #5486](https://github.com/apache/kyuubi/pull/5486)] Bump Kafka client
version from 3.4.0 to 3.5.1
+[[KYUUBI #5508](https://github.com/apache/kyuubi/pull/5508)] Upgrade
download-maven-plugin from 1.6.8 to 1.7.1
+[[KYUUBI #5544](https://github.com/apache/kyuubi/pull/5544)] Release contains
Spark 3.5 extension
+[[KYUUBI #5561](https://github.com/apache/kyuubi/pull/5561)] Binary
distribution artifact ships database schema scripts
+[[KYUUBI #5561](https://github.com/apache/kyuubi/pull/5561)] Rename folder to
db-scripts
+[[KYUUBI #5569](https://github.com/apache/kyuubi/pull/5569)] Fix pnpm-lock
file version
+
+### Credits
+
+Last but not least, this release would not have been possible without the
following contributors:
+
+* Alex Zou
+* Anurag Rajawat
+* Binjie Yang
+* Bowen Liang
+* Bruce Wong
+* CavemanIV
+* Chao Chen
+* Cheng Pan
+* Chenliang Lu
+* David Yuan
+* Deng An
+* Denis Krivenko
+* Derick Cypho
+* Drake Youngkun Min
+* Fei Wang
+* FourSpaces
+* Fu Chen
+* GitHub Bot
+* Guanhua Li
+* Hanna Liashchuk
+* He Zhao
+* Junjie Zu
+* Kaifei Yi
+* Kang Wang
+* Karsonnel
+* Kent Yao
+* Kyofin
+* Miao Wang
+* Min Zhao
+* Naijie Liu
+* Omkar Makhare
+* Paul Lin
+* Peiyue Liu
+* Pengqi Li
+* Qiang Zhang
+* QianyongY
+* Remzi Yang
+* Rojin Raju
+* Ruguo Yu
+* Ruilei Ma
+* Senmiao Liu
+* Shaoyun Chen
+* Sidhant Nagpal
+* Tianlin Liao
+* Xianxun Ye
+* Xiduo You
+* Xieming Li
+* XorSum
+* Xu Guo
+* Yang Du
+* Yangming Zhao
+* Yaodong Zhang
+* Yaogai Zhu
+* Yi Zhu
+* Yifan Zhou
+* Zhen Wang
+* biangjuang
+* camper42
+* fantasticKe
+* huangzhir
+* huapan123456
+* liaoyt
+* mans2singh
+* mrtisttt
+* phyyou
+* rhh777
+* runzhliu
+* touchida
+* uicosp
+* wangyepeng2
+* weixi62961
+* yehere
