This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 19e2985336d [SPARK-43377][SQL] Enable
`spark.sql.thriftServer.interruptOnCancel` by default
19e2985336d is described below
commit 19e2985336d3abd99d1a42c2fd48fb806307b8d2
Author: ulysses-you <[email protected]>
AuthorDate: Fri May 5 16:11:23 2023 -0700
[SPARK-43377][SQL] Enable `spark.sql.thriftServer.interruptOnCancel` by
default
### What changes were proposed in this pull request?
This pr enables `spark.sql.thriftServer.interruptOnCancel` by default
### Why are the changes needed?
Address the comment
https://github.com/apache/spark/pull/30481#discussion_r1181684437
### Does this PR introduce _any_ user-facing change?
yes
### How was this patch tested?
Pass CI
Closes #41047 from ulysses-you/33526-F.
Authored-by: ulysses-you <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
docs/sql-migration-guide.md | 1 +
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala | 2 +-
2 files changed, 2 insertions(+), 1 deletion(-)
diff --git a/docs/sql-migration-guide.md b/docs/sql-migration-guide.md
index 11ed5402ee1..80df50273a1 100644
--- a/docs/sql-migration-guide.md
+++ b/docs/sql-migration-guide.md
@@ -25,6 +25,7 @@ license: |
## Upgrading from Spark SQL 3.4 to 3.5
- Since Spark 3.5, the JDBC options related to DS V2 pushdown are `true` by
default. These options include: `pushDownAggregate`, `pushDownLimit`,
`pushDownOffset` and `pushDownTableSample`. To restore the legacy behavior,
please set them to `false`. e.g. set
`spark.sql.catalog.your_catalog_name.pushDownAggregate` to `false`.
+- Since Spark 3.5, Spark thrift server will interrupt task when canceling a
running statement. To restore the previous behavior, set
`spark.sql.thriftServer.interruptOnCancel` to `false`.
## Upgrading from Spark SQL 3.3 to 3.4
diff --git
a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
index c9974d2dfa8..bf056d7e93a 100644
--- a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
+++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala
@@ -1383,7 +1383,7 @@ object SQLConf {
"When false, all running tasks will remain until finished.")
.version("3.2.0")
.booleanConf
- .createWithDefault(false)
+ .createWithDefault(true)
val THRIFTSERVER_QUERY_TIMEOUT =
buildConf("spark.sql.thriftServer.queryTimeout")
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
