This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new d73c6cba9631 [SPARK-55406][PYTHON][CONNECT][FOLLOW-UP] Add a timeout
for release wait
d73c6cba9631 is described below
commit d73c6cba96313acb02797ade72b56ca8efcaa30b
Author: Tian Gao <[email protected]>
AuthorDate: Thu Feb 26 06:57:06 2026 +0900
[SPARK-55406][PYTHON][CONNECT][FOLLOW-UP] Add a timeout for release wait
### What changes were proposed in this pull request?
Add a timeout when we wait for release to be done
### Why are the changes needed?
The underlying gRPC call for release is blocked - so if the server shutdown
or in a bad state, it won't be able to tell. We do release in a best-effort way
because the server is designed for locating those unused stuff anyway.
We had such failures in CI:
https://github.com/gaogaotiantian/spark/actions/runs/21923748633/job/63310978801
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
CI
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes #54279 from gaogaotiantian/add-timeout-for-client-future.
Authored-by: Tian Gao <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
---
python/pyspark/sql/connect/client/core.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/python/pyspark/sql/connect/client/core.py
b/python/pyspark/sql/connect/client/core.py
index 0a9e8ae3c61c..f28d97e7472e 100644
--- a/python/pyspark/sql/connect/client/core.py
+++ b/python/pyspark/sql/connect/client/core.py
@@ -1271,7 +1271,7 @@ class SparkConnectClient(object):
"""
Close the channel.
"""
- concurrent.futures.wait(self._release_futures)
+ concurrent.futures.wait(self._release_futures, timeout=10)
ExecutePlanResponseReattachableIterator.shutdown_threadpool_if_idle()
self._channel.close()
self._closed = True
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
