[
https://issues.apache.org/jira/browse/SPARK-52055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-52055.
-----------------------------------
Fix Version/s: 4.1.0
Resolution: Fixed
Issue resolved by pull request 50847
[https://github.com/apache/spark/pull/50847]
> Suppress the exception in ExecutePlanResponseReattachableIterator.__del__
> -------------------------------------------------------------------------
>
> Key: SPARK-52055
> URL: https://issues.apache.org/jira/browse/SPARK-52055
> Project: Spark
> Issue Type: Improvement
> Components: Connect, PySpark
> Affects Versions: 4.0.0
> Reporter: Hyukjin Kwon
> Assignee: Hyukjin Kwon
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.1.0
>
>
> {code}
> ./bin/pyspark --remote local
> {code}
> and exit(0) directly will show a warning as below.
> {code}
> Exception ignored in: <function
> ExecutePlanResponseReattachableIterator.__del__ at 0x12229f7e0>
> Traceback (most recent call last):
> File "/.../python/pyspark/sql/connect/client/reattach.py", line 347, in
> __del__
> return self.close()
> ^^^^^^^^^^^^
> File "/.../python/pyspark/sql/connect/client/reattach.py", line 343, in
> close
> self._release_all()
> File "/.../python/pyspark/sql/connect/client/reattach.py", line 245, in
> _release_all
> thread_pool.submit(target)
> File
> "/opt/miniconda3/envs/python3.11/lib/python3.11/concurrent/futures/thread.py",
> line 169, in submit
> raise RuntimeError('cannot schedule new futures after '
> RuntimeError: cannot schedule new futures after interpreter shutdown
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
