Nemanja Boric created SPARK-49859:
-------------------------------------
Summary: Replace multiprocessing.ThreadPool in SparkConnect python
code
Key: SPARK-49859
URL: https://issues.apache.org/jira/browse/SPARK-49859
Project: Spark
Issue Type: Story
Components: Connect
Affects Versions: 3.5.4
Reporter: Nemanja Boric
multiprocessing.ThreadPool requires /dev/shm to be available, so the pyspark
connect client doesn't work in environments where it's unavailable. We should
replace it with concurrent.futures.ThreadPoolExecutor.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
