Sebastian Hillig created SPARK-47565:
----------------------------------------
Summary: PySpark workers dying in daemon mode idle queue fail query
Key: SPARK-47565
URL: https://issues.apache.org/jira/browse/SPARK-47565
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 3.3.4, 3.5.1, 3.4.2
Reporter: Sebastian Hillig
PySpark workers may die after entering the idle queue in `PythonWorkerFactory`.
This may happen because of code that runs in the process, or external factors.
When drawn from the warmpool, such a worker will result in an I/O exception on
the first read/write .
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
