Hyukjin Kwon created SPARK-61586:
------------------------------------
Summary: Remove every listener in StreamingQueryListenerBus.close
Key: SPARK-61586
URL: https://issues.apache.org/jira/browse/SPARK-61586
Project: Spark
Issue Type: Bug
Components: Connect
Affects Versions: 5.0.0
Reporter: Hyukjin Kwon
StreamingQueryListenerBus.close() in PySpark Connect
(python/pyspark/sql/connect/streaming/query.py) iterates over _listener_bus
while remove() deletes from that same list, so it skips every other listener:
with three listeners registered, the second stays registered, and the bus keeps
its server-side listener and its handler thread. close() should remove every
listener.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]