[ https://issues.apache.org/jira/browse/SPARK-48089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon resolved SPARK-48089. ---------------------------------- Fix Version/s: 3.5.2 Resolution: Fixed Issue resolved by pull request 46513 [https://github.com/apache/spark/pull/46513] > Streaming query listener not working in 3.5 client <> 4.0 server > ---------------------------------------------------------------- > > Key: SPARK-48089 > URL: https://issues.apache.org/jira/browse/SPARK-48089 > Project: Spark > Issue Type: Sub-task > Components: PySpark, Structured Streaming > Affects Versions: 4.0.0 > Reporter: Hyukjin Kwon > Assignee: Wei Liu > Priority: Major > Labels: pull-request-available > Fix For: 3.5.2 > > > {code} > ====================================================================== > ERROR [1.488s]: test_listener_events > (pyspark.sql.tests.connect.streaming.test_parity_listener.StreamingListenerParityTests.test_listener_events) > ---------------------------------------------------------------------- > Traceback (most recent call last): > File > "/home/runner/work/spark/spark-3.5/python/pyspark/sql/tests/connect/streaming/test_parity_listener.py", > line 53, in test_listener_events > self.spark.streams.addListener(test_listener) > File > "/home/runner/work/spark/spark-3.5/python/pyspark/sql/connect/streaming/query.py", > line 244, in addListener > self._execute_streaming_query_manager_cmd(cmd) > File > "/home/runner/work/spark/spark-3.5/python/pyspark/sql/connect/streaming/query.py", > line 260, in _execute_streaming_query_manager_cmd > (_, properties) = self._session.client.execute_command(exec_cmd) > ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ > File > "/home/runner/work/spark/spark-3.5/python/pyspark/sql/connect/client/core.py", > line 982, in execute_command > data, _, _, _, properties = self._execute_and_fetch(req) > ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ > File > "/home/runner/work/spark/spark-3.5/python/pyspark/sql/connect/client/core.py", > line 1283, in _execute_and_fetch > for response in self._execute_and_fetch_as_iterator(req): > File > "/home/runner/work/spark/spark-3.5/python/pyspark/sql/connect/client/core.py", > line 1264, in _execute_and_fetch_as_iterator > self._handle_error(error) > File > "/home/runner/work/spark/spark-3.5/python/pyspark/sql/connect/client/core.py", > line 1503, in _handle_error > self._handle_rpc_error(error) > File > "/home/runner/work/spark/spark-3.5/python/pyspark/sql/connect/client/core.py", > line 1539, in _handle_rpc_error > raise convert_exception(info, status.message) from None > pyspark.errors.exceptions.connect.SparkConnectGrpcException: > (java.io.EOFException) > ---------------------------------------------------------------------- > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org