Raghu Angadi created SPARK-44462:
------------------------------------
Summary: Fix the session passed to foreachBatch.
Key: SPARK-44462
URL: https://issues.apache.org/jira/browse/SPARK-44462
Project: Spark
Issue Type: Task
Components: Connect, Structured Streaming
Affects Versions: 3.4.1
Reporter: Raghu Angadi
foreachBatch() in Connect uses initial session used while starting the
streaming query. But streaming query uses a cloned session, not the the
original session. We should set up the mapping for the cloned session and pass
that in. Look for this ticket ID in the code for more context inline.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
