Eric Marnadi created SPARK-54423:
------------------------------------
Summary: Create the OffsetMap to enable tracking of streaming
progress via name
Key: SPARK-54423
URL: https://issues.apache.org/jira/browse/SPARK-54423
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 4.2.0
Reporter: Eric Marnadi
Currently source progress is tracked by ordinal in the logical plan, which is
brittle as sources change over the course of the query. This format will enable
tracking source progress by name.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]