Eric Marnadi created SPARK-54423:
------------------------------------

             Summary: Create the OffsetMap to enable tracking of streaming 
progress via name
                 Key: SPARK-54423
                 URL: https://issues.apache.org/jira/browse/SPARK-54423
             Project: Spark
          Issue Type: Improvement
          Components: Structured Streaming
    Affects Versions: 4.2.0
            Reporter: Eric Marnadi


Currently source progress is tracked by ordinal in the logical plan, which is 
brittle as sources change over the course of the query. This format will enable 
tracking source progress by name. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to