Jungtaek Lim created SPARK-43328:
------------------------------------

             Summary: Add latest timestamp on no-execution trigger for Idle 
event in streaming query listener
                 Key: SPARK-43328
                 URL: https://issues.apache.org/jira/browse/SPARK-43328
             Project: Spark
          Issue Type: Task
          Components: Structured Streaming
    Affects Versions: 3.5.0
            Reporter: Jungtaek Lim


>From SPARK-43183, we introduced a new callback "onQueryIdle" in streaming 
>query listener to separate the idle event from progress update event. The 
>QueryIdleEvent is introduced, but the timestamp is missing which is useful to 
>track the latest no-execution timestamp. QueryStartedEvent and 
>QueryProgressEvent also provide such information.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to