Jungtaek Lim created SPARK-43328:
------------------------------------
Summary: Add latest timestamp on no-execution trigger for Idle
event in streaming query listener
Key: SPARK-43328
URL: https://issues.apache.org/jira/browse/SPARK-43328
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 3.5.0
Reporter: Jungtaek Lim
>From SPARK-43183, we introduced a new callback "onQueryIdle" in streaming
>query listener to separate the idle event from progress update event. The
>QueryIdleEvent is introduced, but the timestamp is missing which is useful to
>track the latest no-execution timestamp. QueryStartedEvent and
>QueryProgressEvent also provide such information.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]