[
https://issues.apache.org/jira/browse/SPARK-24748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-24748.
----------------------------------
Resolution: Incomplete
> Support for reporting custom metrics via Streaming Query Progress
> -----------------------------------------------------------------
>
> Key: SPARK-24748
> URL: https://issues.apache.org/jira/browse/SPARK-24748
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 2.3.1
> Reporter: Arun Mahadevan
> Priority: Major
> Labels: bulk-closed
>
> Currently the Structured Streaming sources and sinks does not have a way to
> report custom metrics. Providing an option to report custom metrics and
> making it available via Streaming Query progress can enable sources and sinks
> to report custom progress information (E.g. the lag metrics for Kafka source).
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
