Jungtaek Lim created SPARK-24161:
------------------------------------
Summary: Enable debug package feature on structured streaming
Key: SPARK-24161
URL: https://issues.apache.org/jira/browse/SPARK-24161
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 2.3.0
Reporter: Jungtaek Lim
Currently, debug package has a implicit class which matches Dataset to provide
debug features on Dataset class. It doesn't work with structured streaming: it
requires query is already started, and the information can be retrieved from
StreamingQuery, not Dataset. For the same reason, "explain" had to be placed to
StreamingQuery whereas it exists on Dataset.
This issue tracks effort to enable debug package feature on structured
streaming. Unlike batch, it may have some restrictions.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
