Github user joseph-torres commented on a diff in the pull request:
https://github.com/apache/spark/pull/19926#discussion_r156532669
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/StreamingQueryManager.scala
---
@@ -237,7 +237,7 @@ class StreamingQueryManager private[sql] (sparkSession:
SparkSession) extends Lo
"is not supported in streaming DataFrames/Datasets and will be
disabled.")
}
- new StreamingQueryWrapper(new StreamExecution(
+ new StreamingQueryWrapper(new MicroBatchExecution(
--- End diff --
My current thinking is to have it be a new trigger type. It can't really be
a config, because continuous processing (at least in the initial
implementation) won't support all operators.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
