Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/21733#discussion_r206725041
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---
@@ -871,6 +871,16 @@ object SQLConf {
.intConf
.createWithDefault(2)
+ val STREAMING_AGGREGATION_STATE_FORMAT_VERSION =
+
buildConf("spark.sql.streaming.streamingAggregation.stateFormatVersion")
+ .internal()
+ .doc("State format version used by streaming aggregation operations
triggered " +
+ "explicitly or implicitly via agg() in a streaming query. State
between versions are " +
--- End diff --
what do you mean mean "implicitly"? Which operations are implicit?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
