Github user HeartSaVioR commented on a diff in the pull request:
https://github.com/apache/spark/pull/21733#discussion_r208776234
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/statefulOperators.scala
---
@@ -167,6 +165,18 @@ trait WatermarkSupport extends UnaryExecNode {
}
}
}
+
+ protected def removeKeysOlderThanWatermark(storeManager:
StreamingAggregationStateManager,
--- End diff --
Missed spot. It will be called from Update mode of StateStoreSaveExec. Will
address.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
