Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/19495#discussion_r145290193
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/FlatMapGroupsWithStateExec.scala
---
@@ -61,6 +61,10 @@ case class FlatMapGroupsWithStateExec(
private val isTimeoutEnabled = timeoutConf != NoTimeout
val stateManager = new FlatMapGroupsWithState_StateManager(stateEncoder,
isTimeoutEnabled)
+ val watermarkPresent = child.output.exists {
--- End diff --
Correction. No it is not. When watermark is not defined in the query, the
eventTimeWatermark value is Some(0)`
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
