Github user vackosar commented on a diff in the pull request:
https://github.com/apache/spark/pull/21919#discussion_r210708107
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/progress.scala ---
@@ -254,3 +259,10 @@ class SinkProgress protected[sql](
}
}
}
+
+private[sql] object SinkProgress {
+ val DEFAULT_NUM_OUTPUT_ROWS: Long = -1L
--- End diff --
I will implement this for continuous streaming and then only legacy sinks
would output -1. I didn't wanted to change the API too often.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
