Github user arunmahadevan commented on a diff in the pull request:
https://github.com/apache/spark/pull/21919#discussion_r210707152
--- Diff:
sql/core/src/main/scala/org/apache/spark/sql/streaming/progress.scala ---
@@ -254,3 +259,10 @@ class SinkProgress protected[sql](
}
}
}
+
+private[sql] object SinkProgress {
+ val DEFAULT_NUM_OUTPUT_ROWS: Long = -1L
--- End diff --
Does it result in sink progress output with "numOutputRows = -1" ? Maybe
add numOutputRows to the output only if the value is not default.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
