For streaming there is an event StreamingQueryProgress which provides num of input rows for each source. Num of output rows that were written is currently not available in StreamingQueryProgress, but I submitted an PR for that here: https://github.com/apache/spark/pull/21919 If you are interested, please vote on the corresponding issue.
-- Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ --------------------------------------------------------------------- To unsubscribe e-mail: dev-unsubscr...@spark.apache.org