the bug is related to where long checkpoints are truncated when dealing with
topics have large number of partitions, in my case 120.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/StructuredStreaming-StreamingQueryException-tp28749p28754.html
Sent from
this is a bug in spark version 2.1.0, seems to be fixed in spark 2.1.1 when
ran with that version.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/StructuredStreaming-StreamingQueryException-tp28749p28753.html
Sent from the Apache Spark User List mailing
