Hi Mina

I believe this is different for Structured Streaming from Kafka,
specifically. I'm assuming you are using structured streaming based on the
name of the dependency ("spark-streaming-kafka"). There is a note in the
docs here:

So, instead of setting Kafka's client property, instead set the Spark config
"startingOffsets" to "earliest". There are examples here:

Setting "startingOffsets" has worked for me. I have not tried setting the
kafka property directly.


Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Reply via email to