Michael,
apparently, the parameter auto.offset.reset has a different meaning
in Spark's Kafka implementation than what is described in the
documentation.
The Kafka docs at https://kafka.apache.org/documentation.html
specify the effect of auto.offset.reset as:
What to do when there is no initial
Hi,
there are apparently helpers to tell you the offsets
https://cwiki.apache.org/confluence/display/KAFKA/0.8.0+SimpleConsumer+Example#id-0.8.0SimpleConsumerExample-FindingStartingOffsetforReads,
but I have no idea how to pass that to the Kafka stream consumer. I am
interested in that as well.
Is there a way in the Apache Spark Kafka Utils to specify an offset to
start reading? Specifically, from the start of the queue, or failing that,
a specific point?
