Github user tdas commented on a diff in the pull request:
https://github.com/apache/spark/pull/22042#discussion_r209473316
--- Diff:
external/kafka-0-10-sql/src/main/scala/org/apache/spark/sql/kafka010/KafkaDataConsumer.scala
---
@@ -95,6 +106,10 @@ private[kafka010] case class InternalKafkaConsumer(
ju.Collections.emptyIterator[ConsumerRecord[Array[Byte], Array[Byte]]]
@volatile private var nextOffsetInFetchedData = UNKNOWN_OFFSET
+ @volatile private var offsetBeforePoll: Long = UNKNOWN_OFFSET
--- End diff --
Can you add some docs to explain what these 2 vars siginify and why these
vars are needed?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
