HeartSaVioR commented on a change in pull request #25135: [SPARK-28367][SS] Use
new KafkaConsumer.poll API in Kafka connector
URL: https://github.com/apache/spark/pull/25135#discussion_r303154822
##########
File path:
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaSourceProviderSuite.scala
##########
@@ -33,6 +33,12 @@ class KafkaSourceProviderSuite extends SparkFunSuite with
PrivateMethodTester {
private val pollTimeoutMsMethod = PrivateMethod[Long]('pollTimeoutMs)
private val maxOffsetsPerTriggerMethod =
PrivateMethod[Option[Long]]('maxOffsetsPerTrigger)
+ override protected def beforeEach(): Unit = {
Review comment:
If I'm understanding correctly, due to employ of `pollTimeoutMs` in
KafkaOffsetReader, non-microbatch mode now requires SparkEnv. Right? Just to
verify my understanding.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
