Github user tedyu commented on the issue:
https://github.com/apache/spark/pull/21488
Made some progress in testing.
Now facing:
```
- assign from latest offsets (failOnDataLoss: true) *** FAILED ***
java.lang.IllegalArgumentException: requirement failed
at scala.Predef$.require(Predef.scala:212)
at
org.apache.spark.sql.kafka010.KafkaSourceSuiteBase.org$apache$spark$sql$kafka010$KafkaSourceSuiteBase$$testFromLatestOffsets(KafkaMicroBatchSourceSuite.scala:993)
at
org.apache.spark.sql.kafka010.KafkaSourceSuiteBase$$anonfun$37$$anonfun$apply$2.apply$mcV$sp(KafkaMicroBatchSourceSuite.scala:734)
at
org.apache.spark.sql.kafka010.KafkaSourceSuiteBase$$anonfun$37$$anonfun$apply$2.apply(KafkaMicroBatchSourceSuite.scala:732)
at
org.apache.spark.sql.kafka010.KafkaSourceSuiteBase$$anonfun$37$$anonfun$apply$2.apply(KafkaMicroBatchSourceSuite.scala:732)
at org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)
```
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
