Github user dongjoon-hyun commented on a diff in the pull request:
https://github.com/apache/spark/pull/20398#discussion_r163956193
--- Diff:
external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaContinuousSourceSuite.scala
---
@@ -87,6 +87,12 @@ class KafkaContinuousSourceTopicDeletionSuite extends
KafkaContinuousTest {
class KafkaContinuousSourceStressForDontFailOnDataLossSuite
extends KafkaSourceStressForDontFailOnDataLossSuite {
+
+ override def createSparkSession(): TestSparkSession = {
+ // Set maxRetries to 3 to handle NPE from `poll` when deleting a topic
+ new TestSparkSession(new SparkContext("local[10,3]",
"test-sql-context", sparkConf))
--- End diff --
This looks good.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
