Josh Rosen created SPARK-43414:
----------------------------------
Summary: Fix flakiness in Kafka RDD suites due to port binding
configuration issue
Key: SPARK-43414
URL: https://issues.apache.org/jira/browse/SPARK-43414
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 3.4.0
Reporter: Josh Rosen
Assignee: Josh Rosen
In SPARK-36837 we updated Kafka to 3.10, which uses a different set of
configuration options for configuring the broker listener port. That PR only
updated one of two KafkaTestUtils files (the SQL one), so the other one (used
by Core tests) had an ineffective port binding configuration and would bind to
the default 9092 port. This could lead to flakiness if multiple suites binding
to that port ran in parallel.
To fix this, we just need to copy the updated port binding configuration from
the other suite.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
