anishshri-db opened a new pull request, #39520: URL: https://github.com/apache/spark/pull/39520
### What changes were proposed in this pull request? Fix kafka test to verify lost partitions to account for slow Kafka operations Basically its possible that kafka operations around topic deletion, partition creation etc can exceed the streaming query timeout thereby failing the query and test incorrectly. This change updates the exit timeout. ### Why are the changes needed? Change is required to avoid test flakiness in the event of Kafka operations becoming slower ### Does this PR introduce _any_ user-facing change? No ### How was this patch tested? Test only change Reran the tests multiple times: ``` [info] Assembly jar up to date: /Users/anish.shrigondekar/spark/spark/connector/protobuf/target/scala-2.12/spark-protobuf-assembly-3.4.0-SNAPSHOT.jar [info] - Query with Trigger.AvailableNow should throw error when topic partitions got unavailable during subsequent batches (6 seconds, 440 milliseconds) [info] - Query with Trigger.AvailableNow should throw error when offset(s) in planned topic partitions got unavailable during subsequent batches (6 seconds, 331 milliseconds) [info] Run completed in 17 seconds, 269 milliseconds. [info] Total number of tests run: 2 [info] Suites: completed 1, aborted 0 [info] Tests: succeeded 2, failed 0, canceled 0, ignored 0, pending 0 [info] All tests passed. [success] Total time: 52 s, completed Jan 11, 2023, 6:05:24 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
