GitHub user jose-torres opened a pull request:
https://github.com/apache/spark/pull/20398
[SPARK-23198][SS][TEST] Fix race condition in
KafkaSourceStressForDontFailOnDataLossSuite
## What changes were proposed in this pull request?
Await query termination before returning from the test case. This is
required to stop query shutdown and Spark shutdown from racing in the
continuous case. Discovered because fixing the continuous case to run properly
in continuous mode caused a bit of flakiness:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86640/testReport/org.apache.spark.sql.kafka010/history/
## How was this patch tested?
n/a
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jose-torres/spark awaitTermination
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20398.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20398
----
commit 89b024694b04f3f2685790d7951ef876dca1d205
Author: Jose Torres <jose@...>
Date: 2018-01-25T19:11:09Z
await termination
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
