GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/18180
[SPARK-20957][SS][Tests]Fix o.a.s.sql.streaming.StreamingQueryManagerSuite
listing
## What changes were proposed in this pull request?
When stopping StreamingQuery, StreamExecution will set `streamDeathCause`
then notify StreamingQueryManager to remove this query. So it's possible that
when `q2.exception.isDefined` returns `true`, StreamingQueryManager's active
list still has `q2`.
This PR just puts the checks into `eventually` to fix the flaky test.
## How was this patch tested?
Jenkins
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zsxwing/spark SPARK-20957
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/18180.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #18180
----
commit c3acd6dbca76c4c9c6eccd1f9ff697e0a57f1804
Author: Shixiong Zhu <[email protected]>
Date: 2017-06-02T00:11:43Z
fix flaky test
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
