GitHub user viirya opened a pull request:
https://github.com/apache/spark/pull/22181
[SPARK-25163][SQL] Fix flaky test:
o.a.s.util.collection.ExternalAppendOnlyMapSuiteCheck
## What changes were proposed in this pull request?
`ExternalAppendOnlyMapSuiteCheck` test is flaky. The reason is that spill
status was possibly checked before all events posted to the listener bus are
processed. We should check spill status after all events are processed.
## How was this patch tested?
Unit test.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/viirya/spark-1 SPARK-25163
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22181.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22181
----
commit 77e108a18788502d05b1b3dacc21c3e72eac4264
Author: Liang-Chi Hsieh <viirya@...>
Date: 2018-08-22T02:41:49Z
Check spill status after processing all events.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
