GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/6852
[SPARK-8404][Streaming][Tests] Use thread-safe collections to make the
tests more reliable
KafkaStreamSuite, DirectKafkaStreamSuite, JavaKafkaStreamSuite and
JavaDirectKafkaStreamSuite use non-thread-safe collections to collect data in
one thread and check it in another thread. It may fail the tests.
This PR changes them to thread-safe collections.
Note: I cannot reproduce the test failures in my environment. But at least,
this PR should make the tests more reliable.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zsxwing/spark fix-KafkaStreamSuite
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6852.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6852
----
commit d464211afe6805117cd4d56957a6f773bc8ae3a8
Author: zsxwing <[email protected]>
Date: 2015-06-17T07:43:34Z
Use thread-safe collections to make the tests more reliable
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
