GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/7017
[SPARK-8634][Streaming][Tests]Fix flaky test StreamingListenerSuite
"receiver info reporting"
As per the unit test log in
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35754/
```
15/06/24 23:09:10.210 Thread-3495 INFO ReceiverTracker: Starting 1 receivers
15/06/24 23:09:10.270 Thread-3495 INFO SparkContext: Starting job: apply at
Transformer.scala:22
...
15/06/24 23:09:14.259 ForkJoinPool-4-worker-29 INFO
StreamingListenerSuiteReceiver: Started receiver and sleeping
15/06/24 23:09:14.270 ForkJoinPool-4-worker-29 INFO
StreamingListenerSuiteReceiver: Reporting error and sleeping
```
it needs at least 4 seconds to receive all receiver events in this slow
machine, but `timeout` for `eventually` is only 2 seconds.
This PR increases `timeout` to make this test stable.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zsxwing/spark SPARK-8634
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7017.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7017
----
commit 719cae4f8fc7a0e8f47220c76d502a467ae772f6
Author: zsxwing <[email protected]>
Date: 2015-06-25T15:18:09Z
Fix flaky test StreamingListenerSuite "receiver info reporting"
As per the unit test log in
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/35754/
```
15/06/24 23:09:10.210 Thread-3495 INFO ReceiverTracker: Starting 1 receivers
15/06/24 23:09:10.270 Thread-3495 INFO SparkContext: Starting job: apply at
Transformer.scala:22
...
15/06/24 23:09:14.259 ForkJoinPool-4-worker-29 INFO
StreamingListenerSuiteReceiver: Started receiver and sleeping
15/06/24 23:09:14.270 ForkJoinPool-4-worker-29 INFO
StreamingListenerSuiteReceiver: Reporting error and sleeping
```
it needs at least 4 seconds to receive all receiver events in this slow
machine, but `timeout` for `eventually` is only 2 seconds.
This PR increases `timeout` to make this test stable.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
