This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.0 by this push:
new e2fded3 [SPARK-29137][ML][PYTHON][TESTS] Increase the timeout for
StreamingLinearRegressionWithTests.test_train_prediction
e2fded3 is described below
commit e2fded3e1ffda71d5e08f492d02cc3d20ff1f53c
Author: HyukjinKwon <gurwls...@apache.org>
AuthorDate: Mon Jun 1 22:03:47 2020 -0700
[SPARK-29137][ML][PYTHON][TESTS] Increase the timeout for
StreamingLinearRegressionWithTests.test_train_prediction
### What changes were proposed in this pull request?
It increases the timeout for
`StreamingLinearRegressionWithTests.test_train_prediction`
```
Traceback (most recent call last):
File
"/home/jenkins/workspace/SparkPullRequestBuilder3/python/pyspark/mllib/tests/test_streaming_algorithms.py",
line 503, in test_train_prediction
self._eventually(condition)
File
"/home/jenkins/workspace/SparkPullRequestBuilder3/python/pyspark/mllib/tests/test_streaming_algorithms.py",
line 69, in _eventually
lastValue = condition()
File
"/home/jenkins/workspace/SparkPullRequestBuilder3/python/pyspark/mllib/tests/test_streaming_algorithms.py",
line 498, in condition
self.assertGreater(errors[1] - errors[-1], 2)
AssertionError: 1.672640157855923 not greater than 2
```
This could likely happen when the PySpark tests run in parallel and it
become slow.
### Why are the changes needed?
To make the tests less flaky. Seems it's being reported multiple times:
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123144/consoleFull
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123146/testReport/
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123141/testReport/
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123142/testReport/
### Does this PR introduce _any_ user-facing change?
No, test-only.
### How was this patch tested?
Jenkins will test it out.
Closes #28701 from HyukjinKwon/SPARK-29137.
Authored-by: HyukjinKwon <gurwls...@apache.org>
Signed-off-by: Dongjoon Hyun <dongj...@apache.org>
(cherry picked from commit 64cb6f7066134a0b9e441291992d2da73de5d918)
Signed-off-by: Dongjoon Hyun <dongj...@apache.org>
---
python/pyspark/mllib/tests/test_streaming_algorithms.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/python/pyspark/mllib/tests/test_streaming_algorithms.py
b/python/pyspark/mllib/tests/test_streaming_algorithms.py
index 2077809a..f57de83 100644
--- a/python/pyspark/mllib/tests/test_streaming_algorithms.py
+++ b/python/pyspark/mllib/tests/test_streaming_algorithms.py
@@ -463,7 +463,7 @@ class
StreamingLinearRegressionWithTests(MLLibStreamingTestCase):
return True
return "Latest errors: " + ", ".join(map(lambda x: str(x), errors))
- eventually(condition)
+ eventually(condition, timeout=180.0)
if __name__ == "__main__":
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
