This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new d846476 [SPARK-31966][ML][TESTS][PYTHON][2.4] Increase the timeout
for StreamingLogisticRegressionWithSGDTests.test_training_and_prediction
d846476 is described below
commit d846476d35893fb3886c422358dc834dd52ae759
Author: HyukjinKwon <[email protected]>
AuthorDate: Thu Aug 20 10:33:27 2020 +0900
[SPARK-31966][ML][TESTS][PYTHON][2.4] Increase the timeout for
StreamingLogisticRegressionWithSGDTests.test_training_and_prediction
### What changes were proposed in this pull request?
This PR backports https://github.com/apache/spark/pull/28798 to branch-2.4
to reduce the flakiness in the tests.
This is similar with
https://github.com/apache/spark/commit/64cb6f7066134a0b9e441291992d2da73de5d918
The test
`StreamingLogisticRegressionWithSGDTests.test_training_and_prediction` seems
also flaky. This PR just increases the timeout to 3 mins too. The cause is very
likely the time elapsed.
See
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/123787/testReport/pyspark.mllib.tests.test_streaming_algorithms/StreamingLogisticRegressionWithSGDTests/test_training_and_prediction/
```
Traceback (most recent call last):
File
"/home/jenkins/workspace/SparkPullRequestBuilder2/python/pyspark/mllib/tests/test_streaming_algorithms.py",
line 330, in test_training_and_prediction
eventually(condition, timeout=60.0)
File
"/home/jenkins/workspace/SparkPullRequestBuilder2/python/pyspark/testing/utils.py",
line 90, in eventually
% (timeout, lastValue))
AssertionError: Test failed due to timeout after 60 sec, with last
condition returning: Latest errors: 0.67, 0.71, 0.78, 0.7, 0.75, 0.74, 0.73,
0.69, 0.62, 0.71, 0.69, 0.75, 0.72, 0.77, 0.71, 0.74, 0.76, 0.78, 0.7, 0.78,
0.8, 0.74, 0.77, 0.75, 0.76, 0.76, 0.75
```
### Why are the changes needed?
To make PR builds more stable.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Jenkins will test them out.
Closes #29481 from HyukjinKwon/SPARK-31966-2.4.
Authored-by: HyukjinKwon <[email protected]>
Signed-off-by: HyukjinKwon <[email protected]>
---
python/pyspark/mllib/tests.py | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/python/pyspark/mllib/tests.py b/python/pyspark/mllib/tests.py
index 4c2ce13..ec9497c 100644
--- a/python/pyspark/mllib/tests.py
+++ b/python/pyspark/mllib/tests.py
@@ -1489,7 +1489,7 @@ class
StreamingLogisticRegressionWithSGDTests(MLLibStreamingTestCase):
return True
return "Latest errors: " + ", ".join(map(lambda x: str(x), errors))
- self._eventually(condition)
+ self._eventually(condition, timeout=180.0)
class StreamingLinearRegressionWithTests(MLLibStreamingTestCase):
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
