AngersZhuuuu edited a comment on issue #25729: [SPARK-29022][SQL][test-hadoop3.2][test-java11] Fix spark 'add jar', CliSessionState's hiveConf 's classLoader ClassNotFound URL: https://github.com/apache/spark/pull/25729#issuecomment-532480148 > The last python two failures look consistent. Could you take a look if it's relevant? Look the test of python, it won't use code I have changed., it just start SparkContext and SparkStreamingContext, won't start SparkSession. And you can see the third build from last [BUILD](https://github.com/apache/spark/pull/25729#issuecomment-532043555) and my latest two commit, I just modify UT and add some comment. Two test result success now. ``` pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests.test_parameter_convergence pyspark.mllib.tests.test_streaming_algorithms.StreamingLinearRegressionWithTests.test_train_prediction ``` Build and use jdk11 run pyspark mllib test:  It can pass test will argument **PARALLELISM** `-p 1`， `-p 4`， `-p 6` , always failed with parameter `-p 8` with the some relevant error. ``` FAIL: test_parameter_accuracy (pyspark.mllib.tests.test_streaming_algorithms.StreamingLogisticRegressionWithSGDTests) ---------------------------------------------------------------------- Traceback (most recent call last): File "/Users/angerszhu/Documents/project/AngersZhu/spark/python/pyspark/mllib/tests/test_streaming_algorithms.py", line 266, in test_parameter_accuracy self._eventually(condition, catch_assertions=True) File "/Users/angerszhu/Documents/project/AngersZhu/spark/python/pyspark/mllib/tests/test_streaming_algorithms.py", line 74, in _eventually raise lastValue AssertionError: 0.24354595657120295 != 0.1 within 1 places ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
