venkata91 commented on pull request #33253:
URL: https://github.com/apache/spark/pull/33253#issuecomment-886088386
It seems like some pyspark tests are failing not related to this PR. cc
@sarutak
```Failed example:
sc.parallelize([1]).isEmpty()
Exception raised:
Traceback (most recent call last):
File "/usr/lib/pypy3/lib-python/3/doctest.py", line 1332, in __run
compileflags, 1), test.globs)
File "<doctest __main__.RDD.isEmpty[1]>", line 1, in <module>
sc.parallelize([1]).isEmpty()
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/rdd.py", line
1608, in isEmpty
return self.getNumPartitions() == 0 or len(self.take(1)) == 0
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/rdd.py", line
1568, in take
res = self.context.runJob(self, takeUpToNumLeft, p)
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/context.py",
line 1228, in runJob
return list(_load_from_socket(sock_info,
mappedRDD._jrdd_deserializer))
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/rdd.py", line
164, in _load_from_socket
sockfile = _create_local_socket(sock_info)
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/rdd.py", line
141, in _create_local_socket
sockfile, sock = local_connect_and_auth(port, auth_secret)
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/java_gateway.py",
line 214, in local_connect_and_auth
raise RuntimeError("could not open socket: %s" % errors)
RuntimeError: could not open socket: ["tried to connect to ('127.0.0.1',
42447), but an error occurred: [Errno 104] Connection reset by peer"]
**********************************************************************
1 of 2 in __main__.RDD.isEmpty
***Test Failed*** 1 failures.
Had test failures in pyspark.rdd with pypy3; see logs.```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
