Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/18444
Sounds actually related:
```
======================================================================
ERROR: test_array_types (pyspark.sql.tests.SQLTests)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/sql/tests.py",
line 2402, in test_array_types
assertCollectSuccess(t, 2 ** (ctypes.sizeof(ctype) * 8) - 1)
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/sql/tests.py",
line 2352, in assertCollectSuccess
self.assertEqual(df.first()["myarray"][0], value)
File
"/home/jenkins/workspace/SparkPullRequestBuilder/python/pyspark/sql/dataframe.py",
line 994, in first
...
Py4JJavaError: An error occurred while calling o1194.collectToPython.
: org.apache.spark.SparkException: Job aborted due to stage failure: Task 2
in stage 101.0 failed 1
times, most recent failure: Lost task 2.0 in stage 101.0 (TID 429,
localhost, executor driver):
net.razorvine.pickle.PickleException: unsupported datatype: 64-bits
unsigned long
at
net.razorvine.pickle.objects.ArrayConstructor.constructLongArrayFromUInt64(ArrayConstructor.java:302)
...
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
