ulysses-you commented on pull request #30772:
URL: https://github.com/apache/spark/pull/30772#issuecomment-747179945
The jenkins test failed with
```
======================================================================
ERROR: test_complex_groupby (pyspark.sql.tests.GroupedMapPandasUDFTests)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/jenkins/workspace/SparkPullRequestBuilder@2/python/pyspark/sql/tests.py",
line 5765, in test_complex_groupby
expected = expected.sort_values(['id', 'v']).reset_index(drop=True)
File
"/home/jenkins/anaconda2/lib/python2.7/site-packages/pandas/core/frame.py",
line 4711, in sort_values
for x in by]
File
"/home/jenkins/anaconda2/lib/python2.7/site-packages/pandas/core/generic.py",
line 1701, in _get_label_or_level_values
self._check_label_or_level_ambiguity(key, axis=axis)
File
"/home/jenkins/anaconda2/lib/python2.7/site-packages/pandas/core/generic.py",
line 1655, in _check_label_or_level_ambiguity
raise ValueError(msg)
ValueError: 'id' is both an index level and a column label, which is
ambiguous.
```
github action skipped and passed
```
test_array_type_correct (pyspark.sql.tests.GroupedMapPandasUDFTests) ...
skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_coerce (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped 'Pandas
>= 0.19.2 must be installed; however, it was not found.'
test_column_order (pyspark.sql.tests.GroupedMapPandasUDFTests) ... skipped
'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_complex_groupby (pyspark.sql.tests.GroupedMapPandasUDFTests) ...
skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
test_datatype_string (pyspark.sql.tests.GroupedMapPandasUDFTests) ...
skipped 'Pandas >= 0.19.2 must be installed; however, it was not found.'
```
This failed test is pandas related and it passed with branch-3.0 and higer.
I'm not familiar with this part, @HyukjinKwon do you have any idea ?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
