dongjoon-hyun commented on PR #45416:
URL: https://github.com/apache/spark/pull/45416#issuecomment-2002173352
Hi, @panbingkun and all.
Unfortunately, this seems to break `branch-3.4` and `branch-3.5` CI due to
the Python version and package differences. Do you think we can isolate this PR
to `master` branch only?
- Python Linter Failure
- https://github.com/apache/spark/actions/runs/8305693061/job/22733444259
```
starting mypy annotations test...
annotations failed mypy checks:
python/pyspark/pandas/plot/matplotlib.py:22: error: Module
"matplotlib.axes._base" has no attribute "_process_plot_format" [attr-defined]
Found 1 error in 1 file (checked 425 source files)
1
Error: Process completed with exit code 1.
```
- Pandas Failure
- https://github.com/apache/spark/actions/runs/8305693061/job/22733444673
```
======================================================================
ERROR [15.158s]: test_aggregate
(pyspark.pandas.tests.test_groupby_slow.GroupBySlowTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/__w/spark/spark/python/pyspark/pandas/tests/test_groupby_slow.py",
line 287, in test_aggregate
stats_pdf.sort_values(by=[(20, "min"), (20, "max"), (30,
"sum")]).reset_index(
File "/usr/local/lib/python3.9/dist-packages/pandas/util/_decorators.py",
line 331, in wrapper
return func(*args, **kwargs)
File "/usr/local/lib/python3.9/dist-packages/pandas/core/frame.py", line
6894, in sort_values
keys = [self._get_label_or_level_values(x, axis=axis) for x in by]
File "/usr/local/lib/python3.9/dist-packages/pandas/core/frame.py", line
6894, in <listcomp>
keys = [self._get_label_or_level_values(x, axis=axis) for x in by]
File "/usr/local/lib/python3.9/dist-packages/pandas/core/generic.py", line
1838, in _get_label_or_level_values
self._check_label_or_level_ambiguity(key, axis=axis)
File "/usr/local/lib/python3.9/dist-packages/pandas/core/generic.py", line
1780, in _check_label_or_level_ambiguity
and key in self.axes[axis].names
ValueError: The truth value of an array with more than one element is
ambiguous. Use a.any() or a.all()
----------------------------------------------------------------------
Ran 15 tests in 174.031s
FAILED (errors=1)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
