rshkv edited a comment on pull request #34717:
URL: https://github.com/apache/spark/pull/34717#issuecomment-981126049
I noticed that `IntegralExtensionOpsTest.test_invert` fails on Pandas 1.0.0
and succeeds on 1.0.1 (error below). So maybe safer to recommend that version.
Otherwise everything seems to work with 1.0.0.
<details>
<summary>Test failure</summary>
```
======================================================================
ERROR [0.404s]: test_invert
(pyspark.pandas.tests.data_type_ops.test_num_ops.IntegralExtensionOpsTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/circleci/project/python/pyspark/testing/pandasutils.py", line
122, in assertPandasEqual
**kwargs
File
"/opt/pyenv/versions/3.7.3/lib/python3.7/site-packages/pandas/_testing.py",
line 1137, in assert_series_equal
assert_attr_equal("dtype", left, right, obj=f"Attributes of {obj}")
File
"/opt/pyenv/versions/3.7.3/lib/python3.7/site-packages/pandas/_testing.py",
line 772, in assert_attr_equal
raise_assert_detail(obj, msg, left_attr, right_attr)
File
"/opt/pyenv/versions/3.7.3/lib/python3.7/site-packages/pandas/_testing.py",
line 915, in raise_assert_detail
raise AssertionError(msg)
AssertionError: Attributes of Series are different
Attribute "dtype" are different
[left]: object
[right]: Int8
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File
"/home/circleci/project/python/pyspark/pandas/tests/data_type_ops/test_num_ops.py",
line 498, in test_invert
self.check_extension(~pser, ~psser)
File
"/home/circleci/project/python/pyspark/pandas/tests/data_type_ops/testing_utils.py",
line 248, in check_extension
self.assert_eq(left, right)
File "/home/circleci/project/python/pyspark/testing/pandasutils.py", line
223, in assert_eq
self.assertPandasEqual(lobj, robj, check_exact=check_exact)
File "/home/circleci/project/python/pyspark/testing/pandasutils.py", line
130, in assertPandasEqual
raise AssertionError(msg) from e
AssertionError: Attributes of Series are different
Attribute "dtype" are different
[left]: object
[right]: Int8
Left:
dtype: object
object
Right:
dtype: Int8
Int8
```
</details>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
