rshkv commented on pull request #34717: URL: https://github.com/apache/spark/pull/34717#issuecomment-981126049
I noticed that `IntegralExtensionOpsTest.test_invert` fails on Pandas 1.0.0 and succeeds on 1.0.1 (error below). So Maybe safer to recommend that version. Otherwise everything seems to work with 1.0.0. <details> <summary>Test failure</summary> ``` ====================================================================== ERROR [0.404s]: test_invert (pyspark.pandas.tests.data_type_ops.test_num_ops.IntegralExtensionOpsTest) ---------------------------------------------------------------------- Traceback (most recent call last): File "/home/circleci/project/python/pyspark/testing/pandasutils.py", line 122, in assertPandasEqual **kwargs File "/opt/pyenv/versions/3.7.3/lib/python3.7/site-packages/pandas/_testing.py", line 1137, in assert_series_equal assert_attr_equal("dtype", left, right, obj=f"Attributes of {obj}") File "/opt/pyenv/versions/3.7.3/lib/python3.7/site-packages/pandas/_testing.py", line 772, in assert_attr_equal raise_assert_detail(obj, msg, left_attr, right_attr) File "/opt/pyenv/versions/3.7.3/lib/python3.7/site-packages/pandas/_testing.py", line 915, in raise_assert_detail raise AssertionError(msg) AssertionError: Attributes of Series are different Attribute "dtype" are different [left]: object [right]: Int8 The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/home/circleci/project/python/pyspark/pandas/tests/data_type_ops/test_num_ops.py", line 498, in test_invert self.check_extension(~pser, ~psser) File "/home/circleci/project/python/pyspark/pandas/tests/data_type_ops/testing_utils.py", line 248, in check_extension self.assert_eq(left, right) File "/home/circleci/project/python/pyspark/testing/pandasutils.py", line 223, in assert_eq self.assertPandasEqual(lobj, robj, check_exact=check_exact) File "/home/circleci/project/python/pyspark/testing/pandasutils.py", line 130, in assertPandasEqual raise AssertionError(msg) from e AssertionError: Attributes of Series are different Attribute "dtype" are different [left]: object [right]: Int8 Left: dtype: object object Right: dtype: Int8 Int8 ``` </details> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org