itholic commented on code in PR #41211:
URL: https://github.com/apache/spark/pull/41211#discussion_r1197445641
##########
python/pyspark/pandas/tests/data_type_ops/test_date_ops.py:
##########
@@ -61,6 +63,10 @@ def test_add(self):
for psser in self.pssers:
self.assertRaises(TypeError, lambda: self.psser + psser)
+ @unittest.skipIf(
+ LooseVersion(pd.__version__) >= LooseVersion("2.0.0"),
+ "TODO(SPARK-43571): Enable DateOpsTests.test_sub for pandas 2.0.0.",
+ )
Review Comment:
Let me skip the tests for now, since there are numerous changes introduced
in pandas 2.0.0, and most of them are related to behavior changes in the pandas
API on Spark.
In the current PR, our primary goal will be to prioritize support for pandas
2.0.0 in PySpark, and I don't want to introduce any behavior changes. I already
created bunch of tickets for enabling tests, so let me handle them in the
follow-ups.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
