itholic commented on code in PR #44899:
URL: https://github.com/apache/spark/pull/44899#discussion_r1468984306
##########
python/pyspark/testing/utils.py:
##########
@@ -768,6 +767,8 @@ def assertDataFrameEqual(
pass
if has_pandas:
+ import pyspark.pandas as ps
+
Review Comment:
Just fixed it.
BTW, your test environment appears to have `pandas` installed, only
`pyarrow` is not installed. Am I understand correctly?? I thought it does not
have both `pandas` and `pyarrow`.
##########
python/pyspark/testing/utils.py:
##########
@@ -768,6 +767,8 @@ def assertDataFrameEqual(
pass
if has_pandas:
+ import pyspark.pandas as ps
+
Review Comment:
Just fixed it.
@panbingkun BTW, your test environment appears to have `pandas` installed,
only `pyarrow` is not installed. Am I understand correctly?? I thought it does
not have both `pandas` and `pyarrow`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]