itholic commented on code in PR #44778:
URL: https://github.com/apache/spark/pull/44778#discussion_r1464186119
##########
python/pyspark/sql/tests/test_udf.py:
##########
@@ -917,6 +923,7 @@ def test_complex_return_types(self):
self.assertEqual(row[1], {"a": "b"})
self.assertEqual(row[2], Row(col1=1, col2=2))
+ @unittest.skipIf(not have_pyarrow, pyarrow_requirement_message)
def test_named_arguments(self):
Review Comment:
FYI, in `assertDataFrameEqual` we just skip using pandas if it's not
installed, but somehow it is not working properly for now.
```python
has_pandas = False
try:
# If pandas dependencies are available, allow pandas or
pandas-on-Spark DataFrame
import pyspark.pandas as ps
import pandas as pd
from pyspark.testing.pandasutils import PandasOnSparkTestUtils
has_pandas = True
except ImportError:
# no pandas, so we won't call pandasutils functions
pass
```
Anyway, I just create ticket SPARK-46821 to resolve this. I'm working on it.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
