Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/20473
BTW @ueshin,
I think we should use `require_minimum_pyarrow_version` here:
https://github.com/apache/spark/blob/ec63e2d0743a4f75e1cce21d0fe2b54407a86a4a/python/pyspark/sql/tests.py#L78-L84
because we declared >= 0.8.0 as you already know:
https://github.com/apache/spark/blob/b8bfce51abf28c66ba1fc67b0f25fe1617c81025/python/setup.py#L204
Would you like me to double check other files and fix it separately or
would you be willing to fix it?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
