Github user ueshin commented on a diff in the pull request:
https://github.com/apache/spark/pull/19884#discussion_r157692179
--- Diff: python/pyspark/sql/types.py ---
@@ -1679,6 +1678,15 @@ def from_arrow_schema(arrow_schema):
for field in arrow_schema])
+def _require_minimum_pyarrow_version():
--- End diff --
I'm not familiar with `LooseVersion`, but don't we need to use
`LooseVersion` for `pyarrow.__version__`, too? cc @HyukjinKwon
Btw, shall we add the dependency to `setup.py`?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
