Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19884#discussion_r157738702
--- Diff: python/pyspark/sql/types.py ---
@@ -1679,6 +1678,15 @@ def from_arrow_schema(arrow_schema):
for field in arrow_schema])
+def _require_minimum_pyarrow_version():
--- End diff --
> don't we need to use LooseVersion for pyarrow.__version__, too?
Seems fine by
https://github.com/python/cpython/blob/6f0eb93183519024cb360162bdd81b9faec97ba6/Lib/distutils/version.py#L331-L340
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
