BryanCutler commented on a change in pull request #29686:
URL: https://github.com/apache/spark/pull/29686#discussion_r485345554
##########
File path: python/pyspark/sql/pandas/utils.py
##########
@@ -40,7 +40,7 @@ def require_minimum_pyarrow_version():
""" Raise ImportError if minimum version of pyarrow is not installed
"""
# TODO(HyukjinKwon): Relocate and deduplicate the version specification.
- minimum_pyarrow_version = "0.15.1"
+ minimum_pyarrow_version = "1.0.0"
Review comment:
I used 1.0.0 as a minimum version for pyarrow because the fixes that
went into 1.0.1 were not related to usage in Spark, as far as I could tell.
There were no fixes for Arrow Java, so I just used 1.0.1 in the pom, since it
is the latest.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
