Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/20487#discussion_r166536018
--- Diff: python/pyspark/sql/session.py ---
@@ -646,6 +646,9 @@ def createDataFrame(self, data, schema=None,
samplingRatio=None, verifySchema=Tr
except Exception:
has_pandas = False
if has_pandas and isinstance(data, pandas.DataFrame):
+ from pyspark.sql.utils import require_minimum_pandas_version
+ require_minimum_pandas_version()
--- End diff --
just for curious, do you have a list of the places that we do this version
check for pandas and pyarrow?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
