dongjoon-hyun commented on a change in pull request #27586: 
[SPARK-30834][DOCS][PYTHON][2.4] Add note for recommended pandas and pyarrow 
versions
URL: https://github.com/apache/spark/pull/27586#discussion_r379650481
 
 

 ##########
 File path: docs/sql-pyspark-pandas-with-arrow.md
 ##########
 @@ -166,6 +166,12 @@ different than a Pandas timestamp. It is recommended to 
use Pandas time series f
 working with timestamps in `pandas_udf`s to get the best performance, see
 [here](https://pandas.pydata.org/pandas-docs/stable/timeseries.html) for 
details.
 
+### Recommended Pandas and PyArrow Versions
+
+For usage with pyspark.sql, the supported versions of Pandas is 0.19.2 and 
PyArrow is 0.8.0. Higher
 
 Review comment:
   BTW, I forgot the exact versions of the `branch-2.4` PR builders in AmpLab 
Jenkins. These are the community testing version. Did I understand correctly?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to