This is an automated email from the ASF dual-hosted git repository.
cutlerb pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 08678456d16 [SPARK-40476][ML][SQL] Reduce the shuffle size of ALS
add 7b8016a578f [SPARK-38098][PYTHON] Add support for ArrayType of nested
StructType to arrow-based conversion
No new revisions were added by this update.
Summary of changes:
python/docs/source/user_guide/sql/arrow_pandas.rst | 5 +--
python/pyspark/sql/pandas/types.py | 9 ++++-
python/pyspark/sql/pandas/utils.py | 13 ++++++++
python/pyspark/sql/tests/test_dataframe.py | 26 +++++++++++++++
python/pyspark/sql/tests/test_pandas_udf_scalar.py | 38 +++++++++++++++++-----
.../org/apache/spark/sql/internal/SQLConf.scala | 4 +--
6 files changed, 81 insertions(+), 14 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
