This is an automated email from the ASF dual-hosted git repository.
ruifengz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from d4e34f5087c6 [SPARK-54446][SQL][ML][CONNECT] FPGrowth supports local
filesystem with Arrow file format
add 7251e95e22cc [SPARK-53615][PYTHON] Introduce iterator API for Arrow
grouped aggregation UDF
No new revisions were added by this update.
Summary of changes:
.../org/apache/spark/api/python/PythonRunner.scala | 2 +
python/pyspark/sql/pandas/_typing/__init__.pyi | 1 +
python/pyspark/sql/pandas/functions.py | 67 ++++++++++
python/pyspark/sql/pandas/functions.pyi | 2 +
python/pyspark/sql/pandas/serializers.py | 52 ++++++++
python/pyspark/sql/pandas/typehints.py | 48 ++++++-
.../sql/tests/arrow/test_arrow_udf_grouped_agg.py | 140 +++++++++++++++++++++
.../sql/tests/arrow/test_arrow_udf_typehints.py | 90 +++++++++++++
python/pyspark/util.py | 2 +
python/pyspark/worker.py | 47 +++++++
.../python/ArrowAggregatePythonExec.scala | 2 +
.../python/UserDefinedPythonFunction.scala | 6 +-
12 files changed, 456 insertions(+), 3 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
