This is an automated email from the ASF dual-hosted git repository.
ruifengz pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 3e1c3bdc7ee1 [SPARK-54009][CORE] Support `spark.io.mode.default`
add 7bd18e3852f1 [SPARK-53610][PYTHON] Limit Arrow batch sizes in
CoGrouped applyInPandas and applyInArrow
No new revisions were added by this update.
Summary of changes:
python/pyspark/sql/pandas/serializers.py | 8 +-
.../sql/tests/arrow/test_arrow_cogrouped_map.py | 63 +++++++++-
.../sql/tests/pandas/test_pandas_cogrouped_map.py | 96 +++++++++++----
.../python/CoGroupedArrowPythonRunner.scala | 130 +++++++++++++--------
.../sql/execution/python/PythonArrowInput.scala | 8 +-
5 files changed, 222 insertions(+), 83 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
