This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from dd32f45 [SPARK-31069][CORE] Avoid repeat compute
`chunksBeingTransferred` cause hight cpu cost in external shuffle service when
`maxChunksBeingTransferred` use default value
add 8e2a0bd [SPARK-24554][PYTHON][SQL] Add MapType support for PySpark
with Arrow
No new revisions were added by this update.
Summary of changes:
python/docs/source/user_guide/arrow_pandas.rst | 3 +-
python/pyspark/sql/pandas/conversion.py | 8 ++-
python/pyspark/sql/pandas/functions.py | 1 -
python/pyspark/sql/pandas/serializers.py | 10 ++-
python/pyspark/sql/pandas/types.py | 42 +++++++++++-
python/pyspark/sql/tests/test_arrow.py | 77 +++++++++++++++++++---
.../pyspark/sql/tests/test_pandas_cogrouped_map.py | 4 +-
.../pyspark/sql/tests/test_pandas_grouped_map.py | 7 +-
.../sql/tests/test_pandas_udf_grouped_agg.py | 4 +-
python/pyspark/sql/tests/test_pandas_udf_scalar.py | 23 +++++--
.../org/apache/spark/sql/internal/SQLConf.scala | 2 +-
.../spark/sql/execution/arrow/ArrowWriter.scala | 12 ++--
12 files changed, 157 insertions(+), 36 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
