This is an automated email from the ASF dual-hosted git repository.
viirya pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from d4e32c8 [SPARK-35654][CORE] Allow ShuffleDataIO control
DiskBlockManager.deleteFilesOnStop
add b8740a1 [SPARK-35499][PYTHON] Apply black to pandas API on Spark codes
No new revisions were added by this update.
Summary of changes:
.github/workflows/build_and_test.yml | 2 +-
dev/lint-python | 32 ++++++++++
dev/{run-tests => reformat-python} | 19 +++---
dev/requirements.txt | 3 +
dev/tox.ini | 4 +-
python/pyspark/pandas/accessors.py | 4 +-
python/pyspark/pandas/base.py | 4 +-
python/pyspark/pandas/config.py | 2 +-
python/pyspark/pandas/data_type_ops/base.py | 9 +--
python/pyspark/pandas/data_type_ops/binary_ops.py | 8 ++-
python/pyspark/pandas/data_type_ops/boolean_ops.py | 44 ++++++++-----
.../pandas/data_type_ops/categorical_ops.py | 2 +-
python/pyspark/pandas/data_type_ops/complex_ops.py | 15 +++--
python/pyspark/pandas/data_type_ops/date_ops.py | 2 +-
.../pyspark/pandas/data_type_ops/datetime_ops.py | 2 +-
python/pyspark/pandas/data_type_ops/num_ops.py | 10 ++-
python/pyspark/pandas/data_type_ops/string_ops.py | 2 +-
python/pyspark/pandas/extensions.py | 4 +-
python/pyspark/pandas/frame.py | 23 ++++---
python/pyspark/pandas/groupby.py | 4 +-
python/pyspark/pandas/indexes/multi.py | 9 +--
python/pyspark/pandas/indexing.py | 22 +++----
python/pyspark/pandas/internal.py | 69 ++++++++++-----------
python/pyspark/pandas/namespace.py | 14 ++++-
python/pyspark/pandas/plot/core.py | 12 +++-
python/pyspark/pandas/plot/matplotlib.py | 2 +-
python/pyspark/pandas/series.py | 25 +++++---
python/pyspark/pandas/spark/accessors.py | 4 +-
.../pandas/tests/data_type_ops/test_binary_ops.py | 11 ++--
.../pandas/tests/data_type_ops/test_boolean_ops.py | 6 +-
.../tests/data_type_ops/test_categorical_ops.py | 3 +-
.../pandas/tests/data_type_ops/test_complex_ops.py | 31 ++++++----
.../pandas/tests/data_type_ops/test_date_ops.py | 9 ++-
.../tests/data_type_ops/test_datetime_ops.py | 3 +-
.../pandas/tests/data_type_ops/test_num_ops.py | 12 ++--
.../pandas/tests/data_type_ops/test_string_ops.py | 6 +-
.../pandas/tests/data_type_ops/testing_utils.py | 1 +
python/pyspark/pandas/tests/indexes/test_base.py | 3 +-
.../tests/plot/test_frame_plot_matplotlib.py | 2 +-
.../pandas/tests/plot/test_frame_plot_plotly.py | 3 +-
.../tests/plot/test_series_plot_matplotlib.py | 2 +-
.../pandas/tests/plot/test_series_plot_plotly.py | 3 +-
python/pyspark/pandas/tests/test_categorical.py | 6 +-
python/pyspark/pandas/tests/test_dataframe.py | 72 ++++++++++++++--------
.../pandas/tests/test_dataframe_spark_io.py | 3 +-
python/pyspark/pandas/tests/test_expanding.py | 3 +-
python/pyspark/pandas/tests/test_groupby.py | 24 +++++---
python/pyspark/pandas/tests/test_namespace.py | 5 +-
.../pandas/tests/test_ops_on_diff_frames.py | 37 +++++++----
.../tests/test_ops_on_diff_frames_groupby.py | 3 +-
python/pyspark/pandas/tests/test_series.py | 27 +++++---
python/pyspark/pandas/typedef/typehints.py | 2 +-
.../pyspark/pandas/usage_logging/usage_logger.py | 2 +-
python/pyspark/pandas/utils.py | 12 ++--
54 files changed, 407 insertions(+), 236 deletions(-)
copy dev/{run-tests => reformat-python} (62%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
