This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 18daa37 [SPARK-30440][CORE][TESTS] Avoid race condition in
TaskSetManagerSuite by not using resourceOffer
add ee8d661 [SPARK-30434][PYTHON][SQL] Move pandas related
functionalities into 'pandas' sub-package
No new revisions were added by this update.
Summary of changes:
dev/sparktestsupport/modules.py | 7 +
examples/src/main/python/sql/arrow.py | 2 +-
python/docs/pyspark.sql.rst | 1 +
python/pyspark/serializers.py | 242 ---------
python/pyspark/sql/__init__.py | 4 +-
python/pyspark/sql/dataframe.py | 224 +--------
python/pyspark/sql/functions.py | 495 +------------------
python/pyspark/sql/group.py | 68 +--
.../sql/pandas/__init__.py} | 7 +-
python/pyspark/sql/pandas/conversion.py | 431 ++++++++++++++++
python/pyspark/sql/pandas/functions.py | 539 +++++++++++++++++++++
.../sql/{cogroup.py => pandas/group_ops.py} | 86 +++-
python/pyspark/sql/pandas/map_ops.py | 96 ++++
python/pyspark/sql/pandas/serializers.py | 281 +++++++++++
python/pyspark/sql/pandas/types.py | 284 +++++++++++
python/pyspark/sql/pandas/utils.py | 60 +++
python/pyspark/sql/session.py | 182 +------
python/pyspark/sql/tests/test_arrow.py | 4 +-
python/pyspark/sql/types.py | 261 ----------
python/pyspark/sql/udf.py | 6 +-
python/pyspark/sql/utils.py | 44 --
python/pyspark/testing/sqlutils.py | 4 +-
python/pyspark/worker.py | 6 +-
python/setup.py | 2 +
.../apache/spark/sql/IntegratedUDFTestUtils.scala | 4 +-
25 files changed, 1822 insertions(+), 1518 deletions(-)
copy python/{test_support/SimpleHTTPServer.py =>
pyspark/sql/pandas/__init__.py} (82%)
create mode 100644 python/pyspark/sql/pandas/conversion.py
create mode 100644 python/pyspark/sql/pandas/functions.py
rename python/pyspark/sql/{cogroup.py => pandas/group_ops.py} (63%)
create mode 100644 python/pyspark/sql/pandas/map_ops.py
create mode 100644 python/pyspark/sql/pandas/serializers.py
create mode 100644 python/pyspark/sql/pandas/types.py
create mode 100644 python/pyspark/sql/pandas/utils.py
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
