This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from e9c4e7ebd595 [SPARK-46397][PYTHON][CONNECT] Function `sha2` should
raise `PySparkValueError` for invalid `numBits`
add f99b86a1afa0 [SPARK-45914][PYTHON] Support commit and abort API for
Python data source write
No new revisions were added by this update.
Summary of changes:
python/pyspark/sql/tests/test_python_datasource.py | 84 +++++++++++++++-----
...data_sources.py => commit_data_source_write.py} | 70 +++++++++++------
.../pyspark/sql/worker/write_into_data_source.py | 3 +
.../python/UserDefinedPythonDataSource.scala | 81 +++++++++++++++++--
.../execution/python/PythonDataSourceSuite.scala | 91 ++++++++++++++++++++++
5 files changed, 277 insertions(+), 52 deletions(-)
copy python/pyspark/sql/worker/{lookup_data_sources.py =>
commit_data_source_write.py} (54%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
