This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from 206cc1a554ef [SPARK-48613][SQL] SPJ: Support auto-shuffle one side +
less join keys than partition keys
add effd4d85a312 [SPARK-48834][SQL] Disable variant input/output to python
scalar UDFs, UDTFs, UDAFs during query compilation
No new revisions were added by this update.
Summary of changes:
.../src/main/resources/error/error-conditions.json | 10 ++
.../connect/client/arrow/ArrowDeserializer.scala | 2 +-
.../sql/connect/client/arrow/ArrowSerializer.scala | 2 +-
.../sql/tests/pandas/test_pandas_udf_scalar.py | 45 +++++++
python/pyspark/sql/tests/test_types.py | 39 ++++++
python/pyspark/sql/tests/test_udf.py | 68 +++++++++-
python/pyspark/sql/types.py | 17 +--
.../spark/sql/catalyst/ScalaReflection.scala | 3 +-
.../spark/sql/catalyst/expressions/PythonUDF.scala | 37 ++++-
.../variant/VariantExpressionEvalUtils.scala | 10 ++
.../spark/sql/errors/QueryCompilationErrors.scala | 6 +
.../sql/catalyst/expressions/ScalaUDFSuite.scala | 32 ++++-
.../apache/spark/sql/IntegratedUDFTestUtils.scala | 149 ++++++++++++++++++++-
.../sql/execution/python/PythonUDFSuite.scala | 55 ++++++++
.../sql/execution/python/PythonUDTFSuite.scala | 125 +++++++++++++++++
15 files changed, 582 insertions(+), 18 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
