This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
from db357edb7b2 [SPARK-44431][SQL] Fix behavior of null IN (empty list) in
optimization rules
add 964f7555a7f [SPARK-44380][SQL][PYTHON] Support for Python UDTF to
analyze in Python
No new revisions were added by this update.
Summary of changes:
.../src/main/resources/error/error-classes.json | 5 +
.../sql/connect/planner/SparkConnectPlanner.scala | 20 +-
.../src/main/scala/org/apache/spark/SparkEnv.scala | 70 ++-
.../org/apache/spark/api/python/PythonRunner.scala | 35 +-
.../spark/api/python/PythonWorkerFactory.scala | 51 +--
.../spark/api/python/StreamingPythonRunner.scala | 5 +-
docs/sql-error-conditions.md | 6 +
python/pyspark/daemon.py | 9 +-
python/pyspark/errors/error_classes.py | 10 +
python/pyspark/sql/connect/client/core.py | 2 +-
python/pyspark/sql/connect/functions.py | 3 +-
python/pyspark/sql/connect/plan.py | 16 +-
python/pyspark/sql/connect/udtf.py | 20 +-
python/pyspark/sql/functions.py | 38 +-
python/pyspark/sql/tests/test_udtf.py | 474 ++++++++++++++++++++-
python/pyspark/sql/udtf.py | 89 +++-
.../pyspark/sql/worker}/__init__.py | 0
python/pyspark/sql/worker/analyze_udtf.py | 142 ++++++
python/pyspark/worker.py | 25 +-
python/setup.py | 1 +
.../spark/sql/catalyst/analysis/Analyzer.scala | 6 +
.../spark/sql/catalyst/expressions/PythonUDF.scala | 23 +
.../spark/sql/errors/QueryCompilationErrors.scala | 7 +
.../python/UserDefinedPythonFunction.scala | 191 ++++++++-
.../apache/spark/sql/IntegratedUDFTestUtils.scala | 2 +-
25 files changed, 1131 insertions(+), 119 deletions(-)
copy {examples/src/main/python => python/pyspark/sql/worker}/__init__.py (100%)
create mode 100644 python/pyspark/sql/worker/analyze_udtf.py
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
