Yicong Huang created SPARK-58314:
------------------------------------
Summary: Remove ArrowStreamUDFSerializer
Key: SPARK-58314
URL: https://issues.apache.org/jira/browse/SPARK-58314
Project: Spark
Issue Type: Sub-task
Components: PySpark
Affects Versions: 5.0.0
Reporter: Yicong Huang
After all eval types that used ArrowStreamUDFSerializer (including the
mapInArrow paths, grouped/cogrouped-map Arrow UDFs, UDTF paths, and
TransformWithStateInPySparkRowSerializer) have been refactored to build their
serializers directly in worker.py, the ArrowStreamUDFSerializer class is dead
code with no runtime users. Remove the class and update the stale docstring
references in conversion.py that mention it.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
