Yicong Huang created SPARK-55723:
------------------------------------
Summary: Unify UDTF error messages with other UDFs in Arrow-based
execution
Key: SPARK-55723
URL: https://issues.apache.org/jira/browse/SPARK-55723
Project: Spark
Issue Type: Improvement
Components: PySpark
Affects Versions: 4.1.2
Reporter: Yicong Huang
Currently, the enforce_schema method in ArrowTableConversions uses
UDTF-specific error messages (e.g., RESULT_COLUMNS_MISMATCH_FOR_ARROW_UDTF)
when casting fails. As we consolidate more Arrow UDF code paths to share this
function, the error messages should be generalized to be user-friendly for all
UDF types, not just UDTF.
This is a follow-up from
https://github.com/apache/spark/pull/54296#discussion_r2861772381.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
