Hyukjin Kwon created SPARK-28359:
------------------------------------

             Summary: Make integrated UDF tests robust by making them no-op
                 Key: SPARK-28359
                 URL: https://issues.apache.org/jira/browse/SPARK-28359
             Project: Spark
          Issue Type: Bug
          Components: PySpark, SQL
    Affects Versions: 3.0.0
            Reporter: Hyukjin Kwon


Current UDFs available in `IntegratedUDFTestUtils` are not exactly no-op. It 
converts input column to strings and outputs to strings.

This causes many issues, for instance, 
https://github.com/apache/spark/pull/25128 or 
https://github.com/apache/spark/pull/25110

Ideally we should make this UDF virtually noop.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to