Hyukjin Kwon created SPARK-48706:
------------------------------------

             Summary: Python UDF in higher order functions should not throw 
internal error
                 Key: SPARK-48706
                 URL: https://issues.apache.org/jira/browse/SPARK-48706
             Project: Spark
          Issue Type: Improvement
          Components: PySpark
    Affects Versions: 4.0.0
            Reporter: Hyukjin Kwon


{code}
from pyspark.sql.functions import transform, udf, col, array
spark.range(1).select(transform(array("id"), lambda x: udf(lambda y: 
y)(x))).collect()
{code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to