Luran He created SPARK-36211:
--------------------------------
Summary: type check fails for `F.udf(...).asNonDeterministic()
Key: SPARK-36211
URL: https://issues.apache.org/jira/browse/SPARK-36211
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 3.1.2
Reporter: Luran He
The following code should type-check, but doesn't:
{{import uuid}}
{{pyspark.sql.functions as F}}
{{my_udf = F.udf(lambda: str(uuid.uuid4())).asNondeterministic()}}
In {{python/pyspark/sql/functions.pyi}} the `udf` signature is wrong
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]