Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/20409#discussion_r164178516
--- Diff: python/pyspark/sql/udf.py ---
@@ -188,6 +188,9 @@ def asNondeterministic(self):
.. versionadded:: 2.3
"""
+ # Here, we explicitly clean the cache to create a JVM UDF instance
+ # with 'deterministic' updated. See SPARK-23233.
+ self._judf_placeholder = None
--- End diff --
Add a test case?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
