Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/20137#discussion_r159507510
--- Diff: python/pyspark/sql/udf.py ---
@@ -162,7 +168,8 @@ def wrapper(*args):
wrapper.func = self.func
wrapper.returnType = self.returnType
wrapper.evalType = self.evalType
- wrapper.asNondeterministic = self.asNondeterministic
+ wrapper.deterministic = self.deterministic
+ wrapper.asNondeterministic = lambda:
self.asNondeterministic()._wrapped()
--- End diff --
Can we do:
```python
wrapper.asNondeterministic = functools.wraps(
self.asNondeterministic)(lambda:
self.asNondeterministic()._wrapped())
```
So that it can produce a proper pydoc when we do `help(udf(lambda: 1,
"integer").asNondeterministic)` (not `help(udf(lambda: 1,
"integer").asNondeterministic())`.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
