Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/19787#discussion_r152014337
--- Diff: python/pyspark/sql/functions.py ---
@@ -2205,6 +2205,10 @@ def udf(f=None, returnType=StringType()):
rows that do not satisfy the conditions, the suggested workaround
is to incorporate the
condition logic into the functions.
+ .. note:: Users can't rely on short-curcuit evaluation of boolean
expressions to execute
--- End diff --
Just a little bit worried of overwhelming users with maybe too much
information although it might be worth.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]