Github user jsnowacki commented on the issue:
https://github.com/apache/spark/pull/19443
This PR fixes only the functions created using `_create_function`, which to
what I found, were the only ones affected by the issue. Rest of the functions
either have different assumption or eventually do the same thing but more
explicitly. I didn't check all of the functions in `functions.py` nor the test
does that, as the list of functions to check would have to be done manually.
Nonetheless, from what I've seen all the explicitly defined functions get
column object via `_to_java_column`, which check the type of argument and casts
string column names to `Column` object.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
