HyukjinKwon commented on issue #23882: [SPARK-26979][PySpark][WIP] Add missing column name support for some SQL functions URL: https://github.com/apache/spark/pull/23882#issuecomment-466841398 Yes, anyway let's whitelist what we're fixing in this PR. Also, it should better be fully checked. Please check other APIs in `functions.py` and `dataframe.py`. What I am worried is if there's a place that doesn't make sense for `Column` and string - we should really whitelist. PySpark side can also be easily done by `lower(df.columnname)`. It doesn't look too much bothering to me actually. "$" syntax is Scala specific and it should stay in Scala. Python specific stuff stays in Python alone.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
