Github user zero323 commented on the issue:
https://github.com/apache/spark/pull/16534
@holdenk I don't think it should go to the point release at all (same as
https://github.com/apache/spark/pull/16533 which, depending on the resolution,
may introduce new functionality or breaking API changes).
https://github.com/apache/spark/pull/16538 went to 2.2 so I think it is a
reasonable target for all subtasks in
[SPARK-19159](https://issues.apache.org/jira/browse/SPARK-19159).
That being said public vs. private is a bit fuzzy here. `udf` docstring
states that it:
> Creates a `Column` expression representing a user defined function (UDF)
and doesn't document return type otherwise. This is obviously not true.
It is also worth noting that we can use a function wrapper without any
changes to the API. It is not the most common practice but we can add required
attributes to the function to keep full backwards compatibility for the time
being.
One way or another it would be nice to make it consistent with
[SPARK-18777](https://issues.apache.org/jira/browse/SPARK-18777) though. If we
go with a function wrapper here, it would make sense to use one there as well.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
