Github user marmbrus commented on the pull request:
https://github.com/apache/spark/pull/13087#issuecomment-220700839
My main questions remains: does this actually make a difference in runtime?
or is execution smart enough already to do this optimization (even if to the
user it looks like its getting called more than once).
Also, @dongjoon-hyun would you have time to audit places where UDFs are
documented and add the expectation that they are deterministic?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
