Github user holdenk commented on the issue:
https://github.com/apache/spark/pull/15960
Arguing on the for-side: if we do want to add a rule like this adding it
closer to the start of the 2.X series is probably the time to do it - any
backports will hopefully not need to go back very far. (Otherwise we could
leave it for the start of the 3.X since backports across major versions are
already normally a bit painful).
Maybe it would make sense to run spark-perf & spark-sql-perf on this branch
and see if there is any meaningful performance improvement?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]