Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/6679#issuecomment-109483321
I noticed this bottleneck while running some Hive compatibility tests in
Spark SQL; I'm kicking off a test run which only runs that suite to see how
much of a difference this makes by itself. More generally, I've noticed some
perf. issues in SQL in places where we didn't broadcast configurations; I'm
going to work on gradually tackling these + creating JIRAs for them in the next
couple of weeks.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
