Github user davies commented on the pull request:
https://github.com/apache/spark/pull/2935#issuecomment-60837619
The timeout of jenkins test is caused by performance regression introduced
in this PR. Deserialization of Hadoop Configuration is pretty slow, after
removing broadcast for configuration, each task may have 10-50ms overhead for
it. For Hive query, each task may have more than one configuration in one
query, the regression is even more.
So, we can not remove the broadcast for conf if we can not speed up
deserialization of hadoop configuration.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
