Github user pwendell commented on the pull request:
https://github.com/apache/spark/pull/4048#issuecomment-70300365
@squito yeah for sure, I think it's nice to have some set of integration
tests that are flagged as such. I was just suggesting other ways we can improve
our tests as well.
I wouldn't give up so easily on making `local-cluster` faster though... I
don't think anyone has looked into optimizing it recently, and it's a common
mechanism used by all tests, so if we improve the launch time then it will
speed things up across the board. Also, there are other efforts around test
parallelization that are ongoing which will speed up the runtime.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
