Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/7031#issuecomment-115957527
Yay, this passed tests! I think that we should merge my other PR, #6967,
first, then loop back to review the parallelism-specific changes here. With 4
threads / processes of parallelism, the Python tests ran in ~10 minutes,
whereas they usually take 30+ minutes in Jenkins. In principle, + our tests
will support a much higher level of parallelism, so I bet we could cut this
down to 5 minutes or less.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
