GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/10885
[SPARK-8725] Test modules in topologically-sorted order in dev/run-tests
This patch improves our `dev/run-tests` script to test modules in a
topologically-sorted order based on modules' dependencies. This will help to
ensure that bugs in upstream projects are not misattributed to downstream
projects because those projects' tests were the first ones to exhibit the
failure
Topological sorting is also useful for shortening the feedback loop when
testing pull requests: if I make a change in SQL then the SQL tests should run
before MLlib, not after.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark SPARK-8725
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/10885.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #10885
----
commit adcc843950d89016a9b5ec7a38fa982f762f2a40
Author: Josh Rosen <[email protected]>
Date: 2016-01-24T01:50:10Z
Test modules in topologically-sorted order.
commit 6a9cc2abbf0d07e7fc4e0dc816c91bc2d67ead97
Author: Josh Rosen <[email protected]>
Date: 2016-01-24T01:56:55Z
No need to flatten test goals into a set.
commit 76a446e948f361b56ec054fad2277f74a82645d1
Author: Josh Rosen <[email protected]>
Date: 2016-01-24T01:57:27Z
Make pep8 happy
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
