GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/6866
[SPARK-8422] [BUILD] [PROJECT INFRA] Add a module abstraction to
dev/run-tests
This patch builds upon #5694 to add a 'module' abstraction to the
`dev/run-tests` script which groups together the per-module test logic,
including the mapping from file paths to modules, the mapping from modules to
test goals, and the dependencies / relationships between modules.
This refactoring makes it much easier to increase the granularity of test
modules, which will let us skip even more tests. It's also a prerequisite for
other changes that will reduce test time, such as running subsets of the Python
tests based on which files / modules have changed.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark more-dev-run-tests-refactoring
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6866.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6866
----
commit bb04f4a99767d0b802b2bf759b4a4ee08df8fa39
Author: Josh Rosen <[email protected]>
Date: 2015-06-18T00:26:34Z
WIP
commit 358a7017d7da88cfe4e8cfa7386593da1ab839c7
Author: Josh Rosen <[email protected]>
Date: 2015-06-18T01:05:27Z
Finish integrating module changes
commit 6d11b1d71ee9f02e49089508bf4dcb001847d342
Author: Josh Rosen <[email protected]>
Date: 2015-06-18T01:08:08Z
Remove doc profiles option, since it's not actually needed (see #6865)
commit de711aa290c6cc588522c1ebeb9d69ab074f5d36
Author: Josh Rosen <[email protected]>
Date: 2015-06-18T01:10:06Z
Test everything if nothing has changed (needed for non-PRB builds)
commit ee20c5541c224194f3f087be8f8c81ee5c63fca3
Author: Josh Rosen <[email protected]>
Date: 2015-06-18T01:11:56Z
Minor fixes
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
