Hello all,
I'm running up against an issue that I'm sure has come up countless times.
How can we share test dependencies in a principled way? I would like to
configure our projects such that:
1. For a project *P*, its tests are associated with the project, so that
`mvn install` from the project directory *p/* fails when P's tests fail.
2. Some of P's testing functionality (e.g., stubs, testing utility
classes, JUnit superclasses) are packaged for use in the tests of other
projects* D* that depend on P.
3. P's shared testing functionality has dependencies on P. For example,
P defines a repository interface R, and its tests define and use an RStub
that implements R. We want to package RStub for use by D's tests.
4. When D declares a scope:test dependency on P's testing functionality,
automatically pull in the transitive dependencies of that testing
functionality.
5. Avoid cycles in the Maven dependency graph.
Some things I've tried so far:
- Create test-jars for P. This fails on #2 and #4:
- The test-jars include all of P's test classes instead of just the
testing functionality that needs to be shared for use by D's tests.
- All transitive dependencies of P's test-jar must be manually
specified with scope:test in the D's POM.
- Extract the stubs to an independent "P - Stubs" project, which P's
tests depend on.
- p-stubs depends on P.
- Stubs, testing utilities, etc. go in p-stubs/src/main/.
- P depends on p-stubs with scope:test.
- D depends on p-stubs with scope:test.
- This fails on #5: it causes a cycle in the dependency graph since P
depends on p-stubs (scope:test) and p-stubs depends on P. See
https://stackoverflow.com/questions/10174542
- Create an independent "P - Tests" project, with P's stubs and tests.
- p-tests depends on P.
- Stubs, testing utilities, etc. go in p-tests/src/main/.
- P's tests go in p-tests/src/test/.
- D depends on p-tests with scope:test.
- This almost works but fails on #1: P's build succeeds when its
tests fail.
- This approach also seems to be fighting Maven and IDE tooling. For
example, NetBeans will automatically create p/src/test even
though we never
intend to put anything there.
My searches so far have not turned up any complete solutions to this
problem. The maven-jar-plugin documentation has a section
<https://maven.apache.org/plugins/maven-jar-plugin/examples/create-test-jar.html#The_preferred_way>
that touches on this issue:
The preferred way
In order to let Maven resolve all test-scoped transitive dependencies you
should create a separate project.
1. <project>
2. <groupId>groupId</groupId>
3. <artifactId>artifactId-tests</artifactId>
4. <version>version</version>
5. ...
6. </project>
- Move the sources files from src/test/java you want to share from the
original project to the src/main/java of this project. The same type of
movement counts for the resources as well of course.
- Move the required test-scoped dependencies and from the original
project to this project and remove the scope (i.e. changing it to the
compile-scope). And yes, that means that the junit dependency (or any
other testing framework dependency) gets the default scope too. You'll
probably need to add some project specific dependencies as well to let it
all compile again.
Now you have your reusable *test-classes* and you can refer to it as you're
used to...
This is along the lines of the "P - Stubs" approach I suggested above, but
it unfortunately cannot work since the stubs themselves depend on P (fails
on #3 above).
Is there a satisfying way to solve this problem? It seems to me like any
one of the following changes would resolve the issue.
- Allow P to depend on a separate project p-stubs with scope:test, even
though p-stubs depends on P (instead of calling it a dependency cycle).
This means that the build order would be a bit awkward: P (compile) →
p-stubs (compile) → P (test).
- Allow P to indicate that its tests are in another project p-tests.
That way, `mvn install` in p/ would continue to p-tests/ and then fail P's
build if the tests in p-tests fail.
- Introduce a new "stubs" concept to the project model, adding a new
p/stubs directory for project P. A stubs-compile step would occur between
compile and test-compile. The stubs and tests of D could depend on P's
stubs (perhaps automatically by virtue of D's dependency on P).
Maybe one of these—or a better alternative—is already possible? I feel like
I must be missing something. Is something wrong with the way I'm
structuring my projects? Does Maven already provide a way to achieve this
out-of-the-box? Is there a plugin that provides something like the "stubs"
functionality?
Thanks!
Brandon
p.s. Sorry that my first message to the list is so long!
