I've also been wondering about integration tests. In the past, I've found that it's easy to break a build which creates a runnable jar. It should be reasonable straightforward to run some basic smoke tests using Maven. Even a test as simple as running help without reporting an error might be useful.
Opinions welcomed :-) Robert
