On Tue, Aug 26, 2014 at 12:35:18PM +0100, David Cantrell wrote:
> The problem is that the interesting platforms that aren't getting tested
> are those for which you can't just spin up another VM. In particular I'm
> thinking of Solaris on Sparc, and Irix.
There's also other dimensions of testing which could use more coverage,
other than architecture and perl version -- in particular, various
configuration permutationsm, such as:
- running perl under a chrooted jail where things like $HOME are unwritable,
- or where $TMPDIR is not /tmp (and /tmp doesn't exist or is unwritable),
- or with HARNESS_OPTIONS=j9 (parallel testing),
- unusual locale settings (defaulting to a right-to-left language is always
fun)
- $Config{make} is not 'make'
- no compiler
- unusual compiler flags
Running with these configs always leads to "interesting" test results.
(Note that for these reports to be useful to the author, the configuration
changes should be clearly explained in a 'notes' section, or with an
accompanying dump of environment variables, etc.)
