Randy Kobes <[EMAIL PROTECTED]> writes:

> Also, some packages in general supply some non-standard tests
> that must be run and evaluated manually - although it's a bit of
> a judgement call, I think such tests can reasonably lead to a
> "pass" grade.

Mentioning that there are other ways of giving a pass than judging
the output of "make test" seems to be a good idea. Many years ago
before I started as a cpantester some  modules got a PASS not by 
runing make test but by runing the suplied "samples" or "examples"
etc. Another area with problems are GUI modules.

Therefore we could append the FAQ with something like:
  If there are no tests supplied but some sample scripts its up to
  your judgement to give a PASS if these scripts run fine. The same
  goes for rather visual tests like GUI modules. 

HTH,

Andreas Marcel

Reply via email to