On Thu, Aug 15, 2019 at 11:21 AM L A Walsh <cpan-tes...@tlinx.org> wrote: > This is very worrisome as it indicates old modules that used to > work may no longer work even though nothing changed. AFAIK, this > shouldn't be possible.
Of course it's possible. Your code might not have changed, but other things change all the time -- other modules that your code is using, system libraries used by everything, the operating system itself, or the hardware that it's running on. analysis.cpantesters.org performs statistical analysis on all the reports in the system in an attempt to find patterns that can isolate what the relevant factors are to changing test results -- but it can only analyze data in the reports. It's likely that the relevant information (OS/platform, dependent modules, compile-time parameters etc) are included in the reports, but it's also possible that it's not, in which case you'd need to make a new release that included additional information in the test output.
