>On Thu, Sep 04, 2008 at 12:04:45AM -0700, Eric Wilhelm wrote: >> My examination of the .meta files in the cpan says [correction: 2286] >> distributions have a META.yml with 'generated_by' citing >> Module::Build. To my knowledge, the testing of pre-release versions >> does not extend to building or testing these [2]k+ distributions, and >> once it ships, the failure reports go to a lot of authors, not M::B >> maintainers. So, that worries me. Does anyone have the ability to >> setup a set of out-of-band tests to avoid spamming everyone else >> with my failures? > >Sure. I'll just set up 5.10.0 and CPAN::Reporter, and disable all > email sending. Then we can just look in its log file to see what > passed and what failed (that will also include any dependencies). > >Would it be sufficient to test, say, a random sample of 300 of those... > >Just a big long list of AUTHOR/dist-1.23.tar.gz lines would be > sufficient.
Thanks. Does this work? http://scratchcomputing.com/tmp/generated_by.module-build.txt Perhaps 2286 is still a lot. A one-liner tells me there are 474 authors. I wonder if starting with one dist from each author would be a useful sampling, since often the weird stuff happens when an author found a way to do some undocumented thing with M::B and we didn't know about it. Should I split-out two lists that way? Now, of course setting-up your smokes with MB as the preferred installer and such is important. It would also be necessary to be able to check fails from this against the previous MB version. Please let me know where else I can help. Thanks, Eric -- "It ain't those parts of the Bible that I can't understand that bother me, it's the parts that I do understand." --Mark Twain --------------------------------------------------- http://scratchcomputing.com ---------------------------------------------------
