Re: testing for warnings during tests

--- Gabor Szabo [EMAIL PROTECTED] wrote: So I wonder if there are other ways. E.g. if the harness could catch the warnings? The harness has code which can allow you to merge the STDERR and STDOUT streams. See the '--merge' switch to prove. With that, a (simple-minded) parser becomes:

Re: testing for warnings during tests

2008/6/10 Gabor Szabo [EMAIL PROTECTED]: So apparently using Test::NoWarnings isn't that cool and mandating it with CPANTS metric is even less cool. What's the problem with T::NW? Maybe I'm misunderstanding the rest of this mail but you seem to be looking for something that will catch warnings

Re: testing for warnings during tests

On Tue, Jun 10, 2008 at 10:33 AM, Fergal Daly [EMAIL PROTECTED] wrote: 2008/6/10 Gabor Szabo [EMAIL PROTECTED]: So apparently using Test::NoWarnings isn't that cool and mandating it with CPANTS metric is even less cool. What's the problem with T::NW? Maybe I'm misunderstanding the rest of

Re: testing for warnings during tests

On 10 Jun 2008, at 08:14, Ovid wrote: So I wonder if there are other ways. E.g. if the harness could catch the warnings? The harness has code which can allow you to merge the STDERR and STDOUT streams. See the '--merge' switch to prove. With that, a (simple-minded) parser becomes: use

Re: testing for warnings during tests

On Tue, Jun 10, 2008 at 3:33 AM, Fergal Daly [EMAIL PROTECTED] wrote: What's the problem with T::NW? Maybe I'm misunderstanding the rest of Not a problem with T::NW itself, just that it doesn't catch all the cases that Gabor is concerned about and people had issues with using CPANTS to encourage

Re: testing for warnings during tests

On Tue, Jun 10, 2008 at 12:28 AM, Gabor Szabo [EMAIL PROTECTED] wrote: The issue I am trying to solve is how to catch and report when a test suit gives any warnings? Are there situations where a test suite should give warnings? I.e. stuff that the user should see that shouldn't get swallowed

Re: testing for warnings during tests

I haven't used Test::NoWarnings. However, for me personally, I don't like to suppress output unless I am catching it in an explicit test. The code I am working on is designed to throw warnings or errors under certain conditions. Especially in code that is designed to run under a web server, it is

Re: New CPANTS metrics

In article [EMAIL PROTECTED], David Golden [EMAIL PROTECTED] wrote: On Mon, Jun 9, 2008 at 4:32 PM, Gabor Szabo [EMAIL PROTECTED] wrote: I am sending this to both the module-authors list so you can be aware of the new metrics and the perl-qa list as they might have a few words as well

Re: New CPANTS metrics

On Tue, Jun 10, 2008 at 12:27 PM, brian d foy [EMAIL PROTECTED] wrote: I'd like to see the metircs that only talk about the quality of the distribution, and leave everything else alone. If it's something I can fix by doing something to the distribution itself, measure it. If it's anything

Re: testing for warnings during tests

In article [EMAIL PROTECTED], Gabor Szabo [EMAIL PROTECTED] wrote: Having those warnings during tests is a problem that should be somehow solved. I'd like to have a cpan-testers report whenever my test suite issues warnings. It's not a new category. If the tests all pass it's still a PASS.

Reuse TAP from prove -v for later use

Hi! *Intro:* I use TAP to collect reports of several kinds, not only Perl libraries. Normally I send the raw TAP from running a test suite to a test receiver. That receiver collects the raw TAP into a database. I evaluate the TAP later with TAP::Parser. (The receiver is basically just a

Re: Reuse TAP from prove -v for later use

On 10 Jun 2008, at 17:48, Steffen Schwigon wrote: I'm not sure what's the best way to dual-use prove/Build test/make test on one hand and sending the raw TAP at the same time to the receiver. prove -v seems to slighty change my TAP, eg., adds extra single intermediate summary ok lines,

pgTAP

Hey all, I just wanted to mention that I've ported Test::More to PostgreSQL. Yes, you heard right. Details here: http://justatheory.com/computers/databases/postgresql/introducing_pgtap.html The project page for it should appear here in a day or two: http://pgfoundry.org/projects/pgtap/

Re: Reuse TAP from prove -v for later use

Steffen Schwigon wrote: *The question:* I'm not sure what's the best way to dual-use prove/Build test/make test on one hand and sending the raw TAP at the same time to the receiver. That's what TAP::Harness::Archive was meant to address. If you run prove with the -a flag it will create an

Re: best practices for temporary files during testing

On Saturday 07 June 2008 19.36.21 Gabor Szabo wrote: I just got a failure report from David Golden as this line did not work with Permission denied copy($0, $0.tmp) He was running it on Windows (Strawberry Perl). I am sure I create temporary files in various test, so it might be the

Re: New CPANTS metrics

* brian d foy [EMAIL PROTECTED] [2008-06-10T12:27:29] I'd like to see the metircs that only talk about the quality of the distribution, and leave everything else alone. If it's something I can fix by doing something to the distribution itself, measure it. If it's anything else, leave it out.

Re: New CPANTS metrics

On Tue, Jun 10, 2008 at 10:37 PM, Ricardo SIGNES [EMAIL PROTECTED] wrote: * brian d foy [EMAIL PROTECTED] [2008-06-10T12:27:29] I'd like to see the metircs that only talk about the quality of the distribution, and leave everything else alone. If it's something I can fix by doing something to

Re: pgTAP

Hi David, I think you wanted to send this to [EMAIL PROTECTED] Regards, -- Aristotle Pagaltzis // http://plasmasturm.org/

Re: pgTAP

On Jun 10, 2008, at 14:10, Aristotle Pagaltzis wrote: Hi David, I think you wanted to send this to [EMAIL PROTECTED] I guess. I'm not on that list. I was just thinking, do QA in SQL! Best, David

Re: New CPANTS metrics

G'day Everyone, brian d foy wrote: I'd like to see the metircs that only talk about the quality of the distribution, and leave everything else alone. If it's something I can fix by doing something to the distribution itself, measure it. If it's anything else, leave it out. Gabor Szabo wrote:

Re: New CPANTS metrics

On Wed, Jun 11, 2008 at 5:26 AM, Paul Fenwick [EMAIL PROTECTED] wrote: I think a good solution is to add a new category called honours. It is an honour to have your module packaged by Debian, included in the ActiveState distro, or to be used by another CPAN module. For honours, we only

Re: pgTAP

* David E. Wheeler [EMAIL PROTECTED] [2008-06-11 04:05]: I guess. I'm not on that list. I was just thinking, do QA in SQL! Well, that’s the point of that list. :-) We’re trying to make TAP a less of a Perl echo chamber thing, and from that desire the site and list arose. Your pgTAP experiments

RE: pgTAP

-Original Message- From: Aristotle Pagaltzis [mailto:[EMAIL PROTECTED] that's the power of TAP. ... Wasn't that a hit for Huy Lewis years ago ?...