Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-25 Thread Adrian Howard
On 24 Apr 2006, at 15:51, Shlomi Fish wrote: [snip] Am I missing something or isn't that what Test::Harness:Straps/Test::Run::Straps are for? If not, I suppose I can extract a class out of Test::Run::Straps that will provide a reusable TAP parser. [snip] In addition to Michael's and

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-24 Thread Adam Kennedy
chromatic wrote: On Sunday 23 April 2006 15:46, Michael Peters wrote: How about a good TAP parser module that does nothing but parse TAP. Then it could be used in all kinds of test harness permutations. That's exactly what I want and precisely why I think a well-defined TAP is more

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-24 Thread Adam Kennedy
Michael Peters wrote: Shlomi Fish wrote: On Sunday 23 April 2006 22:35, chromatic wrote: On Sunday 23 April 2006 12:05, Shlomi Fish wrote: This debate demonstrates why a plugin system is necessary for a test harness. No, it demonstrates why a well-defined test output protocol is useful. I

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-24 Thread Rafael Garcia-Suarez
Andy Lester wrote: I'm approaching the end of this release cycle. I really want to get this released. I've removed the meaningless percentages of tests that have failed. If you rely on the output at the end, it's different now. I'm not attached to percentages, which I wasn't looking

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-24 Thread Adrian Howard
On 23 Apr 2006, at 20:05, Shlomi Fish wrote: [snip] This debate demonstrates why a plugin system is necessary for a test harness. If it has it, then one can write a plugin to control whether or not percentages are displayed. So for example, you can install a plugin that does that, and put

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-24 Thread Shlomi Fish
On Monday 24 April 2006 01:46, Michael Peters wrote: Shlomi Fish wrote: On Sunday 23 April 2006 22:35, chromatic wrote: On Sunday 23 April 2006 12:05, Shlomi Fish wrote: This debate demonstrates why a plugin system is necessary for a test harness. No, it demonstrates why a

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-24 Thread Michael Peters
Shlomi Fish wrote: On Monday 24 April 2006 01:46, Michael Peters wrote: Shlomi Fish wrote: On Sunday 23 April 2006 22:35, chromatic wrote: On Sunday 23 April 2006 12:05, Shlomi Fish wrote: This debate demonstrates why a plugin system is necessary for a test harness. No, it demonstrates

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-24 Thread chromatic
On Monday 24 April 2006 07:56, Michael Peters wrote: Not only would this make it easier to have a harness look for something other than TAP (maybe some other protocol from some other language) but it also means I can parse test runs after they've been run on a completely different machine

Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Andy Lester
I'm approaching the end of this release cycle. I really want to get this released. I've removed the meaningless percentages of tests that have failed. If you rely on the output at the end, it's different now. xoa file: $CPAN/authors/id/P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Yitzchak Scott-Thoennes
On Sun, Apr 23, 2006 at 11:01:17AM +0200, Marcus Holland-Moritz wrote: The only thing worth mentioning is that with perl 5.003, the following happens: [EMAIL PROTECTED] $ perl5.003 Makefile.PL Can't locate ExtUtils/Command.pm in @INC at Makefile.PL line 4.

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Yitzchak Scott-Thoennes
On Sun, Apr 23, 2006 at 11:34:12AM +0200, Marcus Holland-Moritz wrote: On 2006-04-23, at 02:26:54 -0700, Yitzchak Scott-Thoennes wrote: On Sun, Apr 23, 2006 at 11:01:17AM +0200, Marcus Holland-Moritz wrote: The only thing worth mentioning is that with perl 5.003, the following happens:

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Adrian Howard
On 23 Apr 2006, at 07:02, Andy Lester wrote: [snip] I've removed the meaningless percentages of tests that have failed. If you rely on the output at the end, it's different now. [snip] I'll just repeat what I left on Andy's blog here in case anybody agrees with me. I don't like the

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread H.Merijn Brand
On Sun, 23 Apr 2006 12:07:18 +0100, Adrian Howard [EMAIL PROTECTED] wrote: On 23 Apr 2006, at 07:02, Andy Lester wrote: [snip] I've removed the meaningless percentages of tests that have failed. If you rely on the output at the end, it's different now. [snip] I'll just repeat what

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Marcus Holland-Moritz
On 2006-04-23, at 01:02:00 -0500, Andy Lester wrote: I'm approaching the end of this release cycle. I really want to get this released. I've removed the meaningless percentages of tests that have failed. If you rely on the output at the end, it's different now. I've run it through a

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Marcus Holland-Moritz
On 2006-04-23, at 02:49:14 -0700, Yitzchak Scott-Thoennes wrote: On Sun, Apr 23, 2006 at 11:34:12AM +0200, Marcus Holland-Moritz wrote: On 2006-04-23, at 02:26:54 -0700, Yitzchak Scott-Thoennes wrote: On Sun, Apr 23, 2006 at 11:01:17AM +0200, Marcus Holland-Moritz wrote: The only

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Marcus Holland-Moritz
On 2006-04-23, at 02:26:54 -0700, Yitzchak Scott-Thoennes wrote: On Sun, Apr 23, 2006 at 11:01:17AM +0200, Marcus Holland-Moritz wrote: The only thing worth mentioning is that with perl 5.003, the following happens: [EMAIL PROTECTED] $ perl5.003 Makefile.PL

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread demerphq
On 4/23/06, H.Merijn Brand [EMAIL PROTECTED] wrote: On Sun, 23 Apr 2006 12:07:18 +0100, Adrian Howard [EMAIL PROTECTED] wrote: On 23 Apr 2006, at 07:02, Andy Lester wrote: [snip] I've removed the meaningless percentages of tests that have failed. If you rely on the output at the

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Shlomi Fish
On Sunday 23 April 2006 15:08, H.Merijn Brand wrote: On Sun, 23 Apr 2006 12:07:18 +0100, Adrian Howard [EMAIL PROTECTED] wrote: On 23 Apr 2006, at 07:02, Andy Lester wrote: [snip] I've removed the meaningless percentages of tests that have failed. If you rely on the output at the

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread chromatic
On Sunday 23 April 2006 12:05, Shlomi Fish wrote: This debate demonstrates why a plugin system is necessary for a test harness. No, it demonstrates why a well-defined test output protocol is useful. -- c

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Shlomi Fish
On Sunday 23 April 2006 22:35, chromatic wrote: On Sunday 23 April 2006 12:05, Shlomi Fish wrote: This debate demonstrates why a plugin system is necessary for a test harness. No, it demonstrates why a well-defined test output protocol is useful. I agree that a well-defined test output

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread chromatic
On Sunday 23 April 2006 12:46, Shlomi Fish wrote: I agree that a well-defined test output protocol is useful. However, are you implying that assuming we have that, one can write several different test harnesses to process such test outputs? (I'm just guessing.) No. Wouldn't that imply

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread David H. Adler
On Sun, Apr 23, 2006 at 01:02:00AM -0500, Andy Lester wrote: I'm approaching the end of this release cycle. I really want to get this released. Tests pass. One not numeric warning: t/00compile.ok 1/6Argument 2.57_06 isn't numeric in subroutine entry at t/lib/Test/More.pm line 670

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Nicholas Clark
On Sun, Apr 23, 2006 at 01:02:00AM -0500, Andy Lester wrote: I'm approaching the end of this release cycle. I really want to get this released. I've removed the meaningless percentages of tests that have failed. If you rely on the output at the end, it's different now. xoa

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Shlomi Fish
On Sunday 23 April 2006 23:11, chromatic wrote: On Sunday 23 April 2006 12:46, Shlomi Fish wrote: I agree that a well-defined test output protocol is useful. However, are you implying that assuming we have that, one can write several different test harnesses to process such test outputs?

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Tels
Moin, On Sunday 23 April 2006 23:08, Shlomi Fish wrote: On Sunday 23 April 2006 23:11, chromatic wrote: On Sunday 23 April 2006 12:46, Shlomi Fish wrote: I agree that a well-defined test output protocol is useful. However, are you implying that assuming we have that, one can write

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Michael Peters
Shlomi Fish wrote: On Sunday 23 April 2006 22:35, chromatic wrote: On Sunday 23 April 2006 12:05, Shlomi Fish wrote: This debate demonstrates why a plugin system is necessary for a test harness. No, it demonstrates why a well-defined test output protocol is useful. I agree that a

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread chromatic
On Sunday 23 April 2006 15:46, Michael Peters wrote: How about a good TAP parser module that does nothing but parse TAP. Then it could be used in all kinds of test harness permutations. That's exactly what I want and precisely why I think a well-defined TAP is more important than a plugin

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread James E Keenan
David H. Adler wrote: Tests pass. One not numeric warning: t/00compile.ok 1/6Argument 2.57_06 isn't numeric in subroutine entry at t/lib/Test/More.pm line 670 This is the same warning I reported in an earlier message: http://groups.google.com/group/perl.qa/msg/fee69dde25cf42ec

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread Andy Lester
This is the same warning I reported in an earlier message: http:// groups.google.com/group/perl.qa/msg/fee69dde25cf42ec Given the wise counsel of a former Phalanx strategos (every warning your test suite throws is a bug which must be tracked down), I spent several hours looking at this

Re: Test me please: P/PE/PETDANCE/Test-Harness-2.57_06.tar.gz

2006-04-23 Thread David H. Adler
On Sun, Apr 23, 2006 at 04:14:01PM -0400, David H. Adler wrote: On Sun, Apr 23, 2006 at 01:02:00AM -0500, Andy Lester wrote: I'm approaching the end of this release cycle. I really want to get this released. Tests pass. One not numeric warning: Of course, I forgot to mention: Perl