Re: CPAN Testers reports == spam?

[Timothe Litt]

On 06-Mar-22 20:25, Felipe Gasper wrote:



On Mar 6, 2022, at 20:11, Ricardo Signes  wrote:

On Thu, Mar 3, 2022, at 09:48, Felipe Gasper wrote:

   1.0 BAYES_999  BODY: Bayes spam probability is 99.9 to 100%
  [score: 1.]
   5.0 BAYES_99   BODY: Bayes spam probability is 99 to 100%
  [score: 1.]

These relate to your training of SpamAssassin.  I don't know how you or your 
provider is training your Bayes db, but you're getting six points from that.

It’s a cPanel server.

Maybe the `nbsp` in there--useless in a plain-text email?--is the culprit. 
(Bayes, from what I’ve read, takes into account misspelled words.)


   3.3 EXCUSE_REMOVE  BODY: Talks about how to be removed from mailings

This is, I think, a bit higher than the default value for this, but not much higher.  I 
think that's too high, but perhaps replacing this with "to unsubscribe" would 
help.  (Again, though, your personal Bayes is the likely problem here.)

The list-help, list-unsubscribe, etc. headers would probably be a good addition 
here?


   0.9 PP_MIME_FAKE_ASCII_TEXT BODY: MIME text/plain claims to be ASCII
   but isn't

The email does not have a Content-Type header.  It should have one, probably 
"text/plain; charset=utf-8"

Agreed.

-F


The simplest solution would be to feed these reports into the bayes 
filter.  sa-learn is the utility for that.


E.g. file them in a folder, and do something like

sa-learn --ham --mbox ham_folder

I keep training folders for spam, ham, and forget & have a daily cron 
job to keep the filter up-to-date.


sa-learn has a bunch of options for tuning its behavior, which man will 
turn up.





OpenPGP_signature
Description: OpenPGP digital signature

Re: CPAN Testers reports == spam?

[Felipe Gasper]

> On Mar 6, 2022, at 20:11, Ricardo Signes  
> wrote:
> 
> On Thu, Mar 3, 2022, at 09:48, Felipe Gasper wrote:
>>   1.0 BAYES_999  BODY: Bayes spam probability is 99.9 to 100%
>>  [score: 1.]
>>   5.0 BAYES_99   BODY: Bayes spam probability is 99 to 100%
>>  [score: 1.]
> 
> These relate to your training of SpamAssassin.  I don't know how you or your 
> provider is training your Bayes db, but you're getting six points from that.

It’s a cPanel server.

Maybe the `nbsp` in there--useless in a plain-text email?--is the culprit. 
(Bayes, from what I’ve read, takes into account misspelled words.)

> 
>>   3.3 EXCUSE_REMOVE  BODY: Talks about how to be removed from 
>> mailings
> 
> This is, I think, a bit higher than the default value for this, but not much 
> higher.  I think that's too high, but perhaps replacing this with "to 
> unsubscribe" would help.  (Again, though, your personal Bayes is the likely 
> problem here.)

The list-help, list-unsubscribe, etc. headers would probably be a good addition 
here?

> 
>>   0.9 PP_MIME_FAKE_ASCII_TEXT BODY: MIME text/plain claims to be ASCII
>>   but isn't
> 
> The email does not have a Content-Type header.  It should have one, probably 
> "text/plain; charset=utf-8"

Agreed.

-F

Re: CPAN Testers reports == spam?

[Ricardo Signes]

On Thu, Mar 3, 2022, at 09:48, Felipe Gasper wrote:
>   1.0 BAYES_999  BODY: Bayes spam probability is 99.9 to 100%
>  [score: 1.]
>   5.0 BAYES_99   BODY: Bayes spam probability is 99 to 100%
>  [score: 1.]

These relate to your training of SpamAssassin.  I don't know how you or your 
provider is training your Bayes db, but you're getting six points from that.

>   3.3 EXCUSE_REMOVE  BODY: Talks about how to be removed from mailings

This is, I think, a bit higher than the default value for this, but not much 
higher.  I think that's too high, but perhaps replacing this with "to 
unsubscribe" would help.  (Again, though, your personal Bayes is the likely 
problem here.)

>   0.9 PP_MIME_FAKE_ASCII_TEXT BODY: MIME text/plain claims to be ASCII
>   but isn't

The email does not have a Content-Type header.  It should have one, probably 
"text/plain; charset=utf-8"

-- 
rjbs

Re: CPAN Testers Daily Summary Report

[Andreas Koenig]

> On Tue, 31 Dec 2019 20:22:49 -0800, Karen Etheridge  
> said:

  > I have been getting blasted with these types of failures again too. e.g.:
  > http://www.cpantesters.org/cpan/report/a3e7fbf8-2c2b-11ea-9cc5-910b4c49479c
  > http://www.cpantesters.org/cpan/report/a8244f3e-2a0d-11ea-bad3-922c4c49479c

  > Nigel, I'll be honest with you: I automatically ignore every report I
  > receive from you, because the false positive rate is so outrageously
  > high it's not even worth looking anymore.

Automatically ignoring will not help finding the bug that is triggered
in Nigel's setup.

I think it is worthwhile to report when Nigel's smoker start acting up.
I'd also find it worthwhile that Nigel stops his smokers when it happens
and reports at least to me, as the author of CPAN.pm, what happened in
his environment, so that we can figure out how to prevent it or at least
to shut down the smoker automatically.

My impression is that Nigel's smokers have been running fine for a long
time, but at least the solaris one is now acting up in weird ways. I
just found this one:

http://www.cpantesters.org/cpan/report/4d53df1a-2c66-11ea-abbc-55fa4b49479c

It is an "unknown" that reports during t/00-report-prereqs.t that
Package::DeprecationManager 0.17 is installed. It goes on the run a
zillion tests OK. But all of a sudden it does not find
Package::DeprecationManager anymore. It also can't locate Moose anymore.

As if somebody had removed the whole directory in which the test was
running.

Nigel, please stop this and maybe other smokers and help find out the
root cause. I'm sorry that this happens, I can imagine that the bug is
entirely mine, but I don't know what it is and how to fix it. I need
your input and your intuition to pinpoint the bug.

Thank you!
-- 
andreas

Re: CPAN Testers Daily Summary Report

[Karen Etheridge]

I have been getting blasted with these types of failures again too. e.g.:

http://www.cpantesters.org/cpan/report/a3e7fbf8-2c2b-11ea-9cc5-910b4c49479c
http://www.cpantesters.org/cpan/report/a8244f3e-2a0d-11ea-bad3-922c4c49479c

Nigel, I'll be honest with you: I automatically ignore every report I
receive from you, because the false positive rate is so outrageously
high it's not even worth looking anymore.

On Tue, Dec 31, 2019 at 7:14 PM Serguei Trouchelle  wrote:
>
> Nothing. It only happens in your smoker, and every time it looks like
> something removes all files while smoker is running. Are you sure you're
> only running one CPAN process at the time?
>
> On 2019-12-29 07:07, Nigel Horne wrote:
> > What is different about your package that makes it fail in this way?
> >
> > -Nigel
> >
> > On 29/12/2019 02:23, Serguei Trouchelle wrote:
> >> It's happening again:
> >>
> >> http://www.cpantesters.org/cpan/report/b78880ce-27da-11ea-a823-10fac181c852
> >>
> >>
> >> On 2019-10-22 05:05, Nigel Horne wrote:
> >>>
> >>>
> >>> My set up hasn't changed.  If it's not working on 31.5 there's
> >>> something amiss somewhere, but not with my setup.
> >>>
> >>> -Nigel
> >>>
> >>> On 10/22/19, 5:26 AM, "Serguei Trouchelle"  wrote:
> >>>
> >>>  Hello,
> >>>   There's something wrong with your smoker setup.
> >>>   On 2019-10-21 21:12, CPAN Tester Report Server wrote:
> >>>  > Dear Serguei Trouchelle,
> >>>  >
> >>>  > Please find below the latest reports for your distributions,
> >>> generated by CPAN Testers, from the last 24 hours.
> >>>  >
> >>>  > To change your preferences, or disable notifications, please
> >>> visit the CPAN Testers Preferences system at
> >>> https://prefs.cpantesters.org.
> >>>  >
> >>>  >
> >>>  > CPAN-SQLite-0.217:
> >>>  > - amd64-netbsd / 5.31.5:
> >>>  >- UNKNOWN
> >>> http://www.cpantesters.org/cpan/report/b52b2232-f427-11e9-934a-579662b887d7
> >>> ("Nigel Horne" )
> >>>  >
> >>>  >
> >>>  >
> >>>  > If you have an issue with a particular report, or wish to
> >>> gain further information from the tester, please use the 'Find A
> >>> Tester' tool at http://stats.cpantesters.org/cpanmail.html, using
> >>> the ID or GUID of the report, as listed above, to locate the correct
> >>> email address.
> >>>  >
> >>>  > You can also adjust the frequency and nature of these
> >>> notifications or unsubscribe from the notifications entirely, by
> >>> going to the CPAN Testers Preferences website
> >>> (https://prefs.cpantesters.org) and login with your PAUSE
> >>> credentials. You can disable CPAN Testers notifications permanently
> >>> or temporarily. If you have problems with accessing the site, please
> >>> contact the admins  and request to be removed
> >>> from the automatic mailings.
> >>>  >
> >>>  > Thanks,
> >>>  > The CPAN Testers
> >>>  >
> >>>  > CPAN Testers is only made possible with the support of our
> >>> sponsors.
> >>>  > For more information on sponsoring, please visit the I ♥
> >>> CPAN Testers website (http://iheart.cpantesters.org)
> >>>  >
> >>>  > One of our esteemed sponsors is Xiing - GeekUni, a Bronze
> >>> Sponsors.
> >>>  >
> >>>  > Geekuni is an institute which provides online software
> >>> development courses. Every concept is presented in the context of a
> >>> hands-on exercise and the completion of the course is a fully
> >>> functional piece of software.
> >>>  >
> >>>  > https://geekuni.com/
> >>>  >
> >>>--
> >>>  S.T.
> >>>
> >>
> >>
>
>
> --
> S.T.

Re: CPAN Testers Daily Summary Report

[Serguei Trouchelle]

Nothing. It only happens in your smoker, and every time it looks like 
something removes all files while smoker is running. Are you sure you're 
only running one CPAN process at the time?


On 2019-12-29 07:07, Nigel Horne wrote:

What is different about your package that makes it fail in this way?

-Nigel

On 29/12/2019 02:23, Serguei Trouchelle wrote:

It's happening again:

http://www.cpantesters.org/cpan/report/b78880ce-27da-11ea-a823-10fac181c852 



On 2019-10-22 05:05, Nigel Horne wrote:



My set up hasn't changed.  If it's not working on 31.5 there's 
something amiss somewhere, but not with my setup.


-Nigel

On 10/22/19, 5:26 AM, "Serguei Trouchelle"  wrote:

 Hello,
  There's something wrong with your smoker setup.
  On 2019-10-21 21:12, CPAN Tester Report Server wrote:
 > Dear Serguei Trouchelle,
 >
 > Please find below the latest reports for your distributions, 
generated by CPAN Testers, from the last 24 hours.

 >
 > To change your preferences, or disable notifications, please 
visit the CPAN Testers Preferences system at 
https://prefs.cpantesters.org.

 >
 >
 > CPAN-SQLite-0.217:
 > - amd64-netbsd / 5.31.5:
 >    - UNKNOWN 
http://www.cpantesters.org/cpan/report/b52b2232-f427-11e9-934a-579662b887d7 
("Nigel Horne" )

 >
 >
 >
 > If you have an issue with a particular report, or wish to 
gain further information from the tester, please use the 'Find A 
Tester' tool at http://stats.cpantesters.org/cpanmail.html, using 
the ID or GUID of the report, as listed above, to locate the correct 
email address.

 >
 > You can also adjust the frequency and nature of these 
notifications or unsubscribe from the notifications entirely, by 
going to the CPAN Testers Preferences website 
(https://prefs.cpantesters.org) and login with your PAUSE 
credentials. You can disable CPAN Testers notifications permanently 
or temporarily. If you have problems with accessing the site, please 
contact the admins  and request to be removed 
from the automatic mailings.

 >
 > Thanks,
 > The CPAN Testers
 >
 > CPAN Testers is only made possible with the support of our 
sponsors.
 > For more information on sponsoring, please visit the I ♥ 
CPAN Testers website (http://iheart.cpantesters.org)

 >
 > One of our esteemed sponsors is Xiing - GeekUni, a Bronze 
Sponsors.

 >
 > Geekuni is an institute which provides online software 
development courses. Every concept is presented in the context of a 
hands-on exercise and the completion of the course is a fully 
functional piece of software.

 >
 > https://geekuni.com/
 >
   --
 S.T.







--
S.T.

Re: CPAN Testers Daily Summary Report

[Serguei Trouchelle]

It's happening again:

http://www.cpantesters.org/cpan/report/b78880ce-27da-11ea-a823-10fac181c852

On 2019-10-22 05:05, Nigel Horne wrote:



My set up hasn't changed.  If it's not working on 31.5 there's something amiss 
somewhere, but not with my setup.

-Nigel

On 10/22/19, 5:26 AM, "Serguei Trouchelle"  wrote:

 Hello,
 
 There's something wrong with your smoker setup.
 
 On 2019-10-21 21:12, CPAN Tester Report Server wrote:

 > Dear Serguei Trouchelle,
 >
 > Please find below the latest reports for your distributions, generated 
by CPAN Testers, from the last 24 hours.
 >
 > To change your preferences, or disable notifications, please visit the 
CPAN Testers Preferences system at https://prefs.cpantesters.org.
 >
 >
 > CPAN-SQLite-0.217:
 > - amd64-netbsd / 5.31.5:
 >- UNKNOWN http://www.cpantesters.org/cpan/report/b52b2232-f427-11e9-934a-579662b887d7 
("Nigel Horne" )
 >
 >
 >
 > If you have an issue with a particular report, or wish to gain further 
information from the tester, please use the 'Find A Tester' tool at 
http://stats.cpantesters.org/cpanmail.html, using the ID or GUID of the report, as 
listed above, to locate the correct email address.
 >
 > You can also adjust the frequency and nature of these notifications or 
unsubscribe from the notifications entirely, by going to the CPAN Testers Preferences 
website (https://prefs.cpantesters.org) and login with your PAUSE credentials. You can 
disable CPAN Testers notifications permanently or temporarily. If you have problems with 
accessing the site, please contact the admins  and request 
to be removed from the automatic mailings.
 >
 > Thanks,
 > The CPAN Testers
 >
 > CPAN Testers is only made possible with the support of our sponsors.
 > For more information on sponsoring, please visit the I ♥ CPAN Testers 
website (http://iheart.cpantesters.org)
 >
 > One of our esteemed sponsors is Xiing - GeekUni, a Bronze Sponsors.
 >
 > Geekuni is an institute which provides online software development 
courses. Every concept is presented in the context of a hands-on exercise and the 
completion of the course is a fully functional piece of software.
 >
 > https://geekuni.com/
 >
 
 
 --

 S.T.
 
 




--
S.T.

Re: CPAN Testers is down

[Nigel Horne]

I second that.  I’m not sure that I have the means to help, but if I can, let 
me know.

-Nigel

From: Olivier Mengué 
Date: Friday, October 18, 2019 at 5:26 AM
To: Doug Bell 
Cc: Andrei Melnikov , CPAN Testers Discussion List 

Subject: Re: CPAN Testers is down

Thanks Doug for your work on CPAN infrastructure !

Le mer. 16 oct. 2019 à 18:48, Doug Bell 
mailto:d...@preaction.me>> a écrit :
Yes, apparently the folks who were hosting our database at ServerCentral are no 
longer with the company, so I'm having trouble getting it back. Once I do, I'm 
moving it back in-house, because this will not happen again...

Doug Bell
d...@preaction.me<mailto:d...@preaction.me>



> On Oct 16, 2019, at 8:53 AM, Andrei Melnikov 
> mailto:andy.melni...@gmail.com>> wrote:
>
> http://matrix.cpantesters.org/?dist=Proc-Guard reports old cached
> data, and 
> http://www.cpantesters.org/cpan/report/c97445c8-6bf9-1014-ac3c-f9c91c119aac
> reports Service Unavailable
>
> --
> Andrei

Re: CPAN Testers is down

[Todd E Rinaldo]

I’ll pile on that. Thank you!!!

Sent from my iPhone

> On Oct 18, 2019, at 11:33 AM, Olivier Mengué  wrote:
> 
> 
> Thanks Doug for your work on CPAN infrastructure !
> 
>> Le mer. 16 oct. 2019 à 18:48, Doug Bell  a écrit :
>> Yes, apparently the folks who were hosting our database at ServerCentral are 
>> no longer with the company, so I'm having trouble getting it back. Once I 
>> do, I'm moving it back in-house, because this will not happen again...
>> 
>> Doug Bell
>> d...@preaction.me
>> 
>> 
>> 
>> > On Oct 16, 2019, at 8:53 AM, Andrei Melnikov  
>> > wrote:
>> > 
>> > http://matrix.cpantesters.org/?dist=Proc-Guard reports old cached
>> > data, and 
>> > http://www.cpantesters.org/cpan/report/c97445c8-6bf9-1014-ac3c-f9c91c119aac
>> > reports Service Unavailable
>> > 
>> > -- 
>> > Andrei

Re: CPAN Testers is down

[Olivier Mengué]

Thanks Doug for your work on CPAN infrastructure !

Le mer. 16 oct. 2019 à 18:48, Doug Bell  a écrit :

> Yes, apparently the folks who were hosting our database at ServerCentral
> are no longer with the company, so I'm having trouble getting it back. Once
> I do, I'm moving it back in-house, because this will not happen again...
>
> Doug Bell
> d...@preaction.me
>
>
>
> > On Oct 16, 2019, at 8:53 AM, Andrei Melnikov 
> wrote:
> >
> > http://matrix.cpantesters.org/?dist=Proc-Guard reports old cached
> > data, and
> http://www.cpantesters.org/cpan/report/c97445c8-6bf9-1014-ac3c-f9c91c119aac
> > reports Service Unavailable
> >
> > --
> > Andrei
>

Re: CPAN Testers is down

[Doug Bell]

Yes, apparently the folks who were hosting our database at ServerCentral are no 
longer with the company, so I'm having trouble getting it back. Once I do, I'm 
moving it back in-house, because this will not happen again...

Doug Bell
d...@preaction.me



> On Oct 16, 2019, at 8:53 AM, Andrei Melnikov  wrote:
> 
> http://matrix.cpantesters.org/?dist=Proc-Guard reports old cached
> data, and 
> http://www.cpantesters.org/cpan/report/c97445c8-6bf9-1014-ac3c-f9c91c119aac
> reports Service Unavailable
> 
> -- 
> Andrei

Re: CPAN testers website timeouts

[Doug Bell]

Upon closer inspection, it looks like it's gotten worse today. I'm looking into 
it.

> On Aug 17, 2017, at 1:04 PM, Doug Bell  wrote:
> 
> Yes. Now that the incoming test reports are on the same machine as the rest 
> of the web APIs, they are now subject to the random, debilitating spikes in 
> traffic that everything else is. I can't ban everyone doing it, so I have to 
> fix the performance problems. This will take some time.
> 
> If these came from earlier in the week (Saturday/Sunday), then it was a 
> misconfiguration of the Fastly proxy. The timeouts have been increased quite 
> a bit, but the traffic spikes still kill the server.
> 
>> On Aug 17, 2017, at 6:34 AM, David Cantrell  wrote:
>> 
>> Yesterday evening and this morning I've been getting messages similar to
>> this when I try to look at the test failures that I get in my mail:
>> 
>> Error 503 first byte timeout
>> first byte timeout
>> Guru Mediation:
>> Details: cache-lhr6336-LHR 1502969464 1081180210
>> Varnish cache server
>> 
>> or
>> 
>> Error 503 backend read error
>> backend read error
>> Guru Mediation:
>> Details: cache-lhr6336-LHR 1502969525 1081782213
>> Varnish cache server
>> 
>> I generally get what I wanted after a few retries though.
>> 
>> -- 
>> David Cantrell | Bourgeois reactionary pig
>> 
>> Hail Caesar!  Those about to vi ^[ you!

Re: CPAN testers website timeouts

[Doug Bell]

Yes. Now that the incoming test reports are on the same machine as the rest of 
the web APIs, they are now subject to the random, debilitating spikes in 
traffic that everything else is. I can't ban everyone doing it, so I have to 
fix the performance problems. This will take some time.

If these came from earlier in the week (Saturday/Sunday), then it was a 
misconfiguration of the Fastly proxy. The timeouts have been increased quite a 
bit, but the traffic spikes still kill the server.

> On Aug 17, 2017, at 6:34 AM, David Cantrell  wrote:
> 
> Yesterday evening and this morning I've been getting messages similar to
> this when I try to look at the test failures that I get in my mail:
> 
>  Error 503 first byte timeout
>  first byte timeout
>  Guru Mediation:
>  Details: cache-lhr6336-LHR 1502969464 1081180210
>  Varnish cache server
> 
> or
> 
>  Error 503 backend read error
>  backend read error
>  Guru Mediation:
>  Details: cache-lhr6336-LHR 1502969525 1081782213
>  Varnish cache server
> 
> I generally get what I wanted after a few retries though.
> 
> -- 
> David Cantrell | Bourgeois reactionary pig
> 
> Hail Caesar!  Those about to vi ^[ you!

Re: CPAN Testers AUTOMATED_TESTING config

[Slaven Rezic]

bulk88  writes:

> Slaven Rezic wrote:
>> Karen Etheridge  writes:
>>
>>> Hi Slaven,
>>>
>>> recently I received a number of failing test reports from you, for
>>> Plack-App-BeanstalkConsole-0.004:
>>>
>>> http://www.cpantesters.org/cpan/report/27614552-c707-11e2-be51-ac14a65f1290
>>> http://www.cpantesters.org/cpan/report/bc294a00-c706-11e2-b547-d1b9f05bb613
>>> http://www.cpantesters.org/cpan/report/976876e6-c706-11e2-b45e-827567d01fb8
>>> http://www.cpantesters.org/cpan/report/089d0ca6-c706-11e2-b644-eee7e73c5bf2
>>> http://www.cpantesters.org/cpan/report/6dd3a9b2-c707-11e2-87dd-f08dfdc235a3
>>>
>>> However, there should be *no testing at all* done for this distribution,
>>> (save any reports that are sent manually via cpanm-reporter), because the
>>> first line of Makefile.PL is:
>>>
>>> exit 0 if $ENV{AUTOMATED_TESTING};
>>>
>>> This is because this distribution requires the presence of a php
>>> executable, and also the Makefile.PL downloads a large file from github --
>>> so to respect github's servers, I'd rather this happen only when the module
>>> is actually going to be used.
>>>
>>> Automated CPAN testing is supposed to set the AUTOMATED_TESTING variable:
>>>
>>> http://wiki.cpantesters.org/wiki/CPANAuthorNotes
>>>
>>>  "Can I tell if my module is being tested by an automated client 
>>> (a.k.a. 'smoker')?"
>>>
>>>  Automated smoke testers should set $ENV{AUTOMATED_TESTING} to
>>> a true value. This allows authors to skip certain tests (or include
>>> certain tests) when the results are not being monitored by a human
>>> being.
>>>
>>>  One could even go so far as to halt building and testing a
>>> distribution under automated testing by exiting with zero at the
>>> top of the Makefile.PL or Build.PL file:
>>>
>>>  exit 0 if $ENV{AUTOMATED_TESTING};
>>>
>>>
>>> Please could you set AUTOMATED_TESTING in your smokers?  thank you!
>>>
>>
>> Actually, my smoker does not fail under this sentence: "... are not
>> being monitored by a human being". I look into every FAIL report before
>> sending. Really.
>>
>> But I can setup a special rule in 01.DISABLED.yml for your distribution.
>>
>> Regards,
>>  Slaven
>>
>
> As of 2015 your smoker has neither AUTOMATED_TESTING or
> NONINTERACTIVE_TESTING set as described in
> http://www.nntp.perl.org/group/perl.cpan.testers.discuss/2013/06/msg3159.html
>
> See
> http://www.cpantesters.org/cpan/report/8c7c2c36-a887-11e5-b1c7-2d09e1bfc7aa
> http://www.cpantesters.org/cpan/report/8acca780-a887-11e5-b1c7-2d09e1bfc7aa
> http://www.cpantesters.org/cpan/report/892a795c-a887-11e5-b1c7-2d09e1bfc7aa
> http://www.cpantesters.org/cpan/report/8e0862cc-a887-11e5-b1c7-2d09e1bfc7aa
>
> So there is no way for a module to know it is running on CPAN Testers
> on your smoker, and no way to make a module's building/testing more
> verbose for CPAN Testers and less verbose human watched installs, so I
> had to make that module more verbose for everyone.
>

Hi Dragan,

I can do this, but again, it will be just a distroprefs file for your
distribution. I cannot see that any of the five documented environment
variables in David's blog article matches your request (more verbosity):
NONINTERACTIVE_TESTING is just about interactivity, not verbosity,
EXTENDED_TESTING probably does not apply (the amount of testing seems to
be the same), and AUTOMATED_TESTING does not apply for my wrapper script
around CPAN.pm --- in fact, the same script is used for my normal module
installs; so a "smoke" test+install and a "real" test+install is
indistinguishable (other than me using or not using the installed
module).

Regards,
Slaven

-- 
Slaven Rezic - slaven  rezic  de
  BBBike - route planner for cyclists in Berlin
  WWW version:   http://www.bbbike.de
  Perl/Tk version for Unix and Windows:  http://bbbike.sourceforge.net

Re: CPAN Testers AUTOMATED_TESTING config

[bulk88]

Slaven Rezic wrote:

Karen Etheridge  writes:


Hi Slaven,

recently I received a number of failing test reports from you, for
Plack-App-BeanstalkConsole-0.004:

http://www.cpantesters.org/cpan/report/27614552-c707-11e2-be51-ac14a65f1290
http://www.cpantesters.org/cpan/report/bc294a00-c706-11e2-b547-d1b9f05bb613
http://www.cpantesters.org/cpan/report/976876e6-c706-11e2-b45e-827567d01fb8
http://www.cpantesters.org/cpan/report/089d0ca6-c706-11e2-b644-eee7e73c5bf2
http://www.cpantesters.org/cpan/report/6dd3a9b2-c707-11e2-87dd-f08dfdc235a3

However, there should be *no testing at all* done for this distribution,
(save any reports that are sent manually via cpanm-reporter), because the
first line of Makefile.PL is:

exit 0 if $ENV{AUTOMATED_TESTING};

This is because this distribution requires the presence of a php
executable, and also the Makefile.PL downloads a large file from github --
so to respect github's servers, I'd rather this happen only when the module
is actually going to be used.

Automated CPAN testing is supposed to set the AUTOMATED_TESTING variable:

http://wiki.cpantesters.org/wiki/CPANAuthorNotes

 "Can I tell if my module is being tested by an automated client (a.k.a. 
'smoker')?"

 Automated smoke testers should set $ENV{AUTOMATED_TESTING} to a true 
value. This allows authors to skip certain tests (or include certain tests) 
when the results are not being monitored by a human being.

 One could even go so far as to halt building and testing a distribution 
under automated testing by exiting with zero at the top of the Makefile.PL or 
Build.PL file:

 exit 0 if $ENV{AUTOMATED_TESTING};


Please could you set AUTOMATED_TESTING in your smokers?  thank you!



Actually, my smoker does not fail under this sentence: "... are not
being monitored by a human being". I look into every FAIL report before
sending. Really.

But I can setup a special rule in 01.DISABLED.yml for your distribution.

Regards,
 Slaven



As of 2015 your smoker has neither AUTOMATED_TESTING or 
NONINTERACTIVE_TESTING set as described in 
http://www.nntp.perl.org/group/perl.cpan.testers.discuss/2013/06/msg3159.html


See
http://www.cpantesters.org/cpan/report/8c7c2c36-a887-11e5-b1c7-2d09e1bfc7aa
http://www.cpantesters.org/cpan/report/8acca780-a887-11e5-b1c7-2d09e1bfc7aa
http://www.cpantesters.org/cpan/report/892a795c-a887-11e5-b1c7-2d09e1bfc7aa
http://www.cpantesters.org/cpan/report/8e0862cc-a887-11e5-b1c7-2d09e1bfc7aa

So there is no way for a module to know it is running on CPAN Testers on 
your smoker, and no way to make a module's building/testing more verbose 
for CPAN Testers and less verbose human watched installs, so I had to 
make that module more verbose for everyone.

Possible Typo in Report [was Re: CPAN Testers Daily Summary Report]

[Shlomi Fish]

Hi all,

this message reads:

On Sat, 28 Nov 2015 02:23:17 +
CPAN Tester Report Server  wrote:

> Dear Shlomi Fish,
> 
> Please find below the latest reports for your distributions, generated by
> CPAN Testers, from the last 24 hours. 
> 
> To change your preferences, or disable notifications, please visit the CPAN
> Testers Preferences system at https://prefs.cpantesters.org.
> 
> 
[SNIPPED] 
> CPAN Testers is only made possible with the support of our sponsors.
> For more information on sponsoring, please visit the I ♥ CPAN Testers website
> (http://iheart.cpantesters.org)
> 
> One of our etseemed sponsors is , a .
> 

Shouldn't it be "esteemed": https://en.wiktionary.org/wiki/esteemed ? Should it
be corrected?

Regards,

Shlomi Fish



-- 
-
Shlomi Fish

Please reply to list if it's a mailing list post

Re: CPAN Testers Daily Summary Report

[Anselmo Canfora]

Thank you,
I given a quick glance to blog posts, not sure if my case can be drawn 
back to the reported issues explained there. If you notice the imagine 
below, the output states: /Test::More- broken/ (instead of version 
number).
Could be in this case, the module (or the underlying ones) failed to 
test itself?:)

The Report of my case is here:

http://www.cpantesters.org/cpan/report/2ef9476c-48d2-11e4-bf95-495f2c6f0924

Anselmo Canfora

Il 02/10/2014 15.30, Olivier Mengué ha scritto:
Those blog posts (and the attached comments) may be useful to learn 
more about Test::More testing you're suffering:


http://blogs.perl.org/users/chad_exodist_granum/2014/08/the-new-testbuilder---why.html
http://blogs.perl.org/users/brian_d_foy/2014/09/testmore-has-lots-of-crazy-new-development-thats-breaking-my-modules.html

2014-10-01 12:37 GMT+02:00 Anselmo Canfora acanf...@cpan.org 
mailto:acanf...@cpan.org:


Hello,
I received the notification reported below, it seems that
Test::More is broken in one of the test machines. Who is the
person I should notify this?




Thank you in advance for the help!

Anselmo Canfora



 Original message 

Dear Anselmo Canfora,

Please find below the latest reports for your distributions, generated by 
CPAN Testers, from the last 24 hours.

To change your preferences, or disable notifications, please visit the CPAN 
Testers Preferences system athttps://prefs.cpantesters.org.


JSONP-0.71:
- x86_64-linux-thread-multi-ld / 5.18.2:
   - 
FAILhttp://www.cpantesters.org/cpan/report/2ef9476c-48d2-11e4-bf95-495f2c6f0924



If you have an issue with a particular report, or wish to gain further 
information from the tester, please use the 'Find A Tester' tool 
athttp://stats.cpantesters.org/cpanmail.html, using the ID or GUID of the 
report, as listed above, to locate the correct email address.

You can also adjust the frequency and nature of these notification or unsubscribe from 
the notifications entirely, by going to the CPAN Testers Preferences website 
(https://prefs.cpantesters.org) and login with your PAUSE credentials. You can disable CPAN 
Testers notifications permanently or temporarily. If you have problems with accessing the 
site, please contact Barbiebar...@cpan.org  mailto:bar...@cpan.org  and 
request to be removed from the automatic mailings.

Thanks,
The CPAN Testers
-- 
Reports:http://www.cpantesters.org

Statistics:http://stats.cpantesters.org
Preferences:https://prefs.cpantesters.org
Wiki:http://wiki.cpantesters.org
Blog:http://blog.cpantesters.org

Re: CPAN Testers

[David Cantrell]

On Wed, Jun 11, 2014 at 09:52:24PM +0100, Alberto Simoes wrote:

 One of Nigel's machines reported on my module Math::GSL:
 http://www.cpantesters.org/cpan/report/97446734-f1a2-11e3-af0f-6440bde15059
 
 It seems that the problem is that CC is somehow configured as ' cc'. 
 Yes, with that space in the beginning.
 
 I am not sure how that space got there. But it is messing around with 
 ExtUtils::CBuilder.
 
 I am not sure if:
  - ExtUtils::CBuilder should be tweaked to strip spaces in the command 
 name...
  - or if this should never happen, and that Perl needs to be fixed 
 before continuing sending these reports...

Note that having spaces in $Config{cc} is valid. Back when I was the
maintainer of Devel::CheckLib it came up, the example being 'ccache cc'.
You need to split on spaces and build the compiler invocation from the
resulting list, as well as $Config{ccflags} or whatever it's called.
Possibly re-ordering the flags if you want to add your own. Thank god I
don't maintain that code any more :-)

I suppose that, theoretically, you might even need to parse something
hateful with quoted whitespace in it. Yuck.

However, leading/trailing whitespace like in this test report is
probably an error. Given that Config.pm is created at perl build time,
it might be worth taking up with p5p.

-- 
David Cantrell | Bourgeois reactionary pig

   23.5 degrees of axial tilt is the reason for the season

Re: CPAN Testers

[Alberto Simoes]

On 12/06/14, 13:40, Nigel Horne wrote:

On 11/06/2014 16:52, Alberto Simoes wrote:

Dear Nigel, Dear CPAN Testers,

One of Nigel's machines reported on my module Math::GSL:
http://www.cpantesters.org/cpan/report/97446734-f1a2-11e3-af0f-6440bde15059


It seems that the problem is that CC is somehow configured as ' cc'.
Yes, with that space in the beginning.


I'm calling prelbrew with -Acc=cc on MacOS to ensure cc (aka gcc) is
used rather than clang.  I don't set any spaces, either Perlbrew is
doing it or part of the Perl build.  I'm not sure how to progress from
here.


Thanks for your feedback. I noticed that some of your machines with 
clang have the space as well. Anyway, the problem is more complicated, 
as there are places where cc=ccache cc and that fails as well.


Therefore, trying to get p5p to discuss on what ExtUtils::CBuilder 
should do.


Cheers
ambs



I am not sure how that space got there. But it is messing around with
ExtUtils::CBuilder.

I am not sure if:
 - ExtUtils::CBuilder should be tweaked to strip spaces in the command
name...
 - or if this should never happen, and that Perl needs to be fixed
before continuing sending these reports...



-Nigel

Re: CPAN Testers

[Karen Etheridge]

On Thu, Jun 12, 2014 at 08:40:15AM -0400, Nigel Horne wrote:
 I'm calling prelbrew with -Acc=cc on MacOS to ensure cc (aka gcc) is
 used rather than clang.  I don't set any spaces, either Perlbrew is
 doing it or part of the Perl build.  I'm not sure how to progress
 from here.

Nigel, can you provide the full output from 'perl -V'?

Re: CPAN Testers

[Nigel Horne]

On 12/06/2014 11:50, Karen Etheridge wrote:

On Thu, Jun 12, 2014 at 08:40:15AM -0400, Nigel Horne wrote:

I'm calling prelbrew with -Acc=cc on MacOS to ensure cc (aka gcc) is
used rather than clang.  I don't set any spaces, either Perlbrew is
doing it or part of the Perl build.  I'm not sure how to progress
from here.

Nigel, can you provide the full output from 'perl -V'?

Summary of my perl5 (revision 5 version 20 subversion 0) configuration:

  Platform:
osname=darwin, osvers=12.5.0, archname=darwin-thread-multi-2level
uname='darwin ncbimac2008.ncbi.nlm.nih.gov 12.5.0 darwin kernel 
version 12.5.0: sun sep 29 13:33:47 pdt 2013; 
root:xnu-2050.48.12~1release_x86_64 x86_64 '
config_args='-de 
-Dprefix=/Users/hornenj/perl5/perlbrew/perls/perl-5.20.0 -Duseithreads 
-Dusemultiplicity -Accflags=-O2 -W -Wformat=2 -Wswitch -Wshadow 
-Wwrite-strings -Wuninitialized -Wall -pipe -mtune=native -march=native 
-fomit-frame-pointer -msse2 -msse -mmmx -pedantic -D_FORTIFY_SOURCE=2 
-Wpointer-arith -Wstrict-prototypes -fstack-protector -Wstack-protector 
-Wextra -Wbad-function-cast -Wcast-align -Wcast-qual 
-Wdisabled-optimization -Wendif-labels -Wfloat-equal -Wformat-nonliteral 
-Winline -Wmissing-declarations -Wmissing-prototypes -Wnested-externs 
-Wpointer-arith -Wundef -Wformat-security -fassociative-math -Acc=cc 
-Aeval:scriptdir=/Users/hornenj/perl5/perlbrew/perls/perl-5.20.0/bin'

hint=recommended, useposix=true, d_sigaction=define
useithreads=define, usemultiplicity=define
use64bitint=define, use64bitall=define, uselongdouble=undef
usemymalloc=n, bincompat5005=undef
  Compiler:
cc=' cc', ccflags ='-fno-common -DPERL_DARWIN -O2 -W -Wformat=2 
-Wswitch -Wshadow -Wwrite-strings -Wuninitialized -Wall -pipe 
-mtune=native -march=native -fomit-frame-pointer -msse2 -msse -mmmx 
-pedantic -D_FORTIFY_SOURCE=2 -Wpointer-arith -Wstrict-prototypes 
-fstack-protector -Wstack-protector -Wextra -Wbad-function-cast 
-Wcast-align -Wcast-qual -Wdisabled-optimization -Wendif-labels 
-Wfloat-equal -Wformat-nonliteral -Winline -Wmissing-declarations 
-Wmissing-prototypes -Wnested-externs -Wpointer-arith -Wundef 
-Wformat-security -fassociative-math -fno-strict-aliasing 
-I/usr/local/include',

optimize='-O3',
cppflags='-fno-common -DPERL_DARWIN -O2 -W -Wformat=2 -Wswitch 
-Wshadow -Wwrite-strings -Wuninitialized -Wall -pipe -mtune=native 
-march=native -fomit-frame-pointer -msse2 -msse -mmmx -pedantic 
-D_FORTIFY_SOURCE=2 -Wpointer-arith -Wstrict-prototypes 
-fstack-protector -Wstack-protector -Wextra -Wbad-function-cast 
-Wcast-align -Wcast-qual -Wdisabled-optimization -Wendif-labels 
-Wfloat-equal -Wformat-nonliteral -Winline -Wmissing-declarations 
-Wmissing-prototypes -Wnested-externs -Wpointer-arith -Wundef 
-Wformat-security -fassociative-math -fno-strict-aliasing 
-I/usr/local/include'
ccversion='', gccversion='4.2.1 Compatible Apple LLVM 4.2 
(clang-425.0.24)', gccosandvers=''

intsize=4, longsize=8, ptrsize=8, doublesize=8, byteorder=12345678
d_longlong=define, longlongsize=8, d_longdbl=define, longdblsize=16
ivtype='long', ivsize=8, nvtype='double', nvsize=8, Off_t='off_t', 
lseeksize=8

alignbytes=8, prototype=define
  Linker and Libraries:
ld='env MACOSX_DEPLOYMENT_TARGET=10.3 cc', ldflags =' 
-fstack-protector -L/usr/local/lib'

libpth=/usr/local/lib /usr/bin/../lib/clang/4.2/lib /usr/lib
libs=-ldbm -ldl -lm -lutil -lc
perllibs=-ldl -lm -lutil -lc
libc=, so=dylib, useshrplib=false, libperl=libperl.a
gnulibc_version=''
  Dynamic Linking:
dlsrc=dl_dlopen.xs, dlext=bundle, d_dlsymun=undef, ccdlflags=' '
cccdlflags=' ', lddlflags=' -bundle -undefined dynamic_lookup 
-L/usr/local/lib -fstack-protector'



Characteristics of this binary (from libperl):
  Compile-time options: HAS_TIMES MULTIPLICITY PERLIO_LAYERS
PERL_DONT_CREATE_GVSV
PERL_HASH_FUNC_ONE_AT_A_TIME_HARD
PERL_IMPLICIT_CONTEXT PERL_MALLOC_WRAP
PERL_NEW_COPY_ON_WRITE PERL_PRESERVE_IVUV
USE_64_BIT_ALL USE_64_BIT_INT USE_ITHREADS
USE_LARGE_FILES USE_LOCALE USE_LOCALE_COLLATE
USE_LOCALE_CTYPE USE_LOCALE_NUMERIC USE_PERLIO
USE_PERL_ATOF USE_REENTRANT_API
  Built under darwin
  Compiled at May 28 2014 08:29:41
  %ENV:
PERL5LIB=
PERLBREW_BASHRC_VERSION=0.67
PERLBREW_HOME=/Users/hornenj/.perlbrew
PERLBREW_MANPATH=/Users/hornenj/perl5/perlbrew/perls/perl-5.20.0/man
PERLBREW_PATH=/Users/hornenj/perl5/perlbrew/bin:/Users/hornenj/perl5/perlbrew/perls/perl-5.20.0/bin
PERLBREW_PERL=perl-5.20.0
PERLBREW_ROOT=/Users/hornenj/perl5/perlbrew
PERLBREW_VERSION=0.69
  @INC:
/Users/hornenj/perl5/perlbrew/perls/perl-5.20.0/lib/site_perl/5.20.0/darwin-thread-multi-2level
/Users/hornenj/perl5/perlbrew/perls/perl-5.20.0/lib/site_perl/5.20.0

Re: CPAN Testers

[Reini Urban]

On 06/12/2014 07:42 AM, Alberto Simoes wrote:

On 12/06/14, 13:40, Nigel Horne wrote:

On 11/06/2014 16:52, Alberto Simoes wrote:

Dear Nigel, Dear CPAN Testers,

One of Nigel's machines reported on my module Math::GSL:
http://www.cpantesters.org/cpan/report/97446734-f1a2-11e3-af0f-6440bde15059

It seems that the problem is that CC is somehow configured as ' cc'.
Yes, with that space in the beginning.


Probably caused by $ccache $Config{cc}.


I'm calling prelbrew with -Acc=cc on MacOS to ensure cc (aka gcc) is
used rather than clang.  I don't set any spaces, either Perlbrew is
doing it or part of the Perl build.  I'm not sure how to progress from
here.


That is actually fragile and most likely wrong.
cc == gcc == clang in /usr/bin.

Only if your paths esp. point to a real local gcc you'll be fine.
My macports gcc is called gcc-mp-4.9

Try gcc --version to see if it's Apple crippled clang or your own gcc.


Thanks for your feedback. I noticed that some of your machines with
clang have the space as well. Anyway, the problem is more complicated,
as there are places where cc=ccache cc and that fails as well.

Therefore, trying to get p5p to discuss on what ExtUtils::CBuilder
should do.


As David Cantrell said. You need to split on whitespace when the cmd is 
executed with list args.




--
Reini

Re: CPAN Testers

[Reini Urban]

On 06/12/2014 10:54 AM, Nigel Horne wrote:

On 12/06/2014 11:50, Karen Etheridge wrote:

On Thu, Jun 12, 2014 at 08:40:15AM -0400, Nigel Horne wrote:

I'm calling prelbrew with -Acc=cc on MacOS to ensure cc (aka gcc) is
used rather than clang.  I don't set any spaces, either Perlbrew is
doing it or part of the Perl build.  I'm not sure how to progress
from here.

Nigel, can you provide the full output from 'perl -V'?

Summary of my perl5 (revision 5 version 20 subversion 0) configuration:

   Platform:
 osname=darwin, osvers=12.5.0, archname=darwin-thread-multi-2level
 uname='darwin ncbimac2008.ncbi.nlm.nih.gov 12.5.0 darwin kernel
version 12.5.0: sun sep 29 13:33:47 pdt 2013;
root:xnu-2050.48.12~1release_x86_64 x86_64 '
 config_args='-de
-Dprefix=/Users/hornenj/perl5/perlbrew/perls/perl-5.20.0 -Duseithreads
-Dusemultiplicity -Accflags=-O2 -W -Wformat=2 -Wswitch -Wshadow
-Wwrite-strings -Wuninitialized -Wall -pipe -mtune=native -march=native
-fomit-frame-pointer -msse2 -msse -mmmx -pedantic -D_FORTIFY_SOURCE=2
-Wpointer-arith -Wstrict-prototypes -fstack-protector -Wstack-protector
-Wextra -Wbad-function-cast -Wcast-align -Wcast-qual
-Wdisabled-optimization -Wendif-labels -Wfloat-equal -Wformat-nonliteral
-Winline -Wmissing-declarations -Wmissing-prototypes -Wnested-externs
-Wpointer-arith -Wundef -Wformat-security -fassociative-math -Acc=cc
-Aeval:scriptdir=/Users/hornenj/perl5/perlbrew/perls/perl-5.20.0/bin'
 hint=recommended, useposix=true, d_sigaction=define
 useithreads=define, usemultiplicity=define
 use64bitint=define, use64bitall=define, uselongdouble=undef
 usemymalloc=n, bincompat5005=undef
   Compiler:
 cc=' cc',


perlbrew bug. please report it there.

And your cc (aka gcc) is clang on apple. See my previous mail


 libc=, so=dylib, useshrplib=false, libperl=libperl.a
 gnulibc_version=''


What? static?


--
Reini

Re: CPAN Testers

[Reini Urban]

On 06/12/2014 02:57 PM, Karen Etheridge wrote:

On Thu, Jun 12, 2014 at 09:28:29AM -0500, Reini Urban wrote:

I'm calling prelbrew with -Acc=cc on MacOS to ensure cc (aka gcc) is
used rather than clang.  I don't set any spaces, either Perlbrew is
doing it or part of the Perl build.  I'm not sure how to progress from
here.


That is actually fragile and most likely wrong.
cc == gcc == clang in /usr/bin.


On one of my machines, at least (2009 MBP running OS 10.6.8), this is not so:

: [ether@tequila ]$; ls -l /usr/bin/{cc,gcc,clang,gcc-4.2}
lrwxr-xr-x  1 root  wheel 7 27 Dec  2011 /usr/bin/cc - gcc-4.2
-rwxrwxr-x  1 root  admin  44430720 15 Dec  2010 /usr/bin/clang
lrwxr-xr-x  1 root  wheel 7 27 Dec  2011 /usr/bin/gcc - gcc-4.2
-rwxr-xr-x  1 root  wheel166128 23 Oct  2010 /usr/bin/gcc-4.2


Only if your paths esp. point to a real local gcc you'll be fine.
My macports gcc is called gcc-mp-4.9

Try gcc --version to see if it's Apple crippled clang or your own gcc.


: [ether@tequila ]$; clang --version
Apple clang version 1.7 (tags/Apple/clang-77) (based on LLVM 2.9svn)
Target: x86_64-apple-darwin10
Thread model: posix

: [ether@tequila ]$; gcc --version
i686-apple-darwin10-gcc-4.2.1 (GCC) 4.2.1 (Apple Inc. build 5666) (dot 3)


However, on a newer MBP (running 10.8):

: [ether@bourbon ]$; ls -l /usr/bin/{cc,gcc,clang}
lrwxr-xr-x  1 root  wheel 5 22 Jul  2013 /usr/bin/cc - clang
-rwxr-xr-x  1 root  wheel  26311808 22 Jul  2013 /usr/bin/clang
lrwxr-xr-x  1 root  wheel12 22 Jul  2013 /usr/bin/gcc - llvm-gcc-4.2

: [ether@bourbon git/misc]$; gcc --version
i686-apple-darwin11-llvm-gcc-4.2 (GCC) 4.2.1 (Based on Apple Inc. build 5658) 
(LLVM build 2336.11.00)


Thanks.
They changed it around 10.7 or 10.8, with an XCode update.

And they didn't include the newer clang -fsanitize runtime, even if 
their --help lies about it, so you have to use your own clang.

Even on 10.9 with a new 3.4 clang.

Re: CPAN Testers

[Alberto Simoes]

On 12/06/14, 13:40, Nigel Horne wrote:

On 11/06/2014 16:52, Alberto Simoes wrote:

Dear Nigel, Dear CPAN Testers,

One of Nigel's machines reported on my module Math::GSL:
http://www.cpantesters.org/cpan/report/97446734-f1a2-11e3-af0f-6440bde15059


It seems that the problem is that CC is somehow configured as ' cc'.
Yes, with that space in the beginning.


I'm calling prelbrew with -Acc=cc on MacOS to ensure cc (aka gcc) is
used rather than clang.  I don't set any spaces, either Perlbrew is
doing it or part of the Perl build.  I'm not sure how to progress from
here.


Hello
Problem solved. It was a bug on my side (as usual).
This report already passes on the compilation step, even with that space.
http://www.cpantesters.org/cpan/report/9bc59ef8-f26b-11e3-ae90-7eaabde15059

Now the problem is other :)

Thanks for your quick answer and feedback
ambs

Re: CPAN Testers

[Nigel Horne]

On 11/06/2014 16:52, Alberto Simoes wrote:

Dear Nigel, Dear CPAN Testers,

One of Nigel's machines reported on my module Math::GSL:
http://www.cpantesters.org/cpan/report/97446734-f1a2-11e3-af0f-6440bde15059 



It seems that the problem is that CC is somehow configured as ' cc'. 
Yes, with that space in the beginning.


I am not sure how that space got there. But it is messing around with 
ExtUtils::CBuilder.


Noted - I'll see if I can see how it got in there and remove it


I am not sure if:
 - ExtUtils::CBuilder should be tweaked to strip spaces in the command 
name...
 - or if this should never happen, and that Perl needs to be fixed 
before continuing sending these reports...




-Nigel



smime.p7s
Description: S/MIME Cryptographic Signature

Re: CPAN Testers AUTOMATED_TESTING config

[Slaven Rezic]

Karen Etheridge p...@froods.org writes:

 Hi Slaven,

 recently I received a number of failing test reports from you, for
 Plack-App-BeanstalkConsole-0.004:

 http://www.cpantesters.org/cpan/report/27614552-c707-11e2-be51-ac14a65f1290
 http://www.cpantesters.org/cpan/report/bc294a00-c706-11e2-b547-d1b9f05bb613
 http://www.cpantesters.org/cpan/report/976876e6-c706-11e2-b45e-827567d01fb8
 http://www.cpantesters.org/cpan/report/089d0ca6-c706-11e2-b644-eee7e73c5bf2
 http://www.cpantesters.org/cpan/report/6dd3a9b2-c707-11e2-87dd-f08dfdc235a3

 However, there should be *no testing at all* done for this distribution,
 (save any reports that are sent manually via cpanm-reporter), because the
 first line of Makefile.PL is:

 exit 0 if $ENV{AUTOMATED_TESTING};

 This is because this distribution requires the presence of a php
 executable, and also the Makefile.PL downloads a large file from github --
 so to respect github's servers, I'd rather this happen only when the module
 is actually going to be used.

 Automated CPAN testing is supposed to set the AUTOMATED_TESTING variable:

 http://wiki.cpantesters.org/wiki/CPANAuthorNotes

 Can I tell if my module is being tested by an automated client (a.k.a. 
 'smoker')?

 Automated smoke testers should set $ENV{AUTOMATED_TESTING} to a true 
 value. This allows authors to skip certain tests (or include certain tests) 
 when the results are not being monitored by a human being.

 One could even go so far as to halt building and testing a distribution 
 under automated testing by exiting with zero at the top of the Makefile.PL or 
 Build.PL file:

 exit 0 if $ENV{AUTOMATED_TESTING};


 Please could you set AUTOMATED_TESTING in your smokers?  thank you!


Actually, my smoker does not fail under this sentence: ... are not
being monitored by a human being. I look into every FAIL report before
sending. Really.

But I can setup a special rule in 01.DISABLED.yml for your distribution.

Regards,
Slaven

-- 
Slaven Rezic - slaven at rezic dot de
  BBBike - route planner for cyclists in Berlin
  WWW version:   http://www.bbbike.de
  Perl/Tk version for Unix and Windows:  http://bbbike.sourceforge.net

Re: CPAN Testers AUTOMATED_TESTING config

[David Golden]

The Lancaster Consensus from this year's QA hackathon has updated the
desired semantics:
http://www.dagolden.com/index.php/2098/the-annotated-lancaster-consensus/

Specifically, AUTOMATED_TESTING is now intended to distinguish only
between things running for smoke testing versus things running as
part of module installation (or other, manually testing).  It no
longer means without recourse to a human operator as it did after
the Oslo Consensus.  That aspect is now covered by the new
NONINTERACTIVE_TESTING environment variable.

In your case -- automated testing with manual review of results --
both should be set, because when the tests run, it is both smoking and
non-interactive.  :-)

Your manual review is awesome -- I wish more smoke testers did that --
but it doesn't change the environment we want to present to
distributions, so they can decide to opt-in or out of some or all
tests depending on circumstances surrounding the test.

David




On Thu, Jun 13, 2013 at 5:19 PM, Slaven Rezic sla...@rezic.de wrote:
 Karen Etheridge p...@froods.org writes:

 Hi Slaven,

 recently I received a number of failing test reports from you, for
 Plack-App-BeanstalkConsole-0.004:

 http://www.cpantesters.org/cpan/report/27614552-c707-11e2-be51-ac14a65f1290
 http://www.cpantesters.org/cpan/report/bc294a00-c706-11e2-b547-d1b9f05bb613
 http://www.cpantesters.org/cpan/report/976876e6-c706-11e2-b45e-827567d01fb8
 http://www.cpantesters.org/cpan/report/089d0ca6-c706-11e2-b644-eee7e73c5bf2
 http://www.cpantesters.org/cpan/report/6dd3a9b2-c707-11e2-87dd-f08dfdc235a3

 However, there should be *no testing at all* done for this distribution,
 (save any reports that are sent manually via cpanm-reporter), because the
 first line of Makefile.PL is:

 exit 0 if $ENV{AUTOMATED_TESTING};

 This is because this distribution requires the presence of a php
 executable, and also the Makefile.PL downloads a large file from github --
 so to respect github's servers, I'd rather this happen only when the module
 is actually going to be used.

 Automated CPAN testing is supposed to set the AUTOMATED_TESTING variable:

 http://wiki.cpantesters.org/wiki/CPANAuthorNotes

 Can I tell if my module is being tested by an automated client (a.k.a. 
 'smoker')?

 Automated smoke testers should set $ENV{AUTOMATED_TESTING} to a true 
 value. This allows authors to skip certain tests (or include certain tests) 
 when the results are not being monitored by a human being.

 One could even go so far as to halt building and testing a distribution 
 under automated testing by exiting with zero at the top of the Makefile.PL 
 or Build.PL file:

 exit 0 if $ENV{AUTOMATED_TESTING};


 Please could you set AUTOMATED_TESTING in your smokers?  thank you!


 Actually, my smoker does not fail under this sentence: ... are not
 being monitored by a human being. I look into every FAIL report before
 sending. Really.

 But I can setup a special rule in 01.DISABLED.yml for your distribution.

 Regards,
 Slaven

 --
 Slaven Rezic - slaven at rezic dot de
   BBBike - route planner for cyclists in Berlin
   WWW version:   http://www.bbbike.de
   Perl/Tk version for Unix and Windows:  http://bbbike.sourceforge.net



--
David Golden x...@xdg.me
Take back your inbox! → http://www.bunchmail.com/
Twitter/IRC: @xdg

Re: CPAN Testers Matrix with fresh data

[Michiel Beijen]

Hi David,

On Mon, Nov 5, 2012 at 3:19 PM, David Golden x...@xdg.me wrote:
 No one
 has every said that is missing reports (which is interesting since
 it's also derived from a SimpleDB query), so people are looking to use
 it to capture basic pass/fail data even without the underlying report.

I'm sorry, what do you mean by this sentence?

By the way, I'd like to point out that for the month of November no
reports at all show up on cpantesters:
http://stats.cpantesters.org/leaders/leaders-mswin32-all.html

--
Mike

Re: CPAN Testers Matrix with fresh data

[David Golden]

On Tue, Nov 6, 2012 at 3:21 AM, Michiel Beijen michiel.bei...@gmail.com wrote:
 I'm sorry, what do you mean by this sentence?

The tail log is here for reference: http://metabase.cpantesters.org/tail/log.txt

It provides a one-line summary of results, but you can't access the
actual *text* of the report to see what happened.  It can be scraped
to get PASS/FAIL ratios by platform and perl version, but that's all.

-- 
David Golden x...@xdg.me
Take back your inbox! → http://www.bunchmail.com/
Twitter/IRC: @xdg

Re: CPAN Testers Matrix with fresh data

[Buddy Burden]

Slaven,

 Luckily, the information found on
 http://metabase.cpantesters.org/tail/log.txt is enough to build a
 basic matrix view. So with the help of Andreas Koenig who is
 collecting log.txt output since some weeks, we have now an alternative
 CPAN Testers Matrix view. Try out:

 http://217.199.168.174/cgi-bin/cpantestersmatrix.pl

Apologize if I missed the answer earlier, but I just joined the list
(just discovered the list, actually).  What does it mean if I can see
reports here, but not on the main CPAN Testers site?  (I had raised an
RT ticket on this issue, but perhaps I shouldn't have ...)


-- Buddy

Re: CPAN Testers Matrix with fresh data

[David Golden]

On Mon, Nov 5, 2012 at 3:29 AM, Buddy Burden barefootco...@gmail.com wrote:
 Apologize if I missed the answer earlier, but I just joined the list
 (just discovered the list, actually).  What does it mean if I can see
 reports here, but not on the main CPAN Testers site?  (I had raised an
 RT ticket on this issue, but perhaps I shouldn't have ...)

Report are submitted to the Metabase, which stores all the reports.

Reports are then extracted and transformed on the main CPAN Testers site.

We have had ongoing problems of reports submitted to the Metabase not
getting picked up by CPAN Testers.  We believe this is due to Amazon
SimpleDB (which Metabase uses to index submitted reports) being
completely shitty.

Periodically, Barbie and I (mostly Barbie) figure out what reports are
missing and sync them up.  We have for a long while, had loose plans
to migrate off Amazon, but this has stalled due to an amazing lack of
tuits and to a lesser extent a lack of resources.

Mostly, people are patient, but sometimes people want to see that
their reports are submitted *RIGHT AWAY*, so we have the tail log
that just shows recent submissions and the pass/fail status.  No one
has every said that is missing reports (which is interesting since
it's also derived from a SimpleDB query), so people are looking to use
it to capture basic pass/fail data even without the underlying report.

David


-- 
David Golden x...@xdg.me
Take back your inbox! → http://www.bunchmail.com/
Twitter/IRC: @xdg

Re: CPAN Testers Daily Summary Report

[David Golden]

It think you just say Alien::SVN as your prereq because SVN::Core is
actually provided by the Subversion source.  Packagers should
recognize that Alien::* means external libraries and they'll figure it
out.  (Or probably have it automated.)

-- David

On Wed, Jun 6, 2012 at 10:10 AM, Dean Hamstead d...@fragfest.com.au wrote:
 I have tried combinations of SVN::Core(etc), Alien::SVN and SVN::Core(etc) +
 Alien::SVN

 It looks like SVN::Core(etc) isnt being detected as being provided by
 Alien::SVN, and some platforms dont seem to implement Alien::SVN?

 SVN::Core+Alien::SVN seems to work the best, but im curious what impact that
 would have for packagers etc. Also i have the understanding that the Alien::
 packages are supposed to provide placeholder type of things for out of cpan
 dependencies?




 Dean


 On Wed, 30 May 2012 10:34:29 -0400, David Golden wrote:

 I see the deps properly specified in a distribution built from a
 github clone, but that doesn't seem to be the same as what's on CPAN.

 -- David

 On Tue, May 29, 2012 at 5:45 AM, Dean Hamstead d...@fragfest.com.au
 wrote:

 Im hoping some charitable soul can help me out here.

 For some reason i cant seem to get SVN::Core SVN::Client and SVN::Ra to
 be
 recognized properly.
 I have tried listing them as deps and have also now tried listing
 Alien::SVN
 as a dep.

 Feel free to fork and show me what im missing
 (https://github.com/djzort/SVN-Web)


 Dean


 On Tue, 29 May 2012 02:15:14 +, CPAN Tester Report Server wrote:


 Dear Dean Hamstead,

 Please find below the latest reports for your distributions,
 generated by CPAN Testers, from the last 24 hours.

 To set your preferences for what you wish to have reported in this
 Daily Summary, please visit the CPAN Testers Preferences system at
 https://prefs.cpantesters.org.


 SVN-Web-0.60_3:
 - amd64-freebsd / 5.12.2:
  - FAIL




 http://www.cpantesters.org/cpan/report/63bb5004-a888-11e1-9d6f-f6dbfa7543f5

 - amd64-freebsd-thread-multi / 5.12.2:
  - FAIL




 http://www.cpantesters.org/cpan/report/62688864-a89e-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux / 5.12.3:
  - FAIL




 http://www.cpantesters.org/cpan/report/6454b4f0-a8fc-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux / 5.12.4:
  - FAIL




 http://www.cpantesters.org/cpan/report/62eb8460-a8aa-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux-ld / 5.12.4:
  - FAIL




 http://www.cpantesters.org/cpan/report/29081cb4-a8bd-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux-thread-multi / 5.12.4:
  - FAIL




 http://www.cpantesters.org/cpan/report/80a954a4-a8d3-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux-thread-multi / 5.14.0:
  - FAIL




 http://www.cpantesters.org/cpan/report/0a6c124a-a883-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux-thread-multi-ld / 5.14.0:
  - FAIL




 http://www.cpantesters.org/cpan/report/b91747f6-a897-11e1-9d6f-f6dbfa7543f5



 If you have an issue with a particular report, or wish to gain
 further information from the tester, please use the 'Find A Tester'
 tool at http://stats.cpantesters.org/cpanmail.html, using the ID or
 GUID of the report, as listed above, to locate the correct email
 address.

 If you wish to unsubscribe from these notifications, please login to
 the CPAN Testers Preferences system, with your PAUSE credentials, and
 disable CPAN Testers notifications permanently or temporarily. If you
 have problems with accessing the site, please contact Barbie
 bar...@cpan.org and request to be removed from the automatic
 mailings.

 Thanks,
 The CPAN Testers



 --
 Come play computer games with us at http://fragfest.com.au


 --
 Come play computer games with us at http://fragfest.com.au

Re: CPAN Testers Daily Summary Report

[David Golden]

I see the deps properly specified in a distribution built from a
github clone, but that doesn't seem to be the same as what's on CPAN.

-- David

On Tue, May 29, 2012 at 5:45 AM, Dean Hamstead d...@fragfest.com.au wrote:
 Im hoping some charitable soul can help me out here.

 For some reason i cant seem to get SVN::Core SVN::Client and SVN::Ra to be
 recognized properly.
 I have tried listing them as deps and have also now tried listing Alien::SVN
 as a dep.

 Feel free to fork and show me what im missing
 (https://github.com/djzort/SVN-Web)


 Dean


 On Tue, 29 May 2012 02:15:14 +, CPAN Tester Report Server wrote:

 Dear Dean Hamstead,

 Please find below the latest reports for your distributions,
 generated by CPAN Testers, from the last 24 hours.

 To set your preferences for what you wish to have reported in this
 Daily Summary, please visit the CPAN Testers Preferences system at
 https://prefs.cpantesters.org.


 SVN-Web-0.60_3:
 - amd64-freebsd / 5.12.2:
  - FAIL


 http://www.cpantesters.org/cpan/report/63bb5004-a888-11e1-9d6f-f6dbfa7543f5

 - amd64-freebsd-thread-multi / 5.12.2:
  - FAIL


 http://www.cpantesters.org/cpan/report/62688864-a89e-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux / 5.12.3:
  - FAIL


 http://www.cpantesters.org/cpan/report/6454b4f0-a8fc-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux / 5.12.4:
  - FAIL


 http://www.cpantesters.org/cpan/report/62eb8460-a8aa-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux-ld / 5.12.4:
  - FAIL


 http://www.cpantesters.org/cpan/report/29081cb4-a8bd-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux-thread-multi / 5.12.4:
  - FAIL


 http://www.cpantesters.org/cpan/report/80a954a4-a8d3-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux-thread-multi / 5.14.0:
  - FAIL


 http://www.cpantesters.org/cpan/report/0a6c124a-a883-11e1-9d6f-f6dbfa7543f5

 - x86_64-linux-thread-multi-ld / 5.14.0:
  - FAIL


 http://www.cpantesters.org/cpan/report/b91747f6-a897-11e1-9d6f-f6dbfa7543f5



 If you have an issue with a particular report, or wish to gain
 further information from the tester, please use the 'Find A Tester'
 tool at http://stats.cpantesters.org/cpanmail.html, using the ID or
 GUID of the report, as listed above, to locate the correct email
 address.

 If you wish to unsubscribe from these notifications, please login to
 the CPAN Testers Preferences system, with your PAUSE credentials, and
 disable CPAN Testers notifications permanently or temporarily. If you
 have problems with accessing the site, please contact Barbie
 bar...@cpan.org and request to be removed from the automatic
 mailings.

 Thanks,
 The CPAN Testers


 --
 Come play computer games with us at http://fragfest.com.au

Re: CPAN Testers Daily Summary Report

[Dean Hamstead]

yes my bad, i have pushed changes to git (using cvs 9-5, i forget to 
push)


previously i listed out SVN::Ra SVN::Client SVN::Core and got this 
result

http://www.cpantesters.org/cpan/report/a81acbac-a73f-11e1-9d6f-f6dbfa7543f5

I then looked on cpan to see what was going on with these three 
modules, and saw that they were in Alien::SVN,
so swapped out the definition to just Alien::SVN. Which gave the 
results below. The dist.ini for this is now

pushed to github.

Thanks for taking the time to look


Dean

On Wed, 30 May 2012 10:34:29 -0400, David Golden wrote:

I see the deps properly specified in a distribution built from a
github clone, but that doesn't seem to be the same as what's on CPAN.

-- David

On Tue, May 29, 2012 at 5:45 AM, Dean Hamstead d...@fragfest.com.au 
wrote:

Im hoping some charitable soul can help me out here.

For some reason i cant seem to get SVN::Core SVN::Client and SVN::Ra 
to be

recognized properly.
I have tried listing them as deps and have also now tried listing 
Alien::SVN

as a dep.

Feel free to fork and show me what im missing
(https://github.com/djzort/SVN-Web)


Dean


On Tue, 29 May 2012 02:15:14 +, CPAN Tester Report Server wrote:


Dear Dean Hamstead,

Please find below the latest reports for your distributions,
generated by CPAN Testers, from the last 24 hours.

To set your preferences for what you wish to have reported in this
Daily Summary, please visit the CPAN Testers Preferences system at
https://prefs.cpantesters.org.


SVN-Web-0.60_3:
- amd64-freebsd / 5.12.2:
 - FAIL



http://www.cpantesters.org/cpan/report/63bb5004-a888-11e1-9d6f-f6dbfa7543f5

- amd64-freebsd-thread-multi / 5.12.2:
 - FAIL



http://www.cpantesters.org/cpan/report/62688864-a89e-11e1-9d6f-f6dbfa7543f5

- x86_64-linux / 5.12.3:
 - FAIL



http://www.cpantesters.org/cpan/report/6454b4f0-a8fc-11e1-9d6f-f6dbfa7543f5

- x86_64-linux / 5.12.4:
 - FAIL



http://www.cpantesters.org/cpan/report/62eb8460-a8aa-11e1-9d6f-f6dbfa7543f5

- x86_64-linux-ld / 5.12.4:
 - FAIL



http://www.cpantesters.org/cpan/report/29081cb4-a8bd-11e1-9d6f-f6dbfa7543f5

- x86_64-linux-thread-multi / 5.12.4:
 - FAIL



http://www.cpantesters.org/cpan/report/80a954a4-a8d3-11e1-9d6f-f6dbfa7543f5

- x86_64-linux-thread-multi / 5.14.0:
 - FAIL



http://www.cpantesters.org/cpan/report/0a6c124a-a883-11e1-9d6f-f6dbfa7543f5

- x86_64-linux-thread-multi-ld / 5.14.0:
 - FAIL



http://www.cpantesters.org/cpan/report/b91747f6-a897-11e1-9d6f-f6dbfa7543f5



If you have an issue with a particular report, or wish to gain
further information from the tester, please use the 'Find A Tester'
tool at http://stats.cpantesters.org/cpanmail.html, using the ID or
GUID of the report, as listed above, to locate the correct email
address.

If you wish to unsubscribe from these notifications, please login 
to
the CPAN Testers Preferences system, with your PAUSE credentials, 
and
disable CPAN Testers notifications permanently or temporarily. If 
you

have problems with accessing the site, please contact Barbie
bar...@cpan.org and request to be removed from the automatic
mailings.

Thanks,
The CPAN Testers



--
Come play computer games with us at http://fragfest.com.au


--
Come play computer games with us at http://fragfest.com.au

Re: CPAN Testers Daily Summary Report

[Dean Hamstead]

Im hoping some charitable soul can help me out here.

For some reason i cant seem to get SVN::Core SVN::Client and SVN::Ra to 
be recognized properly.
I have tried listing them as deps and have also now tried listing 
Alien::SVN as a dep.


Feel free to fork and show me what im missing 
(https://github.com/djzort/SVN-Web)



Dean


On Tue, 29 May 2012 02:15:14 +, CPAN Tester Report Server wrote:

Dear Dean Hamstead,

Please find below the latest reports for your distributions,
generated by CPAN Testers, from the last 24 hours.

To set your preferences for what you wish to have reported in this
Daily Summary, please visit the CPAN Testers Preferences system at
https://prefs.cpantesters.org.


SVN-Web-0.60_3:
- amd64-freebsd / 5.12.2:
  - FAIL

http://www.cpantesters.org/cpan/report/63bb5004-a888-11e1-9d6f-f6dbfa7543f5

- amd64-freebsd-thread-multi / 5.12.2:
  - FAIL

http://www.cpantesters.org/cpan/report/62688864-a89e-11e1-9d6f-f6dbfa7543f5

- x86_64-linux / 5.12.3:
  - FAIL

http://www.cpantesters.org/cpan/report/6454b4f0-a8fc-11e1-9d6f-f6dbfa7543f5

- x86_64-linux / 5.12.4:
  - FAIL

http://www.cpantesters.org/cpan/report/62eb8460-a8aa-11e1-9d6f-f6dbfa7543f5

- x86_64-linux-ld / 5.12.4:
  - FAIL

http://www.cpantesters.org/cpan/report/29081cb4-a8bd-11e1-9d6f-f6dbfa7543f5

- x86_64-linux-thread-multi / 5.12.4:
  - FAIL

http://www.cpantesters.org/cpan/report/80a954a4-a8d3-11e1-9d6f-f6dbfa7543f5

- x86_64-linux-thread-multi / 5.14.0:
  - FAIL

http://www.cpantesters.org/cpan/report/0a6c124a-a883-11e1-9d6f-f6dbfa7543f5

- x86_64-linux-thread-multi-ld / 5.14.0:
  - FAIL

http://www.cpantesters.org/cpan/report/b91747f6-a897-11e1-9d6f-f6dbfa7543f5



If you have an issue with a particular report, or wish to gain
further information from the tester, please use the 'Find A Tester'
tool at http://stats.cpantesters.org/cpanmail.html, using the ID or
GUID of the report, as listed above, to locate the correct email
address.

If you wish to unsubscribe from these notifications, please login to
the CPAN Testers Preferences system, with your PAUSE credentials, and
disable CPAN Testers notifications permanently or temporarily. If you
have problems with accessing the site, please contact Barbie
bar...@cpan.org and request to be removed from the automatic
mailings.

Thanks,
The CPAN Testers


--
Come play computer games with us at http://fragfest.com.au

Re: CPAN-testers database knackered?

[Aristotle Pagaltzis]

* David Golden xda...@gmail.com [2012-03-12 20:20]:
 MongoDB is the leading candidate to replace Amazon's SimpleDB

I hope that works out if you try it. You have heard the stories?
http://pastebin.com/raw.php?i=FD3xe6Jt
http://blog.schmichael.com/2011/11/05/failing-with-mongodb/

Have you evaluated Kyoto Cabinet? http://fallabs.com/kyotocabinet/
(Perl bindings POD at http://fallabs.com/kyotocabinet/perldoc/.)

Re: CPAN-testers database knackered?

[David Golden]

On Tue, Mar 13, 2012 at 10:58 AM, Aristotle Pagaltzis pagalt...@gmx.de wrote:
 * David Golden xda...@gmail.com [2012-03-12 20:20]:
 MongoDB is the leading candidate to replace Amazon's SimpleDB

 I hope that works out if you try it. You have heard the stories?
 http://pastebin.com/raw.php?i=FD3xe6Jt
 http://blog.schmichael.com/2011/11/05/failing-with-mongodb/

Yes, I've heard the stories.  Fortunately 10gen is here in NYC and
I've been very impressed with their people and had some candid
conversations about the stories as well.  I've asked hard questions
about some of the stories and talked to CTO's for a half dozen
companies that use it about their positive/negative experiences.  I
haven't seen any real roadblocks.  Like most things, if you know what
you're doing and aren't stupid (e.g. trying to shard when you're
already at 100% resource utilization, choosing the wrong shard key),
it works pretty well.

In my own testing vs sqlite and postgres, MongoDB scaled writes
(single process) much better. In a sharded configuration, it should be
lovely.

 Have you evaluated Kyoto Cabinet? http://fallabs.com/kyotocabinet/

It's not really sufficient because it's only key/value store (as I
understand it).  MongoDB gives a query interface that isn't SQL, but
still is multi-dimensional. Plus it allows multiple indexes, which is
really useful for us since people want queries on time (for recent
reports) and queries on distname/version and we can make both cheap.

The CT usage pattern is write-heavy, with reads mostly against the
most recent reports.  That's really good for keeping the relevant
index/data pages in memory, which is ideal with MongoDB.

-- David

Re: CPAN-testers database knackered?

[David Golden]

On Tue, Mar 13, 2012 at 7:19 AM, David Cantrell da...@cantrell.org.uk wrote:
 In terms of what the API (or the MongoDB thing) looks like, to cut down
 on the traffic, CPANdeps can live with just summaries of
 dist/distversion/perlversion/os/state, and doesn't need the report
 bodies.  Report bodies should probably be available as a separate
 object.

That's exactly the way Metabase is designed.  index data lives in
one DB and bodies live in another.  Currently, that's S3 for bodies
and SimpleDB for index data.  Step 1 is moving from SimpleDB to
MongoDB.  Maybe we'll eventually also migrate away from S3, but that's
not as big a priority since it's pretty static and cheap.  Queries on
SimpleDB have been driving up cost to the point where it's insane to
stay on it much longer.

So setting up slave MongoDB instances would replicate the index data,
which is pretty much what you want.  (Probably more than you  need,
but it might be easier/faster than getting the smaller data set.)

-- David

Re: CPAN-testers database knackered?

[Aristotle Pagaltzis]

* David Golden xda...@gmail.com [2012-03-13 18:00]:
 I've asked hard questions about some of the stories and talked to
 CTO's for a half dozen companies that use it about their
 positive/negative experiences. I haven't seen any real roadblocks.

OK.

  Have you evaluated Kyoto Cabinet? http://fallabs.com/kyotocabinet/

 It's not really sufficient because it's only key/value store (as
 I understand it).

Yes. Isn’t that just what you get from SimpleDB, though? That would be
why I thought KC an option.

Regards,
-- 
Aristotle Pagaltzis // http://plasmasturm.org/

Re: CPAN-testers database knackered?

[David Golden]

On Tue, Mar 13, 2012 at 1:59 PM, Aristotle Pagaltzis pagalt...@gmx.de wrote:
 Yes. Isn’t that just what you get from SimpleDB, though? That would be
 why I thought KC an option.

SimpleDB offer complex queries.  And you pay for all the IO and CPU
they use, too, which is why it's getting expensive when cranking
through our report volume.  Slowing down how often Barbie's server
queries metabase for updates cut the monthly bills by hundreds of
dollars a month.

FWIW, I'm convinced this is part of Amazon's business model.  It all
seems so cheap and easy, but once you put any real volume into it, the
nickels and dimes for usage start adding up.  Another example: ever
notice how often Amazon recommends making EBS snapshots in their
literature?  Every idle EBS volume gets charged at their usual
price/gig.  Back up daily and don't have a really good purge system in
place and your storage costs go up 100x or more very quickly!

-- David

Re: CPAN-testers database knackered?

[Pedro Melo]

Hi,

On Sun, Mar 11, 2012 at 9:26 AM, Barbie bar...@missbarbell.co.uk wrote:
 This is why I want to look at an alternative method of getting at the
 data. I'm going to look at creating an API that returns the records in
 CSV or JSON format for a given range of IDs. This will allow you to
 maintain your own DB as you wish, rather than have to continually
 download several Gig repeatedly.

hmms... Maybe a git repo? It has the advantage that syncing since the
last time would be fast, and the pack files are compressed. OTOH,
unless we have per-dist repos it will get very big.

Bye,
-- 
Pedro Melo
@pedromelo
http://www.simplicidade.org/
http://about.me/melo
xmpp:m...@simplicidade.org
mailto:m...@simplicidade.org

Re: CPAN-testers database knackered?

[David Golden]

On Mon, Mar 12, 2012 at 2:49 AM, Pedro Melo m...@simplicidade.org wrote:
 hmms... Maybe a git repo? It has the advantage that syncing since the
 last time would be fast, and the pack files are compressed. OTOH,
 unless we have per-dist repos it will get very big.

I suggest Barbie and I (and others) talk this out in Paris at the end
of the month.

MongoDB is the leading candidate to replace Amazon's SimpleDB as the
indexed part of Metabase storage and one (crazy?) option is to set up
people who need it (cpandeps, analysis) with replicated slaves
(without allowing external read-access -- essentially backup slaves).
Then it would pretty much stay up to date automatically and be fast to
query locally.

Another option is to finally get the web query API opened up to the
public so people could pull their own datasets from Metabase on a
regular basis.

But as I said, I'd rather we hammer this out in person rather than do
something hasty and have yet another patchwork solution.

-- David

Re: CPAN-testers database knackered?

[Barbie]

On Sat, Mar 10, 2012 at 10:02:11PM +, David Cantrell wrote:
 Using DBI::Shell, executing this query against the database at
 http://devel.cpantesters.org/cpanstats.db.gz ...
 
  SELECT id, state, tester, dist, version, platform, perl, osname
FROM cpanstats
   WHERE id  20618074 AND
 state IN ('pass', 'fail', 'na', 'unknown') AND
 perl != '0' 
 
 gives ...
 
 id,state,tester,dist,version,platform,perl,osname
 20618075,'pass','r...@klanker.bingosnet.co.uk ((Charlie
 ))','Net-Inspect','0.09','x86_64-linux','5.15.7','linux'
 DBD::SQLite::st fetchrow_arrayref failed: database disk image is
 malformed, FIN line 5.
 
 And it's not just because my download of the database aborted half way,
 or my filesystem filling up, or it not being able to cope with big
 files.
 
 This has been happening for a couple of days now - anyone know what's
 going on?  Barbie?

Andreas has already alerted me to this, but even recreating the SQLite
DB from scratch has the same problem. The only thing I can think of is
that the DB is so big now that SQLite has problems storing the data. 

This is why I want to look at an alternative method of getting at the
data. I'm going to look at creating an API that returns the records in
CSV or JSON format for a given range of IDs. This will allow you to
maintain your own DB as you wish, rather than have to continually
download several Gig repeatedly.

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org
Ark Appreciation Pages http://ark.eology.org

Re: CPAN-testers database knackered?

[David Cantrell]

On Sun, Mar 11, 2012 at 09:26:44AM +, Barbie wrote:

 Andreas has already alerted me to this, but even recreating the SQLite
 DB from scratch has the same problem. The only thing I can think of is
 that the DB is so big now that SQLite has problems storing the data. 
 
 This is why I want to look at an alternative method of getting at the
 data. I'm going to look at creating an API that returns the records in
 CSV or JSON format for a given range of IDs. This will allow you to
 maintain your own DB as you wish, rather than have to continually
 download several Gig repeatedly.

That would be great - it's the way I use the existing SQLite database
anyway.

As a temporary measure though, would it be possible to generate a
database for the first ten million reports, one for the second ten
million, one for the third ten million and so on?

-- 
David Cantrell | Official London Perl Mongers Bad Influence

  Longum iter est per praecepta, breve et efficax per exempla.

Re: CPAN-testers database knackered?

[Andreas J. Koenig]

 On Sat, 10 Mar 2012 22:02:11 +, David Cantrell 
 da...@cantrell.org.uk said:

   Using DBI::Shell, executing this query against the database at
   http://devel.cpantesters.org/cpanstats.db.gz ...

SELECT id, state, tester, dist, version, platform, perl, osname
  FROM cpanstats
 WHERE id  20618074 AND
   state IN ('pass', 'fail', 'na', 'unknown') AND
   perl != '0' 

   gives ...

   id,state,tester,dist,version,platform,perl,osname
   20618075,'pass','r...@klanker.bingosnet.co.uk ((Charlie
   ))','Net-Inspect','0.09','x86_64-linux','5.15.7','linux'
   DBD::SQLite::st fetchrow_arrayref failed: database disk image is
   malformed, FIN line 5.

   And it's not just because my download of the database aborted half way,
   or my filesystem filling up, or it not being able to cope with big
   files.

   This has been happening for a couple of days now - anyone know what's
   going on?  Barbie?

Confirmed. The sqlite download is broken for me since November and got
even more broken a few days ago. The brokenness was always only
partially and allowed a lot of queries while others were failing.

-- 
andreas

Re: CPAN Testers Emails

[Jonas B. Nielsen]

I received one. Thank you.

jonasbn

Sent from my iPhone

On 23/10/2011, at 19.26, Barbie bar...@missbarbell.co.uk wrote:

 Hi,
 
 Emails should have been sent out for the daily summaries this morning.
 Although the server appears to have sent them, I'm not sure whether they
 actually arrived at their intended destinations. Can anyone confirm
 whether they received an email?
 
 Cheers,
 Barbie.
 -- 
 Birmingham Perl Mongers http://birmingham.pm.org
 Memoirs Of A Roadie http://barbie.missbarbell.co.uk
 CPAN Testers Blog http://blog.cpantesters.org
 YAPC Conference Surveys http://yapc-surveys.org
 Ark Appreciation Pages http://ark.eology.org
 

Re: CPAN Testers Emails

[Kaoru]

I got one, thanks! :-)

- Alex

On Sun, Oct 23, 2011 at 6:26 PM, Barbie bar...@missbarbell.co.uk wrote:
 Hi,

 Emails should have been sent out for the daily summaries this morning.
 Although the server appears to have sent them, I'm not sure whether they
 actually arrived at their intended destinations. Can anyone confirm
 whether they received an email?

 Cheers,
 Barbie.
 --
 Birmingham Perl Mongers http://birmingham.pm.org
 Memoirs Of A Roadie http://barbie.missbarbell.co.uk
 CPAN Testers Blog http://blog.cpantesters.org
 YAPC Conference Surveys http://yapc-surveys.org
 Ark Appreciation Pages http://ark.eology.org

Re: CPAN Testers Emails

[Christian Walde]

On Sun, 23 Oct 2011 19:26:19 +0200, Barbie bar...@missbarbell.co.uk wrote:


Emails should have been sent out for the daily summaries this morning.
Although the server appears to have sent them, I'm not sure whether they
actually arrived at their intended destinations. Can anyone confirm
whether they received an email?


Mine arrived. Thanks for your work. :)

--
With regards,
Christian Walde

Re: CPAN Testers Emails

[Barbie]

Thanks for confirming guys. Hopefully the weekly, monthly and reports
should start flowing from tonight too.

I aim to look at the Preferences site this week, so you can update your
settings again. I need to reset all the SSL certificates and get Apache
accepting HTTPS requests, so hopefully it shouldn't too long to sort
out.

For those who noticed some of the distribution pages being out of sync,
I've fixed the bug and all appears to be updating correctly now.

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org
Ark Appreciation Pages http://ark.eology.org

Re: CPAN Testers Server Issues

[Barbie]

Update:

The host company has confirmed that ...

a) our disk has a fault
b) we don't have a second RAID disk (even though we're paying for it!)

As such to replace the disk it requires complete data loss!

As you might anticipate this is not making me happy today. I had already
started making plans to migrate to a new server, but to do this
gradually over the next month. However, it looks like this will need to
be sped up.

As things stands the CT server is effectively out of action. I have read
access, but will need to wait until the new server is ready before I can
copy over everything as it currently stands. Although I have several
backups of data, I would rather avoid rebuilding the complete set of
data files.

I will keep you updated with further updates as and when I know more or
when there is further progress.

Barbie.

Re: CPAN Testers Server Issues

[David Golden]

On Wed, Aug 31, 2011 at 7:28 AM, Barbie bar...@missbarbell.co.uk wrote:
 As things stands the CT server is effectively out of action. I have read
 access, but will need to wait until the new server is ready before I can
 copy over everything as it currently stands. Although I have several
 backups of data, I would rather avoid rebuilding the complete set of
 data files.

To clarify for our testers, Barbie is talking about the
www.cpantesters.org server, which presents reports for viewing (and
tracks stats, provides feeds and emails, etc.)

The CPAN Testers Metabase server (which *collects* reports) is still
working as usual and collecting reports, so submissions will not be
lost, but with the main server wedged, there will be a delay before
they are visible to the community.

-- David

Re: CPAN Testers Server Issues

[Barbie]

On Wed, Aug 31, 2011 at 07:42:54AM -0400, David Golden wrote:
 On Wed, Aug 31, 2011 at 7:28 AM, Barbie bar...@missbarbell.co.uk wrote:
  As things stands the CT server is effectively out of action. I have read
  access, but will need to wait until the new server is ready before I can
  copy over everything as it currently stands. Although I have several
  backups of data, I would rather avoid rebuilding the complete set of
  data files.
 
 To clarify for our testers, Barbie is talking about the
 www.cpantesters.org server, which presents reports for viewing (and
 tracks stats, provides feeds and emails, etc.)
 
 The CPAN Testers Metabase server (which *collects* reports) is still
 working as usual and collecting reports, so submissions will not be
 lost, but with the main server wedged, there will be a delay before
 they are visible to the community.

Yep as David says :) Sorry for any confusion there. All report
submissions will still be stored. It is just going to take some time to
build the new server and copy the current data across, and start the
feed from the metabase from where we left off.

I have database backups and I'm currently looking at storing all the web
files, to save rebuilding them from scratch.

Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org
Ark Appreciation Pages http://ark.eology.org

Re: CPAN Testers Server Issues

[Nigel Horne]

Good luck fixing it!

-Nigel

Re: CPAN Testers Server Issues

[Barbie]

Update 2:

Machine is now failing to respond completely, and the last top I saw had
a Debian system process locking out everything :(

Despite reboots the server is now dead. I do have backups from last
week, so I can rebuild, but it will take some time. 

Thanks to all who have offered hosting and disks, but we already have a
plan for a new high capacity server in the works. Just wasn't expecting
to implement it a couple of weeks early.

I'm not sure how quickly the new machine or old machine with new disk
will be up and running, but I'll keep everyone posted.

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org
Ark Appreciation Pages http://ark.eology.org

Re: CPAN Testers Daily Summary Report

[David Golden]

My guess is that your code has use diagnostics and the smoker's
machine does not have the usual system documentation installed.
diagnostics.pm actually uses perldiag (Pod) to supply its mesages.

-- David

On Sat, Jul 23, 2011 at 7:29 PM, Philip Prindeville phil...@cpan.org wrote:
 Sorry, I'm looking at this link and not getting it.

 Is the machine in a bogus state that ran this test?


  Original Message 
 Subject:        CPAN Testers Daily Summary Report
 Date:   Sat, 23 Jul 2011 05:26:27 +
 From:   CPAN Tester Report Server do_not_re...@cpantesters.org
 To:     Philip Prindeville phil...@cpan.org



 Dear Philip Prindeville,

 Please find below the latest reports for your distributions, generated by 
 CPAN Testers, from the last 24 hours.

 To set your preferences for what you wish to have reported in this Daily 
 Summary, please visit the CPAN Testers Preferences system at 
 https://prefs.cpantesters.org.


 Net-Patricia-1.19:
 - i686-linux / 5.14.1:
  - FAIL 
 http://www.cpantesters.org/cpan/report/30853506-b35b-11e0-ae72-d004d8ab0ee8



 If you have an issue with a particular report, or wish to gain further 
 information from the tester, please use the 'Find A Tester' tool at 
 http://stats.cpantesters.org/cpanmail.html, using the ID or GUID of the 
 report, as listed above, to locate the correct email address.

 If you wish to unsubscribe from these notifications, please login to the CPAN 
 Testers Preferences system, with your PAUSE credentials, and disable CPAN 
 Testers notifications permanently or temporarily. If you have problems with 
 accessing the site, please contact Barbie bar...@cpan.org and request to be 
 removed from the automatic mailings.

 Thanks,
 The CPAN Testers
 --
 Reports:     http://www.cpantesters.org
 Statistics:  http://stats.cpantesters.org
 Wiki:        http://wiki.cpantesters.org
 Preferences: https://prefs.cpantesters.org

Re: CPAN Testers Daily Summary Report

[Philip Prindeville]

Ok, thanks. So I shouldn't be worried?

On 7/24/11 3:51 AM, David Golden wrote:
 My guess is that your code has use diagnostics and the smoker's
 machine does not have the usual system documentation installed.
 diagnostics.pm actually uses perldiag (Pod) to supply its mesages.

 -- David

 On Sat, Jul 23, 2011 at 7:29 PM, Philip Prindeville phil...@cpan.org wrote:
 Sorry, I'm looking at this link and not getting it.

 Is the machine in a bogus state that ran this test?


  Original Message 
 Subject:CPAN Testers Daily Summary Report
 Date:   Sat, 23 Jul 2011 05:26:27 +
 From:   CPAN Tester Report Server do_not_re...@cpantesters.org
 To: Philip Prindeville phil...@cpan.org



 Dear Philip Prindeville,

 Please find below the latest reports for your distributions, generated by 
 CPAN Testers, from the last 24 hours.

 To set your preferences for what you wish to have reported in this Daily 
 Summary, please visit the CPAN Testers Preferences system at 
 https://prefs.cpantesters.org.


 Net-Patricia-1.19:
 - i686-linux / 5.14.1:
  - FAIL 
 http://www.cpantesters.org/cpan/report/30853506-b35b-11e0-ae72-d004d8ab0ee8



 If you have an issue with a particular report, or wish to gain further 
 information from the tester, please use the 'Find A Tester' tool at 
 http://stats.cpantesters.org/cpanmail.html, using the ID or GUID of the 
 report, as listed above, to locate the correct email address.

 If you wish to unsubscribe from these notifications, please login to the 
 CPAN Testers Preferences system, with your PAUSE credentials, and disable 
 CPAN Testers notifications permanently or temporarily. If you have problems 
 with accessing the site, please contact Barbie bar...@cpan.org and request 
 to be removed from the automatic mailings.

 Thanks,
 The CPAN Testers
 --
 Reports: http://www.cpantesters.org
 Statistics:  http://stats.cpantesters.org
 Wiki:http://wiki.cpantesters.org
 Preferences: https://prefs.cpantesters.org

Re: CPAN Testers Daily Summary Report

[David Golden]

No.  You might reconsider whether you need diagnostics or whether
warnings are sufficient.  I think of diagnostics as an end-user choice
because it's so verbose.

-- David

On Sun, Jul 24, 2011 at 4:01 PM, Philip Prindeville phil...@cpan.org wrote:
 Ok, thanks. So I shouldn't be worried?

 On 7/24/11 3:51 AM, David Golden wrote:
 My guess is that your code has use diagnostics and the smoker's
 machine does not have the usual system documentation installed.
 diagnostics.pm actually uses perldiag (Pod) to supply its mesages.

 -- David

 On Sat, Jul 23, 2011 at 7:29 PM, Philip Prindeville phil...@cpan.org wrote:
 Sorry, I'm looking at this link and not getting it.

 Is the machine in a bogus state that ran this test?


  Original Message 
 Subject:        CPAN Testers Daily Summary Report
 Date:   Sat, 23 Jul 2011 05:26:27 +
 From:   CPAN Tester Report Server do_not_re...@cpantesters.org
 To:     Philip Prindeville phil...@cpan.org



 Dear Philip Prindeville,

 Please find below the latest reports for your distributions, generated by 
 CPAN Testers, from the last 24 hours.

 To set your preferences for what you wish to have reported in this Daily 
 Summary, please visit the CPAN Testers Preferences system at 
 https://prefs.cpantesters.org.


 Net-Patricia-1.19:
 - i686-linux / 5.14.1:
  - FAIL 
 http://www.cpantesters.org/cpan/report/30853506-b35b-11e0-ae72-d004d8ab0ee8



 If you have an issue with a particular report, or wish to gain further 
 information from the tester, please use the 'Find A Tester' tool at 
 http://stats.cpantesters.org/cpanmail.html, using the ID or GUID of the 
 report, as listed above, to locate the correct email address.

 If you wish to unsubscribe from these notifications, please login to the 
 CPAN Testers Preferences system, with your PAUSE credentials, and disable 
 CPAN Testers notifications permanently or temporarily. If you have problems 
 with accessing the site, please contact Barbie bar...@cpan.org and 
 request to be removed from the automatic mailings.

 Thanks,
 The CPAN Testers
 --
 Reports:     http://www.cpantesters.org
 Statistics:  http://stats.cpantesters.org
 Wiki:        http://wiki.cpantesters.org
 Preferences: https://prefs.cpantesters.org

Re: CPAN Testers Statistics update

[Barbie]

On Tue, Jul 05, 2011 at 07:52:25AM +0200, Andreas J. Koenig wrote:
  On Mon, 4 Jul 2011 15:51:30 +0100, Barbie bar...@missbarbell.co.uk 
  said:
 
I'll look into refining the list. This was really just a first stab last
night. If there are any distributions that should be ignored (such as the
'perl' distribution), please me know and I'll add them to the list of
distributions that do not expect to receive tests.
 
 Just a few observations after a quick glance:
 
 Distributions containing -bin- are binary distributions that are only
 meant for installation, not for testing. This convention was once
 decided but did not find much spreading.

Thanks, I've now added a few extra to the exclusion list.

 Math-GSL has a new owner (LETO).
 
 A strange line is this one:
 
 HTML-EP   MSWin32 JWIED   2001-01-05
 
 but there are results at http://matrix.cpantesters.org/?dist=HTML-EP

As others have also pointed out with other lines :) Unfortunately the
query I used tried to do too much in one go, and didn't capture the
results as well I as I'd hoped. I've now reworked the query and logic,
so the next rebuild should produce more credible results.

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org
Ark Appreciation Pages http://ark.eology.org

Re: CPAN Testers game: achievements

[Barbie]

On Tue, Jul 05, 2011 at 06:49:51AM -0400, David Golden wrote:
 Achievements are trendy.
 
 Just brainstorming -- we could have tester profile pages that show
 more personal stats and add achievement badges.
 
 E.g.:
 
 * 100,000 reports
 * 1,000,000 reports
 * 5 operating systems tested
 * 10 operating systems tested
 * 5 perls tested
 * 10 perls tested
 * Tested on Win32 (ditto other operating systems)
 * 1000 distributions tested
 * 10,000 distributions tested
 * 100,000 distributions tested (?!)

I like the idea of merit badges. I also like the idea of having a tester
profile page, as that could lead to more people actively identifying
themselves, rather than just an email address.

 I realize all of this would mean work by Barbie or others, but if
 someone really wants to make CPAN Testers a game, this would be a way
 to go.

I like a challenge ;) 

I think this could be an ideal way to give CPAN Testers a face, rather
than the degree of anonymity it currently has.

I'd also like to be able to give testers the ability to provide more
details about themselves, such as their PAUSEID. This could then link
across the sites to better to allow authors to know who is testing their
distribution(s).

I shall work on a plan ;)

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org
Ark Appreciation Pages http://ark.eology.org

Re: CPAN Testers Statistics update

[Jeroen Latour]

Hi Barbie,

On Tue, Jul 5, 2011 at 10:22 AM, Barbie bar...@missbarbell.co.uk wrote:


 As others have also pointed out with other lines :) Unfortunately the
 query I used tried to do too much in one go, and didn't capture the
 results as well I as I'd hoped. I've now reworked the query and logic,
 so the next rebuild should produce more credible results.


Looks like the update was done now? If you look at the older results, there
are still a lot that are either:

Included in CORE:
OS2-ExtAttr
OS2-PrfDB

Archive included in another archive:
http://cpansearch.perl.org/src/ILYAZ/Tk-OS2-1.00/ (perlt2k files)

Not in database (so reporter tool does not work):
http://search.cpan.org/CPAN/authors/id/T/TY/TYEMQ/FileKGlob.tar.gz
http://search.cpan.org/CPAN/authors/id/J/JA/JACKS/Prolog-alpha.tar.gz

Still, I've managed to find several modules that I could test. Thanks!

Any plans to make this available in a structured format, with links to the
archives, so that a smoker can go through the list?

Thanks,
Jeroen

Re: CPAN Testers game: achievements

[Gabor Szabo]

I like the badges idea very much.

On Tue, Jul 5, 2011 at 3:11 PM, Barbie bar...@missbarbell.co.uk wrote:

 I'd also like to be able to give testers the ability to provide more
 details about themselves, such as their PAUSEID. This could then link
 across the sites to better to allow authors to know who is testing their
 distribution(s).

I wonder if this should hook into some kind identity management

For some time I wanted to have a web site where the various rankings and
badges of Perl programmers are collected.
E.g. from CPAN, PerlMonks, StackOverflow, LinkedIn, etc...
The CPAN Testers badges could be another nice source for this.

We'll see if my new bag of tuits will help there.

Gabor

Re: CPAN Testers Statistics update

[Jeroen Latour]

Hi Barbie,

On Mon, Jul 4, 2011 at 2:28 PM, Barbie bar...@missbarbell.co.uk wrote:

 A further update... distributions with no reports filed against them:

 http://stats.cpantesters.org/noreports.html


Nice work! I've tried testing a few, but it seems that a lot of them are
either no longer available from CPAN, or they've been taken over by another
author (so are not really the latest version). Is there something that can
be done about those? It makes it quite impossible to find modules that need
attention.

Thanks,
Jeroen

Re: CPAN Testers Statistics update

[Barbie]

On Mon, Jul 04, 2011 at 03:16:15PM +0200, Jeroen Latour wrote:
 Hi Barbie,
 
 On Mon, Jul 4, 2011 at 2:28 PM, Barbie bar...@missbarbell.co.uk wrote:
 
  A further update... distributions with no reports filed against them:
 
  http://stats.cpantesters.org/noreports.html
 
 
 Nice work! I've tried testing a few, but it seems that a lot of them are
 either no longer available from CPAN, or they've been taken over by another
 author (so are not really the latest version). Is there something that can
 be done about those? It makes it quite impossible to find modules that need
 attention.

I'll look into refining the list. This was really just a first stab last
night. If there are any distributions that should be ignored (such as the
'perl' distribution), please me know and I'll add them to the list of
distributions that do not expect to receive tests.

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org
Ark Appreciation Pages http://ark.eology.org

Re: CPAN Testers Statistics update

[Serguei Trouchelle]

Chris 'BinGOs' Williams wrote:


My explicit exclusions are:

https://github.com/bingos/cpan-smoke-tools/blob/master/cpansmoke.ini


I think Prima is CPAN-friendly now. I have no problem with it on both Windows 
and Linux.

--
Serguei Trouchelle

Re: CPAN Testers Statistics update

[Andreas J. Koenig]

 On Mon, 4 Jul 2011 15:51:30 +0100, Barbie bar...@missbarbell.co.uk said:

   I'll look into refining the list. This was really just a first stab last
   night. If there are any distributions that should be ignored (such as the
   'perl' distribution), please me know and I'll add them to the list of
   distributions that do not expect to receive tests.

Just a few observations after a quick glance:

Distributions containing -bin- are binary distributions that are only
meant for installation, not for testing. This convention was once
decided but did not find much spreading.

Math-GSL has a new owner (LETO).

A strange line is this one:

HTML-EP MSWin32 JWIED   2001-01-05

but there are results at http://matrix.cpantesters.org/?dist=HTML-EP

All the perl_* by ILYAZ are AFAIR parts of binary distributions for OS2.


-- 
andreas

Re: CPAN Testers and companies

[David Cantrell]

On Sat, Jun 18, 2011 at 08:16:40AM +0300, Gabor Szabo wrote:

 I did a little bit of calculation based on
 http://stats.cpantesters.org/testers.html
 and got these data points:
 ...
 Chris Williams (BINGOS) sent in 4,487,765 (34%)
 ...
 The top 63 ppl (3.66%) sent in 12,378,913 (96.46%)
 Which makes that the point of the so called 20-80 rule.
 So in the case of the CPAN Testers it is more like 4-96 rule.
 
 IMHO while the 20-80 rule is known in many situations 4-96 is a bit unhealthy.
 There are two ways to make it more balanced, one to make BingOS stop
 running smokers or, the better way is to get more people regularly send in
 reports.

If Chris stops, it won't achieve anything apart from us not getting
reports from any platforms where he's the only person doing any testing.
How is this balance supposed to be a good thing?

-- 
David Cantrell | Minister for Arbitrary Justice

There's no problem so complex that it can't be solved
by killing everyone even remotely associated with it

Re: CPAN Testers and companies

[Gabor Szabo]

On Mon, Jun 27, 2011 at 3:48 PM, David Cantrell da...@cantrell.org.uk wrote:
 On Sat, Jun 18, 2011 at 08:16:40AM +0300, Gabor Szabo wrote:

 I did a little bit of calculation based on
 http://stats.cpantesters.org/testers.html
 and got these data points:
 ...
 Chris Williams (BINGOS) sent in 4,487,765 (34%)
 ...
 The top 63 ppl (3.66%) sent in 12,378,913 (96.46%)
 Which makes that the point of the so called 20-80 rule.
 So in the case of the CPAN Testers it is more like 4-96 rule.

 IMHO while the 20-80 rule is known in many situations 4-96 is a bit 
 unhealthy.
 There are two ways to make it more balanced, one to make BingOS stop
 running smokers or, the better way is to get more people regularly send in
 reports.

 If Chris stops, it won't achieve anything apart from us not getting
 reports from any platforms where he's the only person doing any testing.
 How is this balance supposed to be a good thing?

David, I know that my English is not up to the level of most of those
on this list, but are you serious that it was not clear that what I am saying
is that we need to get more people to send in test reports?

Do you really think I'd suggested that Chris stops testing?

Gabor

Re: CPAN Testers Wiki Update

[Gabor Szabo]

On Sun, Jun 19, 2011 at 6:53 PM, Barbie bar...@missbarbell.co.uk wrote:

 You should now be able to register with the site and create a new login
 for yourself.

I managed to register and edit one of the pages.

Thanks!

regards
Gabor

Re: CPAN Testers and companies

[Alceu Rodrigues de Freitas Junior]

Em 18-06-2011 07:25, Pedro Melo escreveu:

Also, I spend a lot of time offline, so a simple solution to offline
reporting + send reports whenever I'm online is welcome.

If someone wants to point me in the right direction I have some tuits
available for this two bits.


I'm not sure if the reports by e-mail are still working (long time out 
of testing cycles to know) but maybe you could check the usage of the 
module Test::Reporter::Transport::Outlook 
(http://search.cpan.org/~arfreitas/Test-Reporter-Transport-Outlook-0.01/lib/Test/Reporter/Transport/Outlook.pm).


It's basically a hack, but it works and in your case you wouldn't need 
to install Redemption.


Regards,
Alceu

Re: CPAN Testers and companies

[Serguei Trouchelle]

Alceu Rodrigues de Freitas Junior wrote:


I'm not sure if the reports by e-mail are still working (long time out
of testing cycles to know) but maybe you could check the usage of the
module Test::Reporter::Transport::Outlook
(http://search.cpan.org/~arfreitas/Test-Reporter-Transport-Outlook-0.01/lib/Test/Reporter/Transport/Outlook.pm).


No, they are not working anymore.


It's basically a hack, but it works and in your case you wouldn't need
to install Redemption.


Well, in fact it doesn't work. All emails will be bounced by cpan.org's MX.

--
Serguei Trouchelle

Re: CPAN Testers and companies

[Przemyslaw Wesolek]

On 18.06.2011 07:16, Gabor Szabo wrote:
 IMHO while the 20-80 rule is known in many situations 4-96 is a bit unhealthy.
 There are two ways to make it more balanced, one to make BingOS stop
 running smokers or, the better way is to get more people regularly send in
 reports.

Although I don't have that much trust in adherence to one-of-many Pareto
rules, I agree that long tail of one-time testers (11% sent only one
report, 30% sent less than 7 reports) is a problem.

However, that are all-time statistics. Let's take a look at this year.
Out of 198 reporters, less that 4% sent only one record, 12% sent less
than 7 reports. So this is much better than overall stats.

Przemek

Re: CPAN Testers and companies

[Barbie]

On Sat, Jun 18, 2011 at 08:16:40AM +0300, Gabor Szabo wrote:
 
 IMHO while the 20-80 rule is known in many situations 4-96 is a bit
 unhealthy.

Why?

For a project like CPAN Testers there are always likely to be more
occasional testers than dedicated ones. Many of the top ten testers have
multiple machines, so that 4-96 calculation is a bit misleading.

Plus I have no problem with occasional testers, their input is just as
valuable as those who are able to run automated smokers, as they run
tests often on real live environments, and can spot potential problems
that automated smokers may not.

 but we might think of a way to get companies do so as well.

I have to say I'm a little dubious of this. While I'm happy to have
companies encouraging their employees to contribute, having a faceless
email address to a support team is not helpful when there are problems.
There is at least one tester that has their email address as the company
support address, and I've never gotten an answer from it.

 all kinds of agreements I signed like not using the
 companies equipment for other things.

This is certainly true for a number of companies, but some are
supportive of testing environments.

 So I wonder if there could be a way to encourage companies to so they will
 encourage their employees to send in such reports?
 
 The sore point of the companies is employment of Perl developers. So maybe
 a leaderboard of *companies* with a counter of the reports their employees
 sent in?

Obtaining free promotion for their companies? This is another reason why
I would prefer individuals to promote CT within their company. I'm very
reluctant to provide this sort of scoreboard, when the servers CT
currently run on don't come cheap and we're giving away free
advertising. I know it might mean we get some additional reports, but
the benefit to the company is likely to be far greater than for CT.

 Maybe creating some logos of the CPAN Testers (probably even including
 a counter) that can be displayed on web sites?

We already have the smoking onion logo. If someone wants to work with
that to create some nice logos to be used on websites that support CT,
then I'd be happy to provide a page for them.

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org
Ark Appreciation Pages http://ark.eology.org

Re: CPAN Testers and companies

[Barbie]

On Sun, Jun 19, 2011 at 04:50:24PM +0200, Przemyslaw Wesolek wrote:
 
 Although I don't have that much trust in adherence to one-of-many Pareto
 rules, I agree that long tail of one-time testers (11% sent only one
 report, 30% sent less than 7 reports) is a problem.

Why?

Don't get me wrong, if we can encourage more regular testers that would
be brilliant, but I don't want to discourage occassional, or even
one-time testers in the process.

Occasional testers are just as valuable as the automated smokers, as
they provide results from different environments.

 However, that are all-time statistics. Let's take a look at this year.
 Out of 198 reporters, less that 4% sent only one record, 12% sent less
 than 7 reports. So this is much better than overall stats.

I'm going to look at providing some additional statistics like this so
we can get a clearer picture of how this changes over time. However,
like all statistics, they won't convey the true picture as it isn't
always clear what machine a report comes from. 

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org
Ark Appreciation Pages http://ark.eology.org

Re: CPAN Testers and companies

[yary]

On Sat, Jun 18, 2011 at 9:15 AM, Jeroen Latour f.j.lat...@gmail.com wrote:
...
 I'm not aware of any way to send reports with cpanm, ...

And that's the only reason I never installed cpanm despite rave
reviews. Sending in reports ought to be a feature that a cpanm plugin
would support. It looks like cpanm used to support plugins, and
intends to do so in the future, but they aren't active now- plugin
architecture was removed from cpanminus when version 1.0 was
released, to avoid confusions. We still have an idea to integrate
these plugins to a new tool that's built around cpanminus.

https://github.com/miyagawa/cpanminus/tree/master/plugins

-y

Re: CPAN Testers and companies

[Gabor Szabo]

On Sun, Jun 19, 2011 at 7:10 PM, Barbie bar...@missbarbell.co.uk wrote:
 On Sat, Jun 18, 2011 at 08:16:40AM +0300, Gabor Szabo wrote:

 IMHO while the 20-80 rule is known in many situations 4-96 is a bit
 unhealthy.

 Why?

 For a project like CPAN Testers there are always likely to be more
 occasional testers than dedicated ones. Many of the top ten testers have
 multiple machines, so that 4-96 calculation is a bit misleading.

 Plus I have no problem with occasional testers, their input is just as
 valuable as those who are able to run automated smokers, as they run
 tests often on real live environments, and can spot potential problems
 that automated smokers may not.


Oh, what I'd like to encourage is to have more people setup their
CPAN.pm or whatever client they use to send out tests.
Getting more automated smokers might be interesting but
I think it would be important to encourage more test reporting on
system-perls or other perls that were not specifically built for
smoke-testing.

So I'd like to encourage more people to send in test as they
install modules.


For that encouraging companies and counting numbers of tests
might not be a good idea after all.

 all kinds of agreements I signed like not using the
 companies equipment for other things.

 This is certainly true for a number of companies, but some are
 supportive of testing environments.

So maybe the way is just further education and encouragement.



 Maybe creating some logos of the CPAN Testers (probably even including
 a counter) that can be displayed on web sites?

 We already have the smoking onion logo. If someone wants to work with
 that to create some nice logos to be used on websites that support CT,
 then I'd be happy to provide a page for them.

That would be nice

regards
Gabor

Re: CPAN Testers and companies

[Pedro Melo]

Hi,

On Sat, Jun 18, 2011 at 6:16 AM, Gabor Szabo szab...@gmail.com wrote:
[... stats chopped ...]
 IMHO while the 20-80 rule is known in many situations 4-96 is a bit unhealthy.
 There are two ways to make it more balanced, one to make BingOS stop
 running smokers or, the better way is to get more people regularly send in
 reports.

I used to send my basic run with cpan. Whenever I installed a module,
the tests would generate a report to sent.

But since I switched to cpanm, I stopped doing that because AFAIK
there is no way to do reports with cpanm. So I would say that the
first think I should do is figure out a way to report my cpanm
installed modules.

Also, I spend a lot of time offline, so a simple solution to offline
reporting + send reports whenever I'm online is welcome.

If someone wants to point me in the right direction I have some tuits
available for this two bits.

Bye,
-- 
Pedro Melo
@pedromelo
http://www.simplicidade.org/
http://about.me/melo
xmpp:m...@simplicidade.org
mailto:m...@simplicidade.org

Re: CPAN Testers and companies

[Jeroen Latour]

Hi Pedro,

On Sat, Jun 18, 2011 at 12:25 PM, Pedro Melo m...@simplicidade.org wrote:

 Hi,

 On Sat, Jun 18, 2011 at 6:16 AM, Gabor Szabo szab...@gmail.com wrote:
 But since I switched to cpanm, I stopped doing that because AFAIK
 there is no way to do reports with cpanm. So I would say that the
 first think I should do is figure out a way to report my cpanm
 installed modules.

 Also, I spend a lot of time offline, so a simple solution to offline
 reporting + send reports whenever I'm online is welcome.


I'm not aware of any way to send reports with cpanm, If you want to do
offline reporting, take a look at metabase-relayd.
It has an --offline option that seems to do what you need.

Regards,
Jeroen

Re: CPAN Testers Daily Summary Report

[Alex J. Avriette]

Hi folks... While Net::TDMA is not the worlds most fabulous module (and in
fact its test coverage is probably less than 1%), all your failures were
out of memory. I test at home on a 64-bit Snow Leopard Server Mac with
20gb of ram and untold terabytes of disk. The module is intended to
*teach*people how to work with TDMA, how the protocol works, and so
on. I can
create a new test, t/00_memory.t or something, to indicate whether this is
going to work at all, but the thing is, in order to test an entire TDMA
Day, we have to *construct* one. If the user hasn't got the juice, it's
not going to work real well.

Here's a test from mine:

number of cores available:  8
users on system:   12
system load averages:   0.18 0.28 0.15
distinct processes on system:  106
actual cpu idle percentage: 1

thunder:Net-TDMA-0.1pre alex$ make test
PERL_DL_NONLAZY=1 /usr/bin/perl -MExtUtils::Command::MM -e
test_harness(0, 'blib/lib', 'blib/arch') t/*.t
t/00_dayok 1/0

This may take a while.
# Your first test, with specified parameters, took 39 seconds.

This, too, may take a while.
t/00_dayok 8/0# The arbitrarily constructed day took 45 seconds to
complete.
# Nominally this would take place in 1/32 of a second, or .031s.
# Which is why /usr/bin/perl is probably not fast enough for this.
t/00_dayok

All tests successful.
Files=1, Tests=9, 90 wallclock secs (82.83 cusr +  7.31 csys = 90.14 CPU)
thunder:Net-TDMA-0.1pre alex$



--
Alex J Avriette
http://www.spunfr.com/ (Harder Better Faster Stronger)
http://www.linkedin.com/in/avriette  (+1 858 3677293)



On Mon, Mar 29, 2010 at 9:29 PM, CPAN Tester Report Server 
do_not_re...@cpantesters.org wrote:

 Dear Alex J. Avriette,

 Please find below the latest reports for your distributions, generated by
 CPAN Testers, from the last 24 hours.

 To set your preferences for what you wish to have reported in this Daily
 Summary, please visit the CPAN Testers Preferences system at
 https://prefs.cpantesters.org.


 Net-TDMA-0.1pre:
 - IP35-irix-64int / 5.8.8:
  - FAIL http://www.cpantesters.org/cpan/report/7031347

 - alpha-netbsd / 5.10.0:
  - FAIL http://www.cpantesters.org/cpan/report/7033635

 - darwin-thread-multi-2level / 5.10.1:
  - FAIL http://www.cpantesters.org/cpan/report/7031357

 - i386-freebsd / 5.10.1:
  - FAIL http://www.cpantesters.org/cpan/report/7025754

 - i386-freebsd-thread-multi / 5.10.1:
  - FAIL http://www.cpantesters.org/cpan/report/7031307

 - i86pc-solaris-64int / 5.10.1:
  - FAIL http://www.cpantesters.org/cpan/report/7028046

 - i86pc-solaris-64int / 5.11.5:
  - FAIL http://www.cpantesters.org/cpan/report/7028169

 - x86_64-linux-thread-multi / 5.11.5:
  - FAIL http://www.cpantesters.org/cpan/report/7030785

 - x86_64-linux-thread-multi / 5.8.9:
  - FAIL http://www.cpantesters.org/cpan/report/7030798

 - x86_64-linux-thread-multi-ld / 5.11.5:
  - FAIL http://www.cpantesters.org/cpan/report/7025605



 If you have an issue with a particular report, or wish to gain further
 information from the tester, please use the 'Find A Tester' tool at
 http://stats.cpantesters.org/cpanmail.html, using the NNTP ID of the
 report to locate the correct email address.

 If you wish to unsubscribe from these notifications, please login to the
 CPAN Testers Preferences system, with your PAUSE credentials, and disable
 CPAN Testers notifications permanently or temporarily. If you have problems
 with accessing the site, please contact Barbie bar...@cpan.org and
 request to be removed from the automatic mailings.

 Thanks,
 The CPAN Testers
 --
 Reports: http://www.cpantesters.org
 Statistics:  http://stats.cpantesters.org
 Wiki:http://wiki.cpantesters.org
 Preferences: https://prefs.cpantesters.org

Re: CPAN Testers Daily Summary Report

[David Golden]

On Mon, Mar 29, 2010 at 11:51 PM, Alex J. Avriette a...@cpan.org wrote:
 I can create a new test, t/00_memory.t or something, to indicate whether this 
 is
 going to work at all, but the thing is, in order to test an entire TDMA
 Day, we have to *construct* one. If the user hasn't got the juice, it's
 not going to work real well.

Hi, Alex.  You have a really unique module and it's likely not very
well suited for the kind of automated testing that is useful for other
modules -- none of the smokers are going to have that kind of memory.
The best thing to do is probably to just tell CPAN Testers to skip
your module entirely.  In your Makefile.PL, add this line right after
your use() statements before the call to WriteMakefile():

exit 0 if $ENV{AUTOMATED_TESTING};

This will exit normally without creating a Makefile.  That is a signal
to CPAN Testers to abort without sending a fail report.  (Don't exit()
with a non-zero code or you'll get more FAIL reports!)

Also, as an unrelated note, I strongly suggest that you don't use
non-numerics in your distribution version.  E.g. 0.1pre.  This is
non-standard.  You also don't have a $VERSION set in your modules,
which makes it impossible for a CPAN client to determine whether to
install new versions when you release them.

Again, I strongly encourage you to set our $VERSION=0.1 in your main
module and let ExtUtils::MakeMaker pick up the version using
VERSION_FROM.

Regards,
David Golden

Re: CPAN Testers 2.0 mid-March update

[Marvin Humphrey]

On Mon, Mar 15, 2010 at 12:27:53AM -0400, David Golden wrote:
 We’ve hit a major milestone. The CT2.0 closed beta test has begun.

Awesome.  Great progress, y'all.

Marvin Humphrey

Re: CPAN Testers 2.0 -- BETA TEST

[p...@0ne.us]

David Golden wrote:

At long last, I think we're ready to beta test CT2.0.

I haven't yet deployed rafl's app to distribute CT2.0 ID files, so if
you are interested in beta testing, please email me and I will email
you an ID file and instructions.  ID files replace email addresses as
the way individual testers are identified.

At this point, I only want a handful of people for the beta test --
Serguei already volunteered to cover CPAN+CPAN::Reporter.  I'd like to
get 3 or 4 more, including some CPANPLUS-based smokers.

Once the ID file distribution app is deployed and I don't have to
manually send out ID files, I'll open up the beta to anyone
interested.

-- David
  
   I'll be glad to help - I'm using CPANPLUS and can fire up a few VMs 
whenever you're ready and start DDOSing you ;) Please let me know which 
OS you want me to fire up - I have linux/netbsd/freebsd/opensolaris 
available atm...

Re: CPAN Testers Daily Summary Report

[Johan Vromans]

[Quoting Chris 'BinGOs' Williams, on January 23 2010, 08:06, in Re: CPAN 
Testers Dai]
 There was a flaw in my previous logic which I have actually tested
 this time against EekBoek.

Did you use 1.04.06 for testing? 1.04.06.01 has been upgraded to
contain M::B 0.32.

-- Johan

Re: CPAN Testers Daily Summary Report

[Johan Vromans]

On a related topic...

I sync my CPAN with cpantesters, and I noticed that in
modules/by-module/Module there's M::B 0.2804 through 0.32 .
(All Ken's and Eric's)

In authors/id/D/DA/DAGOLDEN there's M::B 0.33_01 through 0.3603 .

Shouldn't the newer versions also be in modules/by-module/Module ?

-- Johan

Re: CPAN Testers Daily Summary Report

[Barbie]

On Sat, Jan 23, 2010 at 01:06:22PM +0100, Johan Vromans wrote:
 On a related topic...
 
 I sync my CPAN with cpantesters, and I noticed that in
 modules/by-module/Module there's M::B 0.2804 through 0.32 .
 (All Ken's and Eric's)
 
 In authors/id/D/DA/DAGOLDEN there's M::B 0.33_01 through 0.3603 .
 
 Shouldn't the newer versions also be in modules/by-module/Module ?

They should. I'll restart the sync in a bit and see if it captures the
missing files. It uses Andreas' special rsync distribution to mirror
authors and modules directories directly from PAUSE.

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org

Re: CPAN Testers Daily Summary Report

[Barbie]

On Mon, Jan 25, 2010 at 09:35:05AM +, Barbie wrote:
 On Sat, Jan 23, 2010 at 01:06:22PM +0100, Johan Vromans wrote:
  On a related topic...
  
  I sync my CPAN with cpantesters, and I noticed that in
  modules/by-module/Module there's M::B 0.2804 through 0.32 .
  (All Ken's and Eric's)
  
  In authors/id/D/DA/DAGOLDEN there's M::B 0.33_01 through 0.3603 .
  
  Shouldn't the newer versions also be in modules/by-module/Module ?
 
 They should. I'll restart the sync in a bit and see if it captures the
 missing files. It uses Andreas' special rsync distribution to mirror
 authors and modules directories directly from PAUSE.

I've now restarted the sync and although it seemed to update a few
things, mostly CHECKSUM files, it still hasn't referenced the
Module-Build files.

Andreas does PAUSE have these files in the modules/by-module/Module
directory?

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org

Re: CPAN Testers Daily Summary Report

[Barbie]

On Mon, Jan 25, 2010 at 10:51:34AM +, Barbie wrote:
 On Mon, Jan 25, 2010 at 09:35:05AM +, Barbie wrote:
  On Sat, Jan 23, 2010 at 01:06:22PM +0100, Johan Vromans wrote:
   On a related topic...
   
   I sync my CPAN with cpantesters, and I noticed that in
   modules/by-module/Module there's M::B 0.2804 through 0.32 .
   (All Ken's and Eric's)
   
   In authors/id/D/DA/DAGOLDEN there's M::B 0.33_01 through 0.3603 .
   
   Shouldn't the newer versions also be in modules/by-module/Module ?
  
  They should. I'll restart the sync in a bit and see if it captures the
  missing files. It uses Andreas' special rsync distribution to mirror
  authors and modules directories directly from PAUSE.
 
 I've now restarted the sync and although it seemed to update a few
 things, mostly CHECKSUM files, it still hasn't referenced the
 Module-Build files.
 
 Andreas does PAUSE have these files in the modules/by-module/Module
 directory?

I think I see where the problem lies. The RECENT files in /modules only
list the index files, none of the actual files to update. Has something
changed in the last month regards how these are updated?

The /authors file list:

-rw-r--r-- 1 barbie users23844 2010-01-25 12:02
authors/RECENT-1d.yaml
-rw-r--r-- 1 barbie users 4886 2010-01-25 12:04
authors/RECENT-1h.yaml
-rw-r--r-- 1 barbie users   749404 2010-01-25 07:59
authors/RECENT-1M.yaml
-rw-r--r-- 1 barbie users  2348521 2010-01-19 06:02
authors/RECENT-1Q.yaml
-rw-r--r-- 1 barbie users   200588 2010-01-25 07:59
authors/RECENT-1W.yaml
-rw-r--r-- 1 barbie users  6195539 2009-12-28 22:55
authors/RECENT-1Y.yaml
-rw-r--r-- 1 barbie users 8397 2010-01-25 12:04
authors/RECENT-6h.yaml
lrwxrwxrwx 1 barbie users   14 2008-10-11 09:52
authors/RECENT.recent - RECENT-1h.yaml
-rw-r--r-- 1 barbie users 15844339 2009-11-23 11:09
authors/RECENT-Z.yaml

but /modules only has:

-rw-r--r-- 1 barbie users 1294 2010-01-25 11:53 modules/RECENT-1d.yaml
-rw-r--r-- 1 barbie users  910 2010-01-25 11:53 modules/RECENT-1h.yaml
-rw-r--r-- 1 barbie users 1291 2010-01-25 11:25 modules/RECENT-1W.yaml
lrwxrwxrwx 1 barbie users   14 2008-10-11 10:47 modules/RECENT.recent -
RECENT-1h.yaml
-rw-r--r-- 1 barbie users 1273 2010-01-24 22:55 modules/RECENT-Z.yaml

Are these correct?

Cheers,
Barbie.
-- 
Birmingham Perl Mongers http://birmingham.pm.org
Memoirs Of A Roadie http://barbie.missbarbell.co.uk
CPAN Testers Blog http://blog.cpantesters.org
YAPC Conference Surveys http://yapc-surveys.org

Re: CPAN Testers Daily Summary Report

[Andreas J. Koenig]

 On Mon, 25 Jan 2010 11:06:46 +, Barbie bar...@missbarbell.co.uk 
 said:

   but /modules only has:

   -rw-r--r-- 1 barbie users 1294 2010-01-25 11:53 modules/RECENT-1d.yaml
   -rw-r--r-- 1 barbie users  910 2010-01-25 11:53 modules/RECENT-1h.yaml
   -rw-r--r-- 1 barbie users 1291 2010-01-25 11:25 modules/RECENT-1W.yaml
   lrwxrwxrwx 1 barbie users   14 2008-10-11 10:47 modules/RECENT.recent -
   RECENT-1h.yaml
   -rw-r--r-- 1 barbie users 1273 2010-01-24 22:55 modules/RECENT-Z.yaml

   Are these correct?

Yes, these are correct. modules/ is both buggy and overdue to be ripped
out of CPAN. And the recentfiles mirroring code is not covering the
symlink tree, only the handful of files that are not symlinks.

-- 
andreas

Re: CPAN Testers Daily Summary Report

[Chris 'BinGOs' Williams]

On Sat, Jan 23, 2010 at 06:29:41AM +, Chris 'BinGOs' Williams wrote:
 
   Revision history for Perl extension CPANPLUS::Dist::Build.
 
   0.44 Wed Nov 18 12:37:03 GMT 2009
 - Make the prereq resolving fallback to _build/ querying 
   if the 'prereq_data' action fails. Spotted by Johan Vromans.
 
 *sigh*
 

Further to this I have just uploaded CPANPLUS-Dist-Build-0.46 to CPAN.

There was a flaw in my previous logic which I have actually tested this time
against EekBoek.

Thanks to Johan for his patience.

-- 
Chris Williams
aka BinGOs
PGP ID 0x4658671F
http://www.gumbynet.org.uk
==


pgpnMSkgNFJuS.pgp
Description: PGP signature

Re: CPAN Testers Daily Summary Report

[David Golden]

On Sat, Jan 23, 2010 at 7:06 AM, Johan Vromans j...@cpan.org wrote:
 On a related topic...

 I sync my CPAN with cpantesters, and I noticed that in
 modules/by-module/Module there's M::B 0.2804 through 0.32 .
 (All Ken's and Eric's)

 In authors/id/D/DA/DAGOLDEN there's M::B 0.33_01 through 0.3603 .

 Shouldn't the newer versions also be in modules/by-module/Module ?

The mysteries of PAUSE are deep.  :-)

Andreas -- are you following this thread?

-- David

Re: CPAN Testers Daily Summary Report

[Chris 'BinGOs' Williams]

On Tue, Jan 19, 2010 at 01:15:10PM -0500, David Golden wrote:
 On Tue, Jan 19, 2010 at 12:47 PM, David Cantrell da...@cantrell.org.uk 
 wrote:
  On Mon, Jan 18, 2010 at 09:53:38PM +0100, Andreas J. Koenig wrote:
  On Sat, 16 Jan 2010 22:02:46 +0100, j...@cpan.org (Johan Vromans) said:
   http://www.nntp.perl.org/group/perl.cpan.testers/2010/01/msg6656308.html
   I therefore must assume it's a TESTER problem.
  Yes, we're suffering already for a few days but today Barbie fixed the
  testers master database by hiding the broken reports that come from a
  broken and so far unstopped broken test machine.
 
  But this is one of Chris's reports, not APOCAL's.
 
 Yes -- that pretty clearly should have been discarded and not sent at
 all.  There's something about 'prereq_data' not being recognized.
 
 Aha!  EekBoek bundles M::B 0.28, which didn't have 'prereq_data'.
 
 Chris -- I think CPANPLUS needs to check the exit code of 'Build
 prereq_data' and fall back on scraping _build/prereqs if it's not OK.
 Never underestimate the ability of authors/users to find the wrong
 module, I guess.  :-)

And there I was thinking I had already done that in CPANPLUS::Dist::Build
which is the culprit

  Revision history for Perl extension CPANPLUS::Dist::Build.

  0.44 Wed Nov 18 12:37:03 GMT 2009
- Make the prereq resolving fallback to _build/ querying 
  if the 'prereq_data' action fails. Spotted by Johan Vromans.

*sigh*

-- 
Chris Williams
aka BinGOs
PGP ID 0x4658671F
http://www.gumbynet.org.uk
==


pgp9Bc7TSqyoH.pgp
Description: PGP signature

Re: CPAN Testers Daily Summary Report

[David Golden]

On Thu, Jan 21, 2010 at 5:13 AM, Johan Vromans j...@cpan.org wrote:
 First is the problem that inc::latest requires a packlist for M::B. I
 do not have the faintest idea what should go into the packlist. Perl
 packlists contain absolute file names. What file names should go in
 the packlist for inc::latest?

It's just the packlist that gets installed with Module::Build.  I.e.
by ExtUtils::Packlist.  All this means is that you can't bundle on a
Perl that came with M::B 0.36+ because there are no packlists for
modules distributed with the Perl core.  (That is an issue I haven't
had a chance to pursue with p5p.)

 Second problem is that newer M::B require versions of perl modules
 that are not yet normally found in distros:

  ExtUtils::CBuilder (0.24) is installed, but we need version = 0.27
  ExtUtils::ParseXS (2.18_02) is installed, but we need version = 2.21
  ExtUtils::Manifest (1.51_01) is installed, but we prefer to have 1.54
  YAML::Tiny (1.31) is installed, but we need version = 1.38
  ExtUtils::Install (1.44) is installed, but we need version = 1.54
  ExtUtils::Installed (1.43) is installed, but we need version = 1.999
  Software::License is not installed

That's a fair point.  All of those would need to be bundled as well.
Bundling is still experimental for Module::Build.

 What minimal version of M::B has sufficient support for prereq ?

0.32

 As a side note: Do I really need things like E::CBuilder and
 E::ParseXS to install a perl-only module?

No -- but Module::Build has to support both Perl and XS modules and we
can't guarantee sane behavior across all platforms without them.  In
the past, when they were optional, people would install Module::Build
and then wind up unable to install XS modules because they didn't have
those modules.  Now, when you install Module::Build you get a known
working toolchain configuration.

More generally -- a preferred way to deal with a Module::Build
dependency is to add it to configure_requires in META.yml.

Or, since you have a Makefile.PL, you could add Build.PL to your
MANIFEST.SKIP file and only ship the Makefile.PL.  You'd have Build.PL
for your use as an author, but would avoid Module::Build being an
install-time dependency for your users.

David

Re: CPAN Testers Daily Summary Report

[Johan Vromans]

[Quoting David Golden, on January 19 2010, 13:15, in Re: CPAN Testers Dai]
 Johan -- Would you please consider updating the bundled M::B?  You
 might want to see if the instructions in Module::Build::Bundling are
 sufficient to automate it for you easily.

I'd love to say no problem, but in fact I do run into several
problems when I try to do that.

First is the problem that inc::latest requires a packlist for M::B. I
do not have the faintest idea what should go into the packlist. Perl
packlists contain absolute file names. What file names should go in
the packlist for inc::latest?

Second problem is that newer M::B require versions of perl modules
that are not yet normally found in distros:

  ExtUtils::CBuilder (0.24) is installed, but we need version = 0.27
  ExtUtils::ParseXS (2.18_02) is installed, but we need version = 2.21
  ExtUtils::Manifest (1.51_01) is installed, but we prefer to have 1.54
  YAML::Tiny (1.31) is installed, but we need version = 1.38
  ExtUtils::Install (1.44) is installed, but we need version = 1.54
  ExtUtils::Installed (1.43) is installed, but we need version = 1.999
  Software::License is not installed

What minimal version of M::B has sufficient support for prereq ?

As a side note: Do I really need things like E::CBuilder and
E::ParseXS to install a perl-only module?

-- Johan

Re: CPAN Testers Daily Summary Report

[David Golden]

On Thu, Jan 21, 2010 at 8:12 AM, Johan Vromans j...@cpan.org wrote:
 [Quoting David Golden, on January 21 2010, 06:30, in Re: CPAN Testers Dai]
 It's just the packlist that gets installed with Module::Build.  I.e.
 by ExtUtils::Packlist.  All this means is that you can't bundle on a
 Perl that came with M::B 0.36+ because there are no packlists for
 modules distributed with the Perl core.  (That is an issue I haven't
 had a chance to pursue with p5p.)

 Again, does that mean I have to include a packlist with absolute file
 names derived from the build system that may (will) not correspond to
 the file names used on the target system?

No -- the packlist is used to determine which files to bundle.  It's
actually remarkably hard to know what files belong to a given module
once they've been installed.  Packlists sort of work, but aren't
ideal.  I suspect the ultimate answer is to treat inc/ like a
local::lib directory and install things from original CPAN
distributions (with dependencies).

It reminds me of that line in Aliens: I say we take off and nuke the
site from orbit -- it's the only way to be sure

 Thanks for the answers, pointers, patience, and the nice tools.

You're welcome.  Thanks for being patient with the evolving state of
tools and offering constructive complaints instead of just saying you
suck!  :-)

David

Re: CPAN Testers Daily Summary Report

[Johan Vromans]

[Quoting David Golden, on January 21 2010, 06:30, in Re: CPAN Testers Dai]
 It's just the packlist that gets installed with Module::Build.  I.e.
 by ExtUtils::Packlist.  All this means is that you can't bundle on a
 Perl that came with M::B 0.36+ because there are no packlists for
 modules distributed with the Perl core.  (That is an issue I haven't
 had a chance to pursue with p5p.)

Again, does that mean I have to include a packlist with absolute file
names derived from the build system that may (will) not correspond to
the file names used on the target system?

  What minimal version of M::B has sufficient support for prereq ?
 
 0.32

Okay, I'll try this first.

 Or, since you have a Makefile.PL, you could add Build.PL to your
 MANIFEST.SKIP file and only ship the Makefile.PL.  You'd have Build.PL
 for your use as an author, but would avoid Module::Build being an
 install-time dependency for your users.

That could be worth an investigation.

Thanks for the answers, pointers, patience, and the nice tools.

-- Johan

Re: CPAN Testers Daily Summary Report

[David Cantrell]

On Mon, Jan 18, 2010 at 09:53:38PM +0100, Andreas J. Koenig wrote:
 On Sat, 16 Jan 2010 22:02:46 +0100, j...@cpan.org (Johan Vromans) said:
  http://www.nntp.perl.org/group/perl.cpan.testers/2010/01/msg6656308.html
  I therefore must assume it's a TESTER problem.
 Yes, we're suffering already for a few days but today Barbie fixed the
 testers master database by hiding the broken reports that come from a
 broken and so far unstopped broken test machine.

But this is one of Chris's reports, not APOCAL's.

-- 
David Cantrell | London Perl Mongers Deputy Chief Heretic

Today's previously unreported paraphilia is tomorrow's Internet sensation

Re: CPAN Testers Daily Summary Report

[David Golden]

On Tue, Jan 19, 2010 at 12:47 PM, David Cantrell da...@cantrell.org.uk wrote:
 On Mon, Jan 18, 2010 at 09:53:38PM +0100, Andreas J. Koenig wrote:
 On Sat, 16 Jan 2010 22:02:46 +0100, j...@cpan.org (Johan Vromans) said:
  http://www.nntp.perl.org/group/perl.cpan.testers/2010/01/msg6656308.html
  I therefore must assume it's a TESTER problem.
 Yes, we're suffering already for a few days but today Barbie fixed the
 testers master database by hiding the broken reports that come from a
 broken and so far unstopped broken test machine.

 But this is one of Chris's reports, not APOCAL's.

Yes -- that pretty clearly should have been discarded and not sent at
all.  There's something about 'prereq_data' not being recognized.

Aha!  EekBoek bundles M::B 0.28, which didn't have 'prereq_data'.

Chris -- I think CPANPLUS needs to check the exit code of 'Build
prereq_data' and fall back on scraping _build/prereqs if it's not OK.
Never underestimate the ability of authors/users to find the wrong
module, I guess.  :-)

Johan -- Would you please consider updating the bundled M::B?  You
might want to see if the instructions in Module::Build::Bundling are
sufficient to automate it for you easily.

David

Re: CPAN Testers Daily Summary Report

[Johan Vromans]

[Quoting CPAN Tester Report Server, on January 16 2010, 21:13, in CPAN Testers 
Daily S]
 Dear Johan Vromans,
 
 EekBoek-1.04.06:
 - alpha-linux / 5.10.0:
   - FAIL http://nntp.x.perl.org/group/perl.cpan.testers/6656308

... and several more ...

All tests fail since some mandatory modules, that are
**clearly**marked**as**mandatory**, do not get installed for the
test, e.g.:

  Checking whether your kit is complete...
  Looks good

  Checking prerequisites...
   - ERROR: DBI is not installed

This should trigger CPANPLUS to install it, shouldn't it?

  ... and then, later ...

  It was observed that the test suite seem to fail without these modules:

  DBI

  As such, adding the prerequisite module(s) to 'PREREQ_PM' in your
  Makefile.PL should solve this problem.  For example:

I therefore must assume it's a TESTER problem.

-- Johan

Re: CPAN Testers Daily Summary Report

[Andreas J. Koenig]

 On Sat, 16 Jan 2010 22:02:46 +0100, j...@cpan.org (Johan Vromans) said:

   I therefore must assume it's a TESTER problem.

Yes, we're suffering already for a few days but today Barbie fixed the
testers master database by hiding the broken reports that come from a
broken and so far unstopped broken test machine.

I'm sure I'm speaking for all involved parties when I say we're very
sorry for the mess.

-- 
andreas

Re: CPAN TESTERS ALERT -- throttle your smokers NOW

[Andreas J. Koenig]

 On Thu, 17 Dec 2009 17:12:59 -0500, David Golden xda...@gmail.com said:

   In the meantime, please slow down testing -- put sleep loops in the
   smoker code or something.  Whatever you have to do -- we need to get
   back down to the 100,000 reports/month level (or further) to take some
   pressure off the NOC.

We have not yet throttled enough to reach 10/month. I pulled the
stats file from devel.cpantesters.org and saw excellent reductions:

Total report per day:
  14206 20091213
  27881 20091214
  19905 20091215
  10092 20091216
  15618 20091217
   8355 20091218
   8217 20091219
   6250 20091220

But 6000*30 is still 18:(

Top reporters on 20091220:
   2198 bingos
   1343 apocal
746 Oliver Paukstadt
562 da...@cantrell
298 randir
187 salvacpan
175 stro
127 potatohead
123 andreas.koenig.gmwojprw

Please ACK,
-- 
andreas