#18558: Test all installed packages by default
-------------------------+-------------------------------------------------
       Reporter:         |        Owner:
  ncohen                 |       Status:  needs_review
           Type:         |    Milestone:  sage-6.8
  enhancement            |   Resolution:
       Priority:  major  |    Merged in:
      Component:         |    Reviewers:
  doctest framework      |  Work issues:
       Keywords:         |       Commit:
        Authors:         |  1ffc3c1a7a909b1d75653f9951da869371cc1039
  Nathann Cohen          |     Stopgaps:
Report Upstream:  N/A    |
         Branch:         |
  u/ncohen/18558         |
   Dependencies:         |
  #18456, #18124         |
-------------------------+-------------------------------------------------

Comment (by tmonteil):

 While this ticket is a good step towards a more tested system, i
 understand Jeroen's concerns that it might lead to a less tested one. I
 can witness that recurrent failing doctest lead to not caring anymore. For
 example, when i build a massive amount of binaries, i frequently randomly
 have broken unreproducible doctest for `src/sage/interfaces/expect.py`,
 the consequence is that i stopped to double check them, so if some real
 problem appears on this file, i will not see it because it will look like
 the random one. With a huge list of broken doctests, people won't check if
 some new bugs are reported within the list, and the effect of the ticket
 will be the opposite of it aim.

 Replying to [comment:33 jdemeyer]:
 > Actually, a good compromise for this ticket might be: test only
 ''optional'' packages, move the known-broken packages (like `4ti2`) to
 experimental.

 +1, this is the difference between optional and experimental packages, and
 we keep the best of both points of views. I will add : "propose a way to
 test all installed (experimental) packages as well".

 Replying to [comment:34 ncohen]:
 > Experimental packages are *advertised* as broken [1]. Why would you
 expect them to pass tests?

 This will be a requirement to let them enter the optional list.

 > Advertising the bugs to whoever uses the packages is the whole point of
 this branch.
 You claimed yourself that "The only guys who run doctests (well, except
 bots) are developers", hence if we want to advertize those bugs to users,
 this is not the appropriate way, we should write stopgaps instead.

--
Ticket URL: <http://trac.sagemath.org/ticket/18558#comment:35>
Sage <http://www.sagemath.org>
Sage: Creating a Viable Open Source Alternative to Magma, Maple, Mathematica, 
and MATLAB

-- 
You received this message because you are subscribed to the Google Groups 
"sage-trac" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at http://groups.google.com/group/sage-trac.
For more options, visit https://groups.google.com/d/optout.

Reply via email to