#29106: Display Skipped Tests in Test Result Output
------------------------------------------------+------------------------
               Reporter:  Rich Jones            |          Owner:  nobody
                   Type:  Cleanup/optimization  |         Status:  new
              Component:  Testing framework     |        Version:  2.0
               Severity:  Normal                |       Keywords:
           Triage Stage:  Unreviewed            |      Has patch:  0
    Needs documentation:  0                     |    Needs tests:  0
Patch needs improvement:  0                     |  Easy pickings:  1
                  UI/UX:  1                     |
------------------------------------------------+------------------------
 _This ticket is part of the Django Test Output Beautification initiative:
 https://code.djangoproject.com/ticket/29101_

 Django 1.10 introduced a wonderful new feature, test tagging, which allows
 the user running tests to control which tests are included and excluded in
 a test execution. This is particularly handy in complicated and
 conditional continuous integration setups, which may require lots of
 different tag inclusions and exclusions.

 The annoying part is that the default test output, and even the test
 output with higher verbosity levels, never displays which tests are
 excluded or included.

 I'd be great if this information could be displayed in three ways during a
 test execution: Once during initialization, to show which tags were
 included or excluded, once for each test as it is skipped, and once during
 the final tally.

 So, at the beginning:

 {{{
 System check identified no issues (0 silenced).
 Running tests, excluding [slow, veryslow].
 }}}

 For each test skipped:
 {{{
 ========================
 Testing 'test_good_file_grouping'
 
(data_refinery_workers.downloaders.test_transcriptome_index.DownloadTranscriptomeIndexTestCase)
 _Makes sure that proper file group runs the pipeline._
 -----------------------------------------------------
 ...
 Ok!

 ========================
 Skipping 'test_good_file_grouping'
 
(data_refinery_workers.downloaders.test_transcriptome_index.DownloadTranscriptomeIndexTestCase)
 [veryslow]
 -----------------------------------------------------

 }}}

 And finally, at the end:
 {{{
 ----------------------------------------------------------------------
 Ran 38 tests in 34.808s. Skipped 4 tests.
 }}}

 This should work appropriately for all of the different tag-related test
 arguments.

 It'd also be nice if this test output was appropriately colorized.

 Related tickets:
 https://code.djangoproject.com/ticket/29105
 https://code.djangoproject.com/ticket/22449
 https://code.djangoproject.com/ticket/29105

-- 
Ticket URL: <https://code.djangoproject.com/ticket/29106>
Django <https://code.djangoproject.com/>
The Web framework for perfectionists with deadlines.

-- 
You received this message because you are subscribed to the Google Groups 
"Django updates" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to django-updates+unsubscr...@googlegroups.com.
To post to this group, send email to django-updates@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/django-updates/051.0677a99292cacd9b17195433e056a382%40djangoproject.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to