[airflow] branch main updated: Summarize skipped tests after tests are run (#30520)

[potiuk]

This is an automated email from the ASF dual-hosted git repository.

potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
     new 0b83f064e5 Summarize skipped tests after tests are run (#30520)
0b83f064e5 is described below

commit 0b83f064e524272e8fc1dfcd38edd7ad39bc6660
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Fri Apr 7 11:35:10 2023 +0200

    Summarize skipped tests after tests are run (#30520)
    
    When Pytest run tests it provides a summary of the tests. We are
    running a lot of the tests so we are really interested only in cases
    that are "interesting". So far we were not showing "skipped" tests
    in the summary, because there were cases where a lot of tests
    were skipped (mostly when integration tests were run - we collected
    tests from "tests" folder and run only those tests that were not
    skipped by @integration mark.
    
    This however changed in #28170 as we moved all integration
    tests to "integration" subfolder and now instead of large number of
    skipped tests we run them selectively for each integration.
    
    This should help in verifying that the skipped tests were skipped
    for a good reason (and that we actually see which tests have been
    skipped).
---
 Dockerfile.ci                   | 9 ++++++---
 scripts/docker/entrypoint_ci.sh | 9 ++++++---
 2 files changed, 12 insertions(+), 6 deletions(-)

diff --git a/Dockerfile.ci b/Dockerfile.ci
index cae8826589..d998ad6a38 100644
--- a/Dockerfile.ci
+++ b/Dockerfile.ci
@@ -878,16 +878,19 @@ EXTRA_PYTEST_ARGS=(
     "--teardown-timeout=${TEST_TIMEOUT}"
     "--output=${WARNINGS_FILE}"
     "--disable-warnings"
-    # Only display summary for non-expected case
+    # Only display summary for non-expected cases
+    #
     # f - failed
     # E - error
     # X - xpassed (passed even if expected to fail)
-    # The following cases are not displayed:
     # s - skipped
+    #
+    # The following cases are not displayed:
     # x - xfailed (expected to fail and failed)
     # p - passed
     # P - passed with output
-    "-rfEX"
+    #
+    "-rfEXs"
 )
 
 if [[ ${SUSPENDED_PROVIDERS_FOLDERS=} != "" ]]; then
diff --git a/scripts/docker/entrypoint_ci.sh b/scripts/docker/entrypoint_ci.sh
index 12f70257e4..4e4eee693c 100755
--- a/scripts/docker/entrypoint_ci.sh
+++ b/scripts/docker/entrypoint_ci.sh
@@ -305,16 +305,19 @@ EXTRA_PYTEST_ARGS=(
     "--teardown-timeout=${TEST_TIMEOUT}"
     "--output=${WARNINGS_FILE}"
     "--disable-warnings"
-    # Only display summary for non-expected case
+    # Only display summary for non-expected cases
+    #
     # f - failed
     # E - error
     # X - xpassed (passed even if expected to fail)
-    # The following cases are not displayed:
     # s - skipped
+    #
+    # The following cases are not displayed:
     # x - xfailed (expected to fail and failed)
     # p - passed
     # P - passed with output
-    "-rfEX"
+    #
+    "-rfEXs"
 )
 
 if [[ ${SUSPENDED_PROVIDERS_FOLDERS=} != "" ]]; then