[ 
https://issues.apache.org/jira/browse/HDDS-6463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17764364#comment-17764364
 ] 

Attila Doroszlai commented on HDDS-6463:
----------------------------------------

Acceptance test splits in CI are defined by the {{suite}} matrix variable here:

{code:title=https://github.com/apache/ozone/blob/5d5eb45d14952056faaf2150db273a2f152ff867/.github/workflows/ci.yml#L241-L260}
  acceptance:
    needs:
      - build-info
      - build
    runs-on: ubuntu-20.04
    timeout-minutes: 150
    if: needs.build-info.outputs.needs-compose-tests == 'true'
    strategy:
      matrix:
        suite:
          - secure
          - unsecure
          - compat
          - EC
          - HA-secure
          - HA-unsecure
          - MR
          - misc
          - cert-rotation
      fail-fast: false
{code}

(Proposed to replace this with a script, getting list of suites dynamically in 
HDDS-9270.)

Each split executes test scripts under {{hadoop-ozone/dist/src/main/compose}} 
subdirectories, filtering by suite definition.  E.g. this one belongs to the EC 
split:

{code:title=https://github.com/apache/ozone/blob/5d5eb45d14952056faaf2150db273a2f152ff867/hadoop-ozone/dist/src/main/compose/ozone/test-ec.sh#L18}
#suite:EC
{code}

To create finer grained acceptance test splits, we should define new, distinct 
values for {{suite}}.  Since each test script belongs to only one suite, we can 
extract parts of the existing {{test.sh}} scripts into smaller {{test-xyz.sh}} 
scripts.  Try to keep these extracted scripts logically coherent.

> [perf] Finer grained acceptance test splits
> -------------------------------------------
>
>                 Key: HDDS-6463
>                 URL: https://issues.apache.org/jira/browse/HDDS-6463
>             Project: Apache Ozone
>          Issue Type: Sub-task
>          Components: build, test
>            Reporter: Attila Doroszlai
>            Assignee: Devesh Kumar Singh
>            Priority: Major
>
> GitHub Actions introduced the ability to "Re-run failed jobs", saving 
> resources when re-running failed CI checks.  [~smeng] suggested to extract 
> acceptance tests into finer-grained splits.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to