[
https://issues.apache.org/jira/browse/BEAM-7714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Work on BEAM-7714 stopped by Valentyn Tymofieiev.
-------------------------------------------------
> Allow retries of PostCommit test suites per Python version
> ----------------------------------------------------------
>
> Key: BEAM-7714
> URL: https://issues.apache.org/jira/browse/BEAM-7714
> Project: Beam
> Issue Type: Sub-task
> Components: testing
> Reporter: Valentyn Tymofieiev
> Assignee: Valentyn Tymofieiev
> Priority: Blocker
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Currently Python PostCommit test executes 4 tests running the set of tests
> under Python 2.7, 3.5-3.7. When test execution fails due to a flake,
> contributors have to rerun the whole suite. Having a possibility to re-run
> test suite only for a particular version of Python would make it easier to
> receive a green run.
> Some considerations:
> - increasing number of Jenkins job will increase the number of slots
> required by postcommit, this will slow down the queue, unless we increase
> number of slots. We can investigate utilization of Jenkins workers to see if
> slot increase is advisable.
> - we could introduce phrase-only suites "Run Python 3.7 PostCommits", that
> will be separate jenkins jobs (1 suite, 1 slot) in addition to current jobs.
> phrase-only suites will not be triggered on the PR but will be triggered
> manually when users want to re-run tests for particular version. It may cause
> confusion on a PR though, since PR author will have to explain to reviewers
> that Python 3 Postcommit suite failed, but only 3.6 portion failed, and I
> re-ran Py3.6 portion only in this separate jenkins Job and it passed, so PR
> is safe to merge.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
