Valentyn Tymofieiev created BEAM-7714:
-----------------------------------------
Summary: Allow retries of PostCommit test suites per Python version
Key: BEAM-7714
URL: https://issues.apache.org/jira/browse/BEAM-7714
Project: Beam
Issue Type: Sub-task
Components: testing
Reporter: Valentyn Tymofieiev
Assignee: Mark Liu
Currently Python PostCommit test executes 4 tests running the set of tests
under Python 2.7, 3.5-3.7. When test execution fails due to a flake,
contributors have to rerun the whole suite. Having a possibility to re-run test
suite only for a particular version of Python would make it easier to receive a
green run.
Some considerations:
- increasing number of Jenkins job will increase the number of slots required
by postcommit, this will slow down the queue, unless we increase number of
slots. We can investigate utilization of Jenkins workers to see if slot
increase is advisable.
- we could introduce phrase-only suites "Run Python 3.7 PostCommits", that will
be separate jenkins jobs (1 suite, 1 slot) in addition to current jobs.
phrase-only suites will not be triggered on the PR but will be triggered
manually when users want to re-run tests for particular version. It may cause
confusion on a PR though, since PR author will have to explain to reviewers
that Python 3 Postcommit suite failed, but only 3.6 portion failed, and I
re-ran Py3.6 portion only in this separate jenkins Job and it passed, so PR is
safe to merge.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
