[
https://issues.apache.org/jira/browse/BEAM-3364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Udi Meiri closed BEAM-3364.
---------------------------
Resolution: Won't Fix
Fix Version/s: Not applicable
> Use multiprocess nose plugin to improve unit test run time
> ----------------------------------------------------------
>
> Key: BEAM-3364
> URL: https://issues.apache.org/jira/browse/BEAM-3364
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core, testing
> Reporter: Udi Meiri
> Priority: Minor
> Fix For: Not applicable
>
>
> The multiprocess plugin is installed by default. You can try it out by
> running:
> nosetests --processes 8 --process-timeout 60
> The running time is reduced from ~3m30s to ~30s on my workstation, but with
> some tests reporting errors.
> Errors can be avoided by disabling multiprocess for certain classes by
> setting this global in the test file:
> {code}
> _multiprocess_ = False # Disable nosetests multiprocess plugin.
> {code}
> The problem is that failures are flaky, so repeated runs are required to
> verify we're not adding any new flakes by enabling multiprocess.
> Alternatively, we could try fixing the tests to make them pass.
> Setting up multiprocess runs is done by adding these lines to the bottom of
> setup.cfg:
> {code}
> # Run tests in multiple processes for shorter overall running time.
> processes=8
> # This timeout only applies to multiprocess runs. The default is 10 seconds.
> process-timeout=60
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)