[
https://issues.apache.org/jira/browse/BEAM-5058?focusedWorklogId=160931&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-160931
]
ASF GitHub Bot logged work on BEAM-5058:
----------------------------------------
Author: ASF GitHub Bot
Created on: 31/Oct/18 00:01
Start Date: 31/Oct/18 00:01
Worklog Time Spent: 10m
Work Description: udim commented on issue #6707: [BEAM-5058] Parallelize
Python Precommit and add basic ITs
URL: https://github.com/apache/beam/pull/6707#issuecomment-434514170
`pip install --user` isn't safe to use concurrently.
I'm not sure why you're getting the error you're currently seeing, but
running `virtualenv` concurrently on the same path is not a good idea.
I don't agree with redefining the tasks setupVirtualenv, sdist,
installGcpTest, and cleanPython for every sub-project. This allows for running
them more than once. All 4 tasks above should only be run once during a gradle
invocation, and some of them give undefined results if run concurrently.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 160931)
Time Spent: 2.5h (was: 2h 20m)
> Python precommits should run E2E tests
> --------------------------------------
>
> Key: BEAM-5058
> URL: https://issues.apache.org/jira/browse/BEAM-5058
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core, testing
> Reporter: Udi Meiri
> Assignee: Mark Liu
> Priority: Major
> Time Spent: 2.5h
> Remaining Estimate: 0h
>
> According to [https://beam.apache.org/contribute/testing/] (which I'm working
> on), end-to-end tests should be run in precommit on each combination of
> \{batch, streaming}x\{SDK language}x\{supported runner}.
> At least 2 tests need to be added to Python's precommit: wordcount and
> wordcount_streaming on Dataflow, and possibly on other supported runners
> (direct runner and new runners plz).
> These tests should be configured to run from a Gradle sub-project, so that
> they're run in parallel to the unit tests.
> Example that parallelizes Java precommit integration tests:
> [https://github.com/apache/beam/pull/5731]
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
