[
https://issues.apache.org/jira/browse/BEAM-12655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17418889#comment-17418889
]
Valentyn Tymofieiev commented on BEAM-12655:
--------------------------------------------
It maybe due to a change in pip version, which is used on the workers.
Workers should be executing a command that looks like
https://github.com/apache/beam/blob/b31a7ea6df96abfb8566d28921004ed54151ba2c/sdks/python/container/piputil.go#L52.
You could start a docker container instance used by the workers and check
whether this command still succeeds on your requirements file.
> Pip cannot install from git
> ---------------------------
>
> Key: BEAM-12655
> URL: https://issues.apache.org/jira/browse/BEAM-12655
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Affects Versions: 2.30.0, 2.31.0
> Environment: Dataflow
> Reporter: Piotr M
> Priority: P2
> Labels: dataflow, python, stale-P2
>
> I have a pipeline for GCP Dataflow.
> In this pipeline I install dependencies from requirements.txt not only using
> PyPI but also using links to github. Example link below:
> git+https://${GITHUB_TOKEN}@github.com/my-org/my-repo.git@commit_sha#egg=egg_name
> It was working flawlessly in apache-beam==2.16.0 but after upgrading to 2.31
> (also checked 2.30) I get following error in worker logs:
> ERROR: Error [Errno 2] No such file or directory: 'git': 'git' while
> executing command git clone -q 'https://****@github.com/my-org/my-repo.git'
> /tmp/pip-install-kwjqgr99/my-repo_87c34d2507fe456b892269fd4429a76b
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
