Valentyn Tymofieiev created BEAM-8900:
-----------------------------------------
Summary: Python SDK should stage only up-to-date versions of
pipeline dependencies defined by requirements file.
Key: BEAM-8900
URL: https://issues.apache.org/jira/browse/BEAM-8900
Project: Beam
Issue Type: Bug
Components: sdk-py-core
Reporter: Valentyn Tymofieiev
When staging pipeline dependencies specified in requirements.txt file and
transitive deps, we stage entire content of requirements-cache directory on
user's machine, which may include dependencies that were cached a while ago and
are no longer needed. See [1] for discussion and some ideas how we can avoid
staging packages we don't need.
[1]
https://lists.apache.org/thread.html/f99820489026a46160505ea9a4c8c4a0eabe8649143c1ee22b7088aa%40%3Cdev.beam.apache.org%3E
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
