Ankur Goenka created BEAM-10147:
-----------------------------------
Summary: Clean /tmp/dataflow-requirements-cache before downloading
the requirements from requirements.txt
Key: BEAM-10147
URL: https://issues.apache.org/jira/browse/BEAM-10147
Project: Beam
Issue Type: Bug
Components: runner-dataflow, sdk-py-core
Reporter: Ankur Goenka
when using requirements.txt with beam pipelines,
/tmp/dataflow-requirements-cache is not cleaned and all the new dependencies
are downloaded and then all the files in /tmp/dataflow-requirements-cache are
staged which is wasteful and unecessary.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
