jkff commented on pull request #12571: URL: https://github.com/apache/beam/pull/12571#issuecomment-673689685
FWIW: I can reproduce this with the local Flink runner too: `python3 main.py --runner=FlinkRunner --environment_type=DOCKER --requirements_file=requirements.txt` for the main.py in the thread linked from JIRA - this gives me the same issue. Are there any tests running with these settings? Note that the issue reproduces only if there *are* any compressed artifacts to stage: e.g. for that main.py, it does not reproduce without a non-empty requirements.txt, because then the pipeline has zero artifacts. However, for my production pipeline, I've also seen it fail due to decompressing `workflow.tar.gz` but I'm not sure what controls whether or not that file is created. Maybe there already are some tests, which we can simply somehow force to have a `workflow.tar.gz`? ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
