Matthias Baetens created BEAM-842:
-------------------------------------
Summary: dependency.py: package not found when running on Windows
Key: BEAM-842
URL: https://issues.apache.org/jira/browse/BEAM-842
Project: Beam
Issue Type: Bug
Components: sdk-py
Affects Versions: 0.4.0-incubating
Environment: Windows 10, Python 2.7.11
Reporter: Matthias Baetens
Assignee: Frances Perry
Priority: Minor
When having splitting your pipeline into multiple files and configuring your
project according to the Juliaset example
(https://cloud.google.com/dataflow/pipelines/dependencies-python#multiple-file-dependencies),
the Pipeline still crashes when using Windows.
This is caused by setuptools defaulting to a .zip on Windows, and the current
Beam code looks for a .tar.gz (dependency.py, line 400). When changing this
line to: output_files = glob.glob(os.path.join(temp_dir, '*.zip')), it works.
Suggestion: checking the OS would probably solve this issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)