Matthias Baetens created BEAM-842:
-------------------------------------

             Summary: dependency.py: package not found when running on Windows
                 Key: BEAM-842
                 URL: https://issues.apache.org/jira/browse/BEAM-842
             Project: Beam
          Issue Type: Bug
          Components: sdk-py
    Affects Versions: 0.4.0-incubating
         Environment: Windows 10, Python 2.7.11
            Reporter: Matthias Baetens
            Assignee: Frances Perry
            Priority: Minor


When having splitting your pipeline into multiple files and configuring your 
project according to the Juliaset example 
(https://cloud.google.com/dataflow/pipelines/dependencies-python#multiple-file-dependencies),
 the Pipeline still crashes when using Windows.

This is caused by setuptools defaulting to a .zip on Windows, and the current 
Beam code looks for a .tar.gz (dependency.py, line 400). When changing this 
line to: output_files = glob.glob(os.path.join(temp_dir, '*.zip')), it works. 

Suggestion: checking the OS would probably solve this issue. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to