Using external python packges in pipeline

2017-08-15 Thread shen yu
Hi, I'm using apache-beam python sdk for running pipelines. How do I
install 3rd party packages and use them in my pipeline? I always get
ImportError: No module named ... Do I have to create a template and specify
staging_location, temp_location... in order to use external packages?
(right now I'm using Google cloud shell to run pipelines and install
packages by running pip install)

p.s. I'm not sure if this is the right place to ask platform-specific
(Google cloud Dataflow) questions?

Thanks in advance

youxun


Slack channel

2017-08-15 Thread shen yu
Hi, I'd like to join the Slack channel for Apache Beam. I work at Klook and
would like to get involved in the Apache Beam community. My email is
you...@klook.com