[
https://issues.apache.org/jira/browse/BEAM-5953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679099#comment-16679099
]
Mark Liu edited comment on BEAM-5953 at 11/8/18 11:56 PM:
----------------------------------------------------------
Thanks for the suggestions. Here are the steps to reproduce the problem:
- ./gradlew -p sdks/python/containers/py3 docker
- Push it to GCR.
- Setup virtualenv in python 3 (my version is 3.5)
- export BEAM_EXPERIMENTAL_PY3=1
- Install GCP dependency and build tar ball
- Run:
{code}
python -m apache_beam.examples.wordcount \
--input gs://dataflow-samples/shakespeare/kinglear.txt \
--output gs://$USER-test/tmp \
--runner DataflowRunner \
--project google.com:clouddfe \
--temp_location gs://$USER-test/temp-it \
--worker_harness_container_image
us.gcr.io/google.com/clouddfe/markliu-py3:latest \
--experiment beam_fn_api \
--sdk_location dist/apache-beam-2.9.0.dev0.tar.gz
{code}
was (Author: markflyhigh):
Thanks for the suggestions. Here are the steps to reproduce the problem:
- ./gradlew -p sdks/python/containers/py3 docker
- Push it to GCR.
- Setup virtualenv in python 3 (my version is 3.5)
- export BEAM_EXPERIMENTAL_PY3=1
- Install GCP dependency and build tar ball
- Run:
{code}
python -m apache_beam.examples.wordcount \
--input gs://dataflow-samples/shakespeare/kinglear.txt \
--output gs://$USER-test/tmp \
--runner DataflowRunner \
--project google.com:clouddfe \
--temp_location gs://$USER-test/temp-it \
--worker_harness_container_image
us.gcr.io/google.com/clouddfe/markliu-py3:latest \
--experiment beam_fn_api \
--sdk_location dist/apache-beam-2.9.0.dev0.tar.gz
{code}
> Support DataflowRunner on Python 3
> ----------------------------------
>
> Key: BEAM-5953
> URL: https://issues.apache.org/jira/browse/BEAM-5953
> Project: Beam
> Issue Type: Sub-task
> Components: sdk-py-core
> Reporter: Mark Liu
> Assignee: Mark Liu
> Priority: Major
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
