[
https://issues.apache.org/jira/browse/BEAM-4742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ryan Williams updated BEAM-4742:
--------------------------------
Description:
I hit a couple snags [running the portable wordcount
example|https://github.com/apache/beam/blob/997ee3afe74483ae44e2dcb32ca0e24876129cd9/sdks/python/build.gradle#L200-L214]:
* -[the default docker image is hard-coded to a bintray
URL|https://github.com/apache/beam/blob/997ee3afe74483ae44e2dcb32ca0e24876129cd9/sdks/python/apache_beam/runners/portability/portable_runner.py#L60-L68],
but I published my image to Docker Hub- I missed that [there's already a
pipeline option for
this|https://github.com/apache/beam/pull/5902#discussion_r201071859]! Thanks
[~lcwik]
* the default output path is in a temporary directory that doesn't exist at
the time of the {{open}} call, so I got {{IOError: [Errno 2] No such file or
directory}}
I'll send a PR with fixes to each of these shortly.
I've also not found where to observe output from successfully running the
example.
was:
I hit a couple snags [running the portable wordcount
example|https://github.com/apache/beam/blob/997ee3afe74483ae44e2dcb32ca0e24876129cd9/sdks/python/build.gradle#L200-L214]:
* [the default docker image is hard-coded to a bintray
URL|https://github.com/apache/beam/blob/997ee3afe74483ae44e2dcb32ca0e24876129cd9/sdks/python/apache_beam/runners/portability/portable_runner.py#L60-L68],
but I published my image to Docker Hub
* the default output path is in a temporary directory that doesn't exist at
the time of the {{open}} call, so I got {{IOError: [Errno 2] No such file or
directory}}
I'll send a PR with fixes to each of these shortly.
I've also not found where to observe output from successfully running the
example.
> Allow custom docker-image in portable wordcount example
> -------------------------------------------------------
>
> Key: BEAM-4742
> URL: https://issues.apache.org/jira/browse/BEAM-4742
> Project: Beam
> Issue Type: Improvement
> Components: examples-python
> Affects Versions: 2.5.0
> Reporter: Ryan Williams
> Assignee: Ryan Williams
> Priority: Minor
> Time Spent: 50m
> Remaining Estimate: 0h
>
> I hit a couple snags [running the portable wordcount
> example|https://github.com/apache/beam/blob/997ee3afe74483ae44e2dcb32ca0e24876129cd9/sdks/python/build.gradle#L200-L214]:
> * -[the default docker image is hard-coded to a bintray
> URL|https://github.com/apache/beam/blob/997ee3afe74483ae44e2dcb32ca0e24876129cd9/sdks/python/apache_beam/runners/portability/portable_runner.py#L60-L68],
> but I published my image to Docker Hub- I missed that [there's already a
> pipeline option for
> this|https://github.com/apache/beam/pull/5902#discussion_r201071859]! Thanks
> [~lcwik]
> * the default output path is in a temporary directory that doesn't exist at
> the time of the {{open}} call, so I got {{IOError: [Errno 2] No such file or
> directory}}
> I'll send a PR with fixes to each of these shortly.
> I've also not found where to observe output from successfully running the
> example.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)