[
https://issues.apache.org/jira/browse/BEAM-4768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bui Nguyen Thang updated BEAM-4768:
-----------------------------------
Description:
[https://beam.apache.org/documentation/sdks/python-streaming/]
{code:java}
{code}
??{{python -m apache_beam.examples.streaming_wordcount \ --input_topic
"projects/YOUR_PUBSUB_PROJECT_NAME/topics/YOUR_INPUT_TOPIC" \ --output_topic
"projects/YOUR_PUBSUB_PROJECT_NAME/topics/YOUR_OUTPUT_TOPIC" \ --streaming}}??
got the following error:
{code:java}
ERROR:root:Giving up after 4 attempts. WARNING:root:A task failed with
exception: Traceback (most recent call last): File
"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py",
line 162, in _run_module_as_main "__main__", fname, loader, pkg_name) File
"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py",
line 72, in _run_code exec code in run_globals File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/examples/streaming_wordcount.py",
line 98, in <module> run() File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/examples/streaming_wordcount.py",
line 93, in run result.wait_until_finish() File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/direct_runner.py",
line 421, in wait_until_finish self._executor.await_completion() File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
line 398, in await_completion self._executor.await_completion() File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
line 444, in await_completion six.reraise(t, v, tb) File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
line 341, in call finish_state) File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
line 381, in attempt_call result = evaluator.finish_bundle() File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/transform_evaluator.py",
line 305, in finish_bundle with self._source.reader() as reader: File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/io/gcp/pubsub.py",
line 283, in reader raise NotImplementedError NotImplementedError
When trying to run the streaming wordcount python sample from here:
{code}
Look like some method of pubsub io is not implemented yet.
Please help to advise,
Thanks
was:
When trying to run the streaming wordcount python sample from here:
[https://beam.apache.org/documentation/sdks/python-streaming/]
??{{python -m apache_beam.examples.streaming_wordcount \ --input_topic
"projects/YOUR_PUBSUB_PROJECT_NAME/topics/YOUR_INPUT_TOPIC" \ --output_topic
"projects/YOUR_PUBSUB_PROJECT_NAME/topics/YOUR_OUTPUT_TOPIC" \ --streaming}}??
got the following error:
??ERROR:root:Giving up after 4 attempts.??
??WARNING:root:A task failed with exception:??
??Traceback (most recent call last):??
?? File
"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py",
line 162, in _run_module_as_main??
?? "__main__", fname, loader, pkg_name)??
?? File
"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py",
line 72, in _run_code??
?? exec code in run_globals??
?? File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/examples/streaming_wordcount.py",
line 98, in <module>??
?? run()??
?? File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/examples/streaming_wordcount.py",
line 93, in run??
?? result.wait_until_finish()??
?? File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/direct_runner.py",
line 421, in wait_until_finish??
?? self._executor.await_completion()??
?? File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
line 398, in await_completion??
?? self._executor.await_completion()??
?? File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
line 444, in await_completion??
?? six.reraise(t, v, tb)??
?? File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
line 341, in call??
?? finish_state)??
?? File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
line 381, in attempt_call??
?? result = evaluator.finish_bundle()??
?? File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/transform_evaluator.py",
line 305, in finish_bundle??
?? with self._source.reader() as reader:??
?? File
"/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/io/gcp/pubsub.py",
line 283, in reader??
?? raise NotImplementedError??
??NotImplementedError??
Look like some method of pubsub io is not implemented yet.
Please help to advise,
Thanks
> Can not run Stream wordcount Python Sample
> ------------------------------------------
>
> Key: BEAM-4768
> URL: https://issues.apache.org/jira/browse/BEAM-4768
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Affects Versions: 2.5.0
> Environment: mac os
> Reporter: Bui Nguyen Thang
> Assignee: Ahmet Altay
> Priority: Blocker
>
> [https://beam.apache.org/documentation/sdks/python-streaming/]
> {code:java}
> {code}
> ??{{python -m apache_beam.examples.streaming_wordcount \ --input_topic
> "projects/YOUR_PUBSUB_PROJECT_NAME/topics/YOUR_INPUT_TOPIC" \ --output_topic
> "projects/YOUR_PUBSUB_PROJECT_NAME/topics/YOUR_OUTPUT_TOPIC" \ --streaming}}??
> got the following error:
> {code:java}
> ERROR:root:Giving up after 4 attempts. WARNING:root:A task failed with
> exception: Traceback (most recent call last): File
> "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py",
> line 162, in _run_module_as_main "__main__", fname, loader, pkg_name) File
> "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py",
> line 72, in _run_code exec code in run_globals File
> "/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/examples/streaming_wordcount.py",
> line 98, in <module> run() File
> "/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/examples/streaming_wordcount.py",
> line 93, in run result.wait_until_finish() File
> "/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/direct_runner.py",
> line 421, in wait_until_finish self._executor.await_completion() File
> "/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
> line 398, in await_completion self._executor.await_completion() File
> "/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
> line 444, in await_completion six.reraise(t, v, tb) File
> "/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
> line 341, in call finish_state) File
> "/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/executor.py",
> line 381, in attempt_call result = evaluator.finish_bundle() File
> "/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/runners/direct/transform_evaluator.py",
> line 305, in finish_bundle with self._source.reader() as reader: File
> "/Users/bob/Library/Python/2.7/lib/python/site-packages/apache_beam/io/gcp/pubsub.py",
> line 283, in reader raise NotImplementedError NotImplementedError
> When trying to run the streaming wordcount python sample from here:
> {code}
>
> Look like some method of pubsub io is not implemented yet.
> Please help to advise,
> Thanks
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
