[
https://issues.apache.org/jira/browse/BEAM-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16420719#comment-16420719
]
Thomas Weise edited comment on BEAM-2927 at 3/30/18 5:15 PM:
-------------------------------------------------------------
Here is the example and stack trace below:
{code:java}
with beam.Pipeline(runner=runner, options=pipeline_options) as p:
(p
| 'Create' >> beam.Create(['hello', 'world'])
#| 'Read' >>
ReadFromText("gs://dataflow-samples/shakespeare/kinglear.txt")
| 'Split' >> (beam.FlatMap(lambda x: re.findall(r'[A-Za-z\']+', x))
.with_output_types(unicode))
#| 'PairWithOne' >> beam.Map(lambda x: (x, 1))
#| 'GroupAndSum' >> beam.CombinePerKey(sum)
#| beam.Map(lambda x: logging.info("Got %s", x) or (x, 1))
){code}
{code:java}
2018/03/30 16:26:46 Initializing python harness: /opt/apache/beam/boot
--id=-123 --logging_endpoint=docker.for.mac.host.internal:52193
--artifact_endpoint=docker.for.mac.host.internal:52194
--provision_endpoint=docker.for.mac.host.internal:52195
--control_endpoint=docker.for.mac.host.internal:52191
--semi_persist_dir=/tmp/semi_persistent_dir2308232882860594197
2018/03/30 16:26:46 Executing: python -m
apache_beam.runners.worker.sdk_worker_main
Exception in thread read_state:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/local/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File
"/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 262, in pull_responses
for response in responses:
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 350, in
next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 341, in
_next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with
(StatusCode.UNIMPLEMENTED, Method not found:
org.apache.beam.model.fn_execution.v1.BeamFnState/State)>{code}
was (Author: thw):
Note that I run into this even though the pipeline does not use side inputs.
{code:java}
with beam.Pipeline(runner=runner, options=pipeline_options) as p:
(p
| 'Create' >> beam.Create(['hello', 'world'])
#| 'Read' >>
ReadFromText("gs://dataflow-samples/shakespeare/kinglear.txt")
| 'Split' >> (beam.FlatMap(lambda x: re.findall(r'[A-Za-z\']+', x))
.with_output_types(unicode))
#| 'PairWithOne' >> beam.Map(lambda x: (x, 1))
#| 'GroupAndSum' >> beam.CombinePerKey(sum)
#| beam.Map(lambda x: logging.info("Got %s", x) or (x, 1))
){code}
{code:java}
2018/03/30 16:26:46 Initializing python harness: /opt/apache/beam/boot
--id=-123 --logging_endpoint=docker.for.mac.host.internal:52193
--artifact_endpoint=docker.for.mac.host.internal:52194
--provision_endpoint=docker.for.mac.host.internal:52195
--control_endpoint=docker.for.mac.host.internal:52191
--semi_persist_dir=/tmp/semi_persistent_dir2308232882860594197
2018/03/30 16:26:46 Executing: python -m
apache_beam.runners.worker.sdk_worker_main
Exception in thread read_state:
Traceback (most recent call last):
File "/usr/local/lib/python2.7/threading.py", line 801, in __bootstrap_inner
self.run()
File "/usr/local/lib/python2.7/threading.py", line 754, in run
self.__target(*self.__args, **self.__kwargs)
File
"/usr/local/lib/python2.7/site-packages/apache_beam/runners/worker/sdk_worker.py",
line 262, in pull_responses
for response in responses:
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 350, in
next
return self._next()
File "/usr/local/lib/python2.7/site-packages/grpc/_channel.py", line 341, in
_next
raise self
_Rendezvous: <_Rendezvous of RPC that terminated with
(StatusCode.UNIMPLEMENTED, Method not found:
org.apache.beam.model.fn_execution.v1.BeamFnState/State)>{code}
> Python SDK support for portable side input
> ------------------------------------------
>
> Key: BEAM-2927
> URL: https://issues.apache.org/jira/browse/BEAM-2927
> Project: Beam
> Issue Type: Sub-task
> Components: sdk-py-core
> Reporter: Henning Rohde
> Assignee: Robert Bradshaw
> Priority: Major
> Labels: portability
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
