[
https://issues.apache.org/jira/browse/BEAM-4292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16518772#comment-16518772
]
James Wilson commented on BEAM-4292:
------------------------------------
So I am running into some issues with the first pipeline which is reading the
King Lear text and passing a `PCollection` of `[]byte` to the pubsubio.Write
function.
It fails for both *batch* and *streaming*. For *batch* it is failing when it
is trying to cast form a batch mode execution context to a streaming mode
execution context. I guess this makes sense, but it leave me with one big
question. What determines *batch* vs *streaming*, the input or output? I
figured this would be batch since our input is one file. The next pipeline
that would *read* from PubSub would then be a streaming pipeline since it will
stream each line in.
{color:#FF0000}Workflow failed. Causes:
S01:textio.Read/beam.createFn+textio.Read/textio.expandFn+textio.Read/textio.readFn+main.encodeFn+pubsubio.Write/WRITE
failed.,{color}
When I run in *streaming* mode the results are worse. It cannot render the
graph on Dataflow and it fails in about 7 seconds with a
{color:#FF0000}Workflow failed. Causes: Unknown message code.{color}
> Add streaming wordcount example
> -------------------------------
>
> Key: BEAM-4292
> URL: https://issues.apache.org/jira/browse/BEAM-4292
> Project: Beam
> Issue Type: Improvement
> Components: sdk-go
> Reporter: Henning Rohde
> Assignee: James Wilson
> Priority: Major
>
> It is referenced on the Beam website as part of the Wordcount progression:
> https://beam.apache.org/get-started/wordcount-example/#streamingwordcount-example
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)