[
https://issues.apache.org/jira/browse/BEAM-2464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stas Levin updated BEAM-2464:
-----------------------------
Summary: Create.of(...) does not work as expected when spark-runner is
configured to streaming mode (was: Create.of(...) does not work as expected
when runner is configured to streaming mode)
> Create.of(...) does not work as expected when spark-runner is configured to
> streaming mode
> ------------------------------------------------------------------------------------------
>
> Key: BEAM-2464
> URL: https://issues.apache.org/jira/browse/BEAM-2464
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Affects Versions: 2.0.0
> Reporter: Stas Levin
> Assignee: Stas Levin
> Priority: Minor
>
> When the Spark runner is set to streaming mode, and the input {{PCollection}}
> is created via {{Create.of(...)}}, things do not work as expected.
> This happens due to the fact the {{EVALUATORS}} map in
> {{StreamingTransformTranslator}} does not have a matching
> {{TransformEvaluator}} for the {{Create.Values}} transform.
> I believe this can be fixed by employing a similar approach to the one used
> for translating {{CreateStream}}. In fact, it might be quite possible to move
> things around so that the translation of {{Create.of(..)}} uses
> {{CreateStream.of(...)}} under the hood.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
