[
https://issues.apache.org/jira/browse/BEAM-12807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405316#comment-17405316
]
Chamikara Madhusanka Jayalath commented on BEAM-12807:
------------------------------------------------------
CCing few folks who might have context.
[~lcwik] [~kenn] [~robertwb] [~lostluck]
> Java creates an incorrect pipeline proto when core-construction-java jar is
> not in the CLASSPATH
> ------------------------------------------------------------------------------------------------
>
> Key: BEAM-12807
> URL: https://issues.apache.org/jira/browse/BEAM-12807
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-core
> Reporter: Chamikara Madhusanka Jayalath
> Priority: P2
>
> Seems like Java ends up creating incorrect pipeline API proto segments when
> "core-construction-java" is not available in the system.
>
> For example, this may create a GBK transform without the URN.
>
> This can be reproduced by running the wordcount example in [1] after
> removing the following dependency from the pom.xml file.
> <dependency>
> <groupId>org.apache.beam</groupId>
> <artifactId>beam-runners-core-construction-java</artifactId>
> <version>${beam.version}</version>
> </dependency>
>
> Seems like this is because Java is unable to register corresponding
> XYZTranslation classes (for example [2]).
>
> I think we should fail here instead of generating default incorrect proto
> segments.
>
> [1] [https://github.com/chamikaramj/multi-language-pipelines]
> [2]
> [https://github.com/apache/beam/blob/master/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/GroupByKeyTranslation.java]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)