[ 
https://issues.apache.org/jira/browse/BEAM-12807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405316#comment-17405316
 ] 

Chamikara Madhusanka Jayalath commented on BEAM-12807:
------------------------------------------------------

CCing few folks who might have context.

 

[~lcwik] [~kenn] [~robertwb] [~lostluck]

> Java creates an incorrect pipeline proto when core-construction-java jar is 
> not in the CLASSPATH
> ------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-12807
>                 URL: https://issues.apache.org/jira/browse/BEAM-12807
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-java-core
>            Reporter: Chamikara Madhusanka Jayalath
>            Priority: P2
>
> Seems like Java ends up creating incorrect pipeline API proto segments when 
> "core-construction-java" is not available in the system.
>  
> For example, this may create  a GBK transform without the URN. 
>  
> This can be reproduced by running the wordcount example in [1] after  
> removing the following dependency from the pom.xml file.
>     <dependency>
>       <groupId>org.apache.beam</groupId>
>       <artifactId>beam-runners-core-construction-java</artifactId>
>       <version>${beam.version}</version>
>     </dependency>
>  
> Seems like this is because Java is unable to register corresponding 
> XYZTranslation classes (for example [2]). 
>  
> I think we should fail here instead of generating default incorrect proto 
> segments.
>  
> [1] [https://github.com/chamikaramj/multi-language-pipelines]
> [2] 
> [https://github.com/apache/beam/blob/master/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/GroupByKeyTranslation.java]
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to