Chamikara Madhusanka Jayalath created BEAM-12807:
----------------------------------------------------

             Summary: Java creates an incorrect pipeline proto when 
core-construction-java jar is not in the CLASSPATH
                 Key: BEAM-12807
                 URL: https://issues.apache.org/jira/browse/BEAM-12807
             Project: Beam
          Issue Type: Improvement
          Components: sdk-java-core
            Reporter: Chamikara Madhusanka Jayalath


Seems like Java ends up creating incorrect pipeline API proto segments when 
"core-construction-java" is not available in the system.

 

For example, this may create  a GBK transform without the URN. 

 

This can be reproduced by running the wordcount example in [1] after  removing 
the following dependency from the pom.xml file.

    <dependency>
      <groupId>org.apache.beam</groupId>
      <artifactId>beam-runners-core-construction-java</artifactId>
      <version>${beam.version}</version>
    </dependency>
 
Seems like this is because Java is unable to register corresponding 
XYZTranslation classes (for example [2]). 
 

I think we should fail here instead of generating default incorrect proto 
segments.

 

[1] [https://github.com/chamikaramj/multi-language-pipelines]

[2] 
[https://github.com/apache/beam/blob/master/runners/core-construction-java/src/main/java/org/apache/beam/runners/core/construction/GroupByKeyTranslation.java]

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to