[
https://issues.apache.org/jira/browse/BEAM-11864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kenneth Knowles updated BEAM-11864:
-----------------------------------
Issue Type: Bug (was: Improvement)
> NPE when registering fromRowFunction
> ------------------------------------
>
> Key: BEAM-11864
> URL: https://issues.apache.org/jira/browse/BEAM-11864
> Project: Beam
> Issue Type: Bug
> Components: runner-dataflow
> Reporter: Fokko Driesprong
> Assignee: Fokko Driesprong
> Priority: P1
> Fix For: 2.29.0
>
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> When registering multiple coders, it will produce a NPE when checking if the
> fromRowFunction is already registered:
> ```
> [WARNING]
> java.lang.NullPointerException
> at org.apache.beam.sdk.schemas.utils.AvroUtils$RowToGenericRecordFn.equals
> (AvroUtils.java:559)
> at org.apache.beam.sdk.schemas.SchemaCoder.equals (SchemaCoder.java:208)
> at
> org.apache.beam.vendor.guava.v26_0_jre.com.google.common.base.Objects.equal
> (Objects.java:52)
> at
> org.apache.beam.vendor.guava.v26_0_jre.com.google.common.collect.HashBiMap.seekByKey
> (HashBiMap.java:224)
> at
> org.apache.beam.vendor.guava.v26_0_jre.com.google.common.collect.HashBiMap.get
> (HashBiMap.java:254)
> at org.apache.beam.runners.core.construction.SdkComponents.registerCoder
> (SdkComponents.java:265)
> at org.apache.beam.runners.core.construction.PCollectionTranslation.toProto
> (PCollectionTranslation.java:35)
> at
> org.apache.beam.runners.core.construction.SdkComponents.registerPCollection
> (SdkComponents.java:227)
> at
> org.apache.beam.runners.core.construction.PTransformTranslation.translateAppliedPTransform
> (PTransformTranslation.java:479)
> at
> org.apache.beam.runners.core.construction.PTransformTranslation$KnownTransformPayloadTranslator.translate
> (PTransformTranslation.java:424)
> at org.apache.beam.runners.core.construction.PTransformTranslation.toProto
> (PTransformTranslation.java:239)
> at
> org.apache.beam.runners.core.construction.SdkComponents.registerPTransform
> (SdkComponents.java:175)
> at
> org.apache.beam.runners.core.construction.PipelineTranslation$1.visitPrimitiveTransform
> (PipelineTranslation.java:87)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
> (TransformHierarchy.java:587)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit
> (TransformHierarchy.java:579)
> at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$500
> (TransformHierarchy.java:239)
> at org.apache.beam.sdk.runners.TransformHierarchy.visit
> (TransformHierarchy.java:213)
> at org.apache.beam.sdk.Pipeline.traverseTopologically (Pipeline.java:468)
> at org.apache.beam.runners.core.construction.PipelineTranslation.toProto
> (PipelineTranslation.java:59)
> at org.apache.beam.runners.dataflow.DataflowRunner.run
> (DataflowRunner.java:933)
> at org.apache.beam.runners.dataflow.DataflowRunner.run
> (DataflowRunner.java:196)
> at org.apache.beam.sdk.Pipeline.run (Pipeline.java:322)
> at ....PubsubToBigQuery.main (PubsubToBigQuery.java:98)
> at sun.reflect.NativeMethodAccessorImpl.invoke0 (Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke
> (NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke
> (DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke (Method.java:498)
> at org.codehaus.mojo.exec.ExecJavaMojo$1.run (ExecJavaMojo.java:282)
> at java.lang.Thread.run (Thread.java:748)
> ```
> This is because when you register a GenericRecord, the schema will be null,
> resulting in the NPE above.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
