Luke Cwik created BEAM-9652:
-------------------------------
Summary: BigQueryIO MultiPartitionsWriteTables fails with
ClassCastException: java.lang.Object cannot be cast to
org.apache.beam.sdk.values.KV
Key: BEAM-9652
URL: https://issues.apache.org/jira/browse/BEAM-9652
Project: Beam
Issue Type: Bug
Components: io-java-gcp
Affects Versions: 2.19.0
Reporter: Luke Cwik
Assignee: Luke Cwik
Fix For: 2.21.0
It looks like the coder inference fails for BatchLoad.writeTempTables and
selects an avro coder:
{code:java}
object_value: <
type: "org.apache.beam.sdk.coders.AvroCoder"
parameters: <
name: "type"
value: <
string_value: "java.lang.Object"
>
>
parameters: <
name: "schema"
value: <
string_value:
"{\"type\":\"record\",\"name\":\"Object\",\"namespace\":\"java.lang\",\"fields\":[]}"
>
>
{code}
Full exception:
{code:java}
exception: "java.lang.ClassCastException: java.lang.Object cannot be cast to
org.apache.beam.sdk.values.KV at
org.apache.beam.sdk.coders.KvCoder.registerByteSizeObserver(KvCoder.java:36) at
org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:191)
at
org.apache.beam.sdk.coders.IterableLikeCoder.registerByteSizeObserver(IterableLikeCoder.java:60)
at
org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.registerByteSizeObserver(WindowedValue.java:623)
at
org.apache.beam.sdk.util.WindowedValue$FullWindowedValueCoder.registerByteSizeObserver(WindowedValue.java:539)
at
org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$ElementByteSizeObservableCoder.registerByteSizeObserver(IntrinsicMapTaskExecutorFactory.java:400)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
