Daniel Oliveira created BEAM-9745:
-------------------------------------
Summary: [beam_PostCommit_Java_PortabilityApi] Various GCP IO
tests failing, unable to deserialize Custom DoFns and Custom Coders.
Key: BEAM-9745
URL: https://issues.apache.org/jira/browse/BEAM-9745
Project: Beam
Issue Type: Bug
Components: io-java-gcp, java-fn-execution, sdk-java-harness,
test-failures
Reporter: Daniel Oliveira
Assignee: Daniel Oliveira
_Use this form to file an issue for test failure:_
* [Jenkins
Job|https://builds.apache.org/job/beam_PostCommit_Java_PortabilityApi/4657/]
* [Gradle Build Scan|https://scans.gradle.com/s/c3izncsa4u24k/tests/by-project]
Initial investigation:
The bug appears to be popping up on BigQuery tests mostly, but also a BigTable
and a Datastore test.
Here's an example stacktrace of the two errors, showing _only_ the error
messages themselves. Source:
[https://scans.gradle.com/s/c3izncsa4u24k/tests/efn4wciuamvqq-ccxt3jvofvqbe]
{noformat}
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error
received from SDK harness for instruction -191:
java.lang.IllegalArgumentException: unable to deserialize Custom DoFn With
Execution Info
...
Caused by: java.lang.ClassNotFoundException:
org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$3
...
Caused by: java.lang.RuntimeException: Error received from SDK harness for
instruction -191: java.lang.IllegalArgumentException: unable to deserialize
Custom DoFn With Execution Info
...
Caused by: java.lang.ClassNotFoundException:
org.apache.beam.sdk.io.gcp.bigquery.BatchLoads$3
java.util.concurrent.ExecutionException: java.lang.RuntimeException: Error
received from SDK harness for instruction -206:
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.IllegalArgumentException: unable to deserialize Custom Coder Bytes
...
Caused by:
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.IllegalArgumentException: unable to deserialize Custom Coder Bytes
...
Caused by: java.lang.IllegalArgumentException: unable to deserialize Custom
Coder Bytes
...
Caused by: java.lang.ClassNotFoundException:
org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder
...
Caused by: java.lang.RuntimeException: Error received from SDK harness for
instruction -206:
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.IllegalArgumentException: unable to deserialize Custom Coder Bytes
...
Caused by:
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.UncheckedExecutionException:
java.lang.IllegalArgumentException: unable to deserialize Custom Coder Bytes
...
Caused by: java.lang.IllegalArgumentException: unable to deserialize Custom
Coder Bytes
...
Caused by: java.lang.ClassNotFoundException:
org.apache.beam.sdk.io.gcp.bigquery.TableRowJsonCoder
...
{noformat}
----
_After you've filled out the above details, please [assign the issue to an
individual|https://beam.apache.org/contribute/postcommits-guides/index.html#find_specialist].
Assignee should [treat test failures as
high-priority|https://beam.apache.org/contribute/postcommits-policies/#assigned-failing-test],
helping to fix the issue or find a more appropriate owner. See [Apache Beam
Post-Commit Policies|https://beam.apache.org/contribute/postcommits-policies]._
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
