[
https://issues.apache.org/jira/browse/BEAM-11418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Oliveira updated BEAM-11418:
-----------------------------------
Description:
Some of the test XLang transforms (CoGroupByKey, MultiInputOutput, and
Partition) fail on the Go SDK (using the Java Test Expansion Service). These
tests used to pass and started failing at some point for unknown reasons.
The failures tend to involve a ClassNotFound exception, like so:
{noformat}
RuntimeError: java.lang.IllegalArgumentException: unable to deserialize Custom
DoFn With Execution Info
at
org.apache.beam.sdk.util.SerializableUtils.deserializeFromByteArray(SerializableUtils.java:78)
at
org.apache.beam.runners.core.construction.ParDoTranslation.doFnWithExecutionInformationFromProto(ParDoTranslation.java:712)
at
org.apache.beam.runners.core.construction.ParDoTranslation.getDoFn(ParDoTranslation.java:363)
at
org.apache.beam.fn.harness.FnApiDoFnRunner.<init>(FnApiDoFnRunner.java:351)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$Factory.createRunnerForPTransform(FnApiDoFnRunner.java:183)
at
org.apache.beam.fn.harness.FnApiDoFnRunner$Factory.createRunnerForPTransform(FnApiDoFnRunner.java:157)
{...}
Caused by: java.lang.ClassNotFoundException:
org.apache.beam.sdk.testing.expansion.TestExpansionService$TestTransformRegistrar$PartitionBuilder
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
at java.lang.Class.forName0(Native Method)
{...}
{noformat}
Edit: This seems to be due to artifact staging issues. This bug has been
re-titled to be more accurate to the root cause.
was:Some of the test XLang transforms fail on the Go SDK (using the Java Test
Expansion Service). These tests used to pass and started failing at some point
for unknown reasons.
Summary: [Go XLang] ClassNotFoundException due to incorrect artifact
staging to x-lang environment. (was: Test XLang transforms failing in Go SDK:
CoGroupByKey, MultiInputOutput, and Partition)
> [Go XLang] ClassNotFoundException due to incorrect artifact staging to x-lang
> environment.
> ------------------------------------------------------------------------------------------
>
> Key: BEAM-11418
> URL: https://issues.apache.org/jira/browse/BEAM-11418
> Project: Beam
> Issue Type: Bug
> Components: cross-language, sdk-go
> Reporter: Daniel Oliveira
> Assignee: Daniel Oliveira
> Priority: P2
> Time Spent: 40m
> Remaining Estimate: 0h
>
> Some of the test XLang transforms (CoGroupByKey, MultiInputOutput, and
> Partition) fail on the Go SDK (using the Java Test Expansion Service). These
> tests used to pass and started failing at some point for unknown reasons.
> The failures tend to involve a ClassNotFound exception, like so:
> {noformat}
> RuntimeError: java.lang.IllegalArgumentException: unable to deserialize
> Custom DoFn With Execution Info
> at
> org.apache.beam.sdk.util.SerializableUtils.deserializeFromByteArray(SerializableUtils.java:78)
> at
> org.apache.beam.runners.core.construction.ParDoTranslation.doFnWithExecutionInformationFromProto(ParDoTranslation.java:712)
> at
> org.apache.beam.runners.core.construction.ParDoTranslation.getDoFn(ParDoTranslation.java:363)
> at
> org.apache.beam.fn.harness.FnApiDoFnRunner.<init>(FnApiDoFnRunner.java:351)
> at
> org.apache.beam.fn.harness.FnApiDoFnRunner$Factory.createRunnerForPTransform(FnApiDoFnRunner.java:183)
> at
> org.apache.beam.fn.harness.FnApiDoFnRunner$Factory.createRunnerForPTransform(FnApiDoFnRunner.java:157)
> {...}
> Caused by: java.lang.ClassNotFoundException:
> org.apache.beam.sdk.testing.expansion.TestExpansionService$TestTransformRegistrar$PartitionBuilder
> at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> at java.lang.Class.forName0(Native Method)
> {...}
> {noformat}
> Edit: This seems to be due to artifact staging issues. This bug has been
> re-titled to be more accurate to the root cause.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
