[
https://issues.apache.org/jira/browse/BEAM-4689?focusedWorklogId=117674&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117674
]
ASF GitHub Bot logged work on BEAM-4689:
----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Jun/18 23:46
Start Date: 29/Jun/18 23:46
Worklog Time Spent: 10m
Work Description: jkff commented on issue #5834: [BEAM-4689] Reverts
change of SDF key type
URL: https://github.com/apache/beam/pull/5834#issuecomment-401499906
Dataflow SDF tests passed (looking at console output in the link above), and
the only error in the Java precommit was a compile error in Apex runner - I'm
going to merge this after the Java precommit turns green.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 117674)
Time Spent: 1h 40m (was: 1.5h)
> Dataflow cannot deserialize SplittableParDo DoFns
> -------------------------------------------------
>
> Key: BEAM-4689
> URL: https://issues.apache.org/jira/browse/BEAM-4689
> Project: Beam
> Issue Type: New Feature
> Components: runner-dataflow
> Reporter: Kenneth Knowles
> Assignee: Eugene Kirpichov
> Priority: Blocker
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> The Dataflow postcommit is broken in a way that seems real and user-impacting:
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/testReport/junit/org.apache.beam.sdk.transforms/SplittableDoFnTest/testSideInput/
> {code}
> Caused by: java.lang.IllegalArgumentException: unable to deserialize
> Serialized DoFnInfo
> ...
> Caused by: java.io.InvalidClassException:
> org.apache.beam.runners.core.construction.SplittableParDo$RandomUniqueKeyFn;
> local class incompatible: stream classdesc serialVersionUID =
> 6068396661487412884, local class serialVersionUID = -617521663543732196
> {code}
> This means that the worker is using a version of the class from its own
> classpath, not the version from the user's staged pipeline. It implies that
> the worker is not shading runners-core-construction. Because that is where a
> ton of utility DoFns live, it is critical that it be shaded.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
