[
https://issues.apache.org/jira/browse/BEAM-4689?focusedWorklogId=117913&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117913
]
ASF GitHub Bot logged work on BEAM-4689:
----------------------------------------
Author: ASF GitHub Bot
Created on: 30/Jun/18 21:14
Start Date: 30/Jun/18 21:14
Worklog Time Spent: 10m
Work Description: kennknowles commented on issue #5834: [BEAM-4689]
Reverts change of SDF key type
URL: https://github.com/apache/beam/pull/5834#issuecomment-401566663
FWIW I think you may have reverted the unrelated parts locally and not
pushed them. I get compile failures in the example locally; not sure how
precommit was/is stable.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 117913)
Time Spent: 2h 10m (was: 2h)
> Dataflow cannot deserialize SplittableParDo DoFns
> -------------------------------------------------
>
> Key: BEAM-4689
> URL: https://issues.apache.org/jira/browse/BEAM-4689
> Project: Beam
> Issue Type: New Feature
> Components: runner-dataflow
> Reporter: Kenneth Knowles
> Assignee: Eugene Kirpichov
> Priority: Blocker
> Fix For: 2.6.0
>
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> The Dataflow postcommit is broken in a way that seems real and user-impacting:
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/testReport/junit/org.apache.beam.sdk.transforms/SplittableDoFnTest/testSideInput/
> {code}
> Caused by: java.lang.IllegalArgumentException: unable to deserialize
> Serialized DoFnInfo
> ...
> Caused by: java.io.InvalidClassException:
> org.apache.beam.runners.core.construction.SplittableParDo$RandomUniqueKeyFn;
> local class incompatible: stream classdesc serialVersionUID =
> 6068396661487412884, local class serialVersionUID = -617521663543732196
> {code}
> This means that the worker is using a version of the class from its own
> classpath, not the version from the user's staged pipeline. It implies that
> the worker is not shading runners-core-construction. Because that is where a
> ton of utility DoFns live, it is critical that it be shaded.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
