[
https://issues.apache.org/jira/browse/BEAM-4689?focusedWorklogId=117565&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-117565
]
ASF GitHub Bot logged work on BEAM-4689:
----------------------------------------
Author: ASF GitHub Bot
Created on: 29/Jun/18 19:48
Start Date: 29/Jun/18 19:48
Worklog Time Spent: 10m
Work Description: lukecwik commented on a change in pull request #5834:
[BEAM-4689] Reverts change of SDF key type
URL: https://github.com/apache/beam/pull/5834#discussion_r199263556
##########
File path:
examples/java/src/main/java/org/apache/beam/examples/MinimalWordCount.java
##########
@@ -58,63 +57,28 @@
public class MinimalWordCount {
public static void main(String[] args) {
-
- // Create a PipelineOptions object. This object lets us set various
execution
- // options for our pipeline, such as the runner you wish to use. This
example
- // will run with the DirectRunner by default, based on the class path
configured
- // in its dependencies.
PipelineOptions options = PipelineOptionsFactory.create();
-
- // In order to run your pipeline, you need to make following runner
specific changes:
- //
Review comment:
I don't think you intended to make this change.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 117565)
Time Spent: 0.5h (was: 20m)
> Dataflow cannot deserialize SplittableParDo DoFns
> -------------------------------------------------
>
> Key: BEAM-4689
> URL: https://issues.apache.org/jira/browse/BEAM-4689
> Project: Beam
> Issue Type: New Feature
> Components: runner-dataflow
> Reporter: Kenneth Knowles
> Assignee: Eugene Kirpichov
> Priority: Blocker
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> The Dataflow postcommit is broken in a way that seems real and user-impacting:
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/lastCompletedBuild/testReport/junit/org.apache.beam.sdk.transforms/SplittableDoFnTest/testSideInput/
> {code}
> Caused by: java.lang.IllegalArgumentException: unable to deserialize
> Serialized DoFnInfo
> ...
> Caused by: java.io.InvalidClassException:
> org.apache.beam.runners.core.construction.SplittableParDo$RandomUniqueKeyFn;
> local class incompatible: stream classdesc serialVersionUID =
> 6068396661487412884, local class serialVersionUID = -617521663543732196
> {code}
> This means that the worker is using a version of the class from its own
> classpath, not the version from the user's staged pipeline. It implies that
> the worker is not shading runners-core-construction. Because that is where a
> ton of utility DoFns live, it is critical that it be shaded.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
