[
https://issues.apache.org/jira/browse/BEAM-8034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919079#comment-16919079
]
sunjincheng commented on BEAM-8034:
-----------------------------------
Thanks report this issue and share your analysis and I agree with you this
caused by FLINK-13367. [~mxm] !
[~markflyhigh] Already bring up the PROPOSAL for the Beam 2.16 release, and
Beam 2.16 release branch cut is scheduled on Sep 11.
I'm not sure if I bringup the discuss of Flink-1.8.2 release today can catch up
with Beam 2.16 release(Sep 11), but I think even if 2.16 can't merge this
ticket we also need to push Flink-1.8.2 release as soon as possible, So that we
can upgrade flink-runner version to flink-1.8.2 as soon as possible, at least
we can merge this in Beam 2.17 release.
What do you think?
> Upgrade Flink Runner to 1.8.1 and fix Avro Schema serialization problems
> ------------------------------------------------------------------------
>
> Key: BEAM-8034
> URL: https://issues.apache.org/jira/browse/BEAM-8034
> Project: Beam
> Issue Type: Bug
> Components: runner-flink
> Reporter: Maximilian Michels
> Priority: Major
>
> The Flink Runner should be upgrade to 1.8.1. Users have reported
> serialization problems related to Avro's Schema:
> {noformat}
> Caused by: java.io.NotSerializableException: org.apache.avro.Schema$Field
> at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1184)
> at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
> at java.util.ArrayList.writeObject(ArrayList.java:766)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at
> java.io.ObjectStreamClass.invokeWriteObject(ObjectStreamClass.java:1140)
> at
> java.io.ObjectOutputStream.writeSerialData(ObjectOutputStream.java:1496)
> at
> java.io.ObjectOutputStream.writeOrdinaryObject(ObjectOutputStream.java:1432)
> at java.io.ObjectOutputStream.writeObject0(ObjectOutputStream.java:1178)
> at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:348)
> at
> org.apache.flink.util.InstantiationUtil.serializeObject(InstantiationUtil.java:576)
> at org.apache.flink.api.java.ClosureCleaner.clean(ClosureCleaner.java:122)
> ... 45 more
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
