[
https://issues.apache.org/jira/browse/FLINK-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307230#comment-14307230
]
ASF GitHub Bot commented on FLINK-1391:
---------------------------------------
GitHub user rmetzger opened a pull request:
https://github.com/apache/flink/pull/364
Port FLINK-1391 and FLINK-1392 to "release-0.8" branch.
These commits port the fixes for the two issues (Avro and Protobuf support)
to the release-0.8 branch.
They also contain a hotfix regarding the closure cleaner by @aljoscha.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/rmetzger/flink kryo081
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/364.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #364
----
commit 38ebc09ff5782005c5aa1f60b458cae250b8c26e
Author: Robert Metzger <[email protected]>
Date: 2015-01-12T20:11:09Z
[FLINK-1391] Add support for using Avro-POJOs and Avro types with Kryo
Conflicts:
flink-java/src/main/java/org/apache/flink/api/java/typeutils/TypeExtractor.java
flink-java/src/main/java/org/apache/flink/api/java/typeutils/runtime/KryoSerializer.java
Conflicts:
flink-java/src/main/java/org/apache/flink/api/java/typeutils/runtime/KryoSerializer.java
commit cbe633537567cc39a9877125e79cd7da49ee7f3b
Author: Robert Metzger <[email protected]>
Date: 2015-01-13T09:21:29Z
[FLINK-1392] Add Kryo serializer for Protobuf
Conflicts:
flink-java/pom.xml
flink-java/src/main/java/org/apache/flink/api/java/typeutils/runtime/KryoSerializer.java
Conflicts:
flink-shaded/pom.xml
pom.xml
commit 63472baff1fca18b83666831effe2204606cf355
Author: Aljoscha Krettek <[email protected]>
Date: 2015-01-15T10:46:53Z
[hotfix] Also use java closure cleaner on grouped operations
commit 9043582a4a1f4fd25e960217a99f3f32d4ba18a9
Author: Robert Metzger <[email protected]>
Date: 2015-02-05T13:07:48Z
[backports] Cleanup and port changes to 0.8 branch.
----
> Kryo fails to properly serialize avro collection types
> ------------------------------------------------------
>
> Key: FLINK-1391
> URL: https://issues.apache.org/jira/browse/FLINK-1391
> Project: Flink
> Issue Type: Sub-task
> Affects Versions: 0.8, 0.9
> Reporter: Robert Metzger
> Assignee: Robert Metzger
>
> Before FLINK-610, Avro was the default generic serializer.
> Now, special types coming from Avro are handled by Kryo .. which seems to
> cause errors like:
> {code}
> Exception in thread "main"
> org.apache.flink.runtime.client.JobExecutionException:
> java.lang.NullPointerException
> at org.apache.avro.generic.GenericData$Array.add(GenericData.java:200)
> at
> com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:116)
> at
> com.esotericsoftware.kryo.serializers.CollectionSerializer.read(CollectionSerializer.java:22)
> at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:761)
> at
> org.apache.flink.api.java.typeutils.runtime.KryoSerializer.deserialize(KryoSerializer.java:143)
> at
> org.apache.flink.api.java.typeutils.runtime.KryoSerializer.deserialize(KryoSerializer.java:148)
> at
> org.apache.flink.api.java.typeutils.runtime.PojoSerializer.deserialize(PojoSerializer.java:244)
> at
> org.apache.flink.runtime.plugable.DeserializationDelegate.read(DeserializationDelegate.java:56)
> at
> org.apache.flink.runtime.io.network.serialization.AdaptiveSpanningRecordDeserializer.getNextRecord(AdaptiveSpanningRecordDeserializer.java:71)
> at
> org.apache.flink.runtime.io.network.channels.InputChannel.readRecord(InputChannel.java:189)
> at
> org.apache.flink.runtime.io.network.gates.InputGate.readRecord(InputGate.java:176)
> at
> org.apache.flink.runtime.io.network.api.MutableRecordReader.next(MutableRecordReader.java:51)
> at
> org.apache.flink.runtime.operators.util.ReaderIterator.next(ReaderIterator.java:53)
> at
> org.apache.flink.runtime.operators.DataSinkTask.invoke(DataSinkTask.java:170)
> at
> org.apache.flink.runtime.execution.RuntimeEnvironment.run(RuntimeEnvironment.java:257)
> at java.lang.Thread.run(Thread.java:744)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
