[
https://issues.apache.org/jira/browse/FLINK-36339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17883223#comment-17883223
]
david radley commented on FLINK-36339:
--------------------------------------
[~dwysakowicz] I think this sounds like a good change to make. I curious what
your thinking is around the migration considerations. Do you envisage
tolerating the older java based serializations? Can we manage this change using
versions? Or maybe have a process to freshen existing snapshots to the new form
of serialisations.
> Remove java serialization from SQL serializers
> ----------------------------------------------
>
> Key: FLINK-36339
> URL: https://issues.apache.org/jira/browse/FLINK-36339
> Project: Flink
> Issue Type: Improvement
> Reporter: Dawid Wysakowicz
> Priority: Major
> Fix For: 2.0.0
>
>
> Some of the serializers used in SQL use java serialization in their snapshots
> which introduces risks of state incompatibilities that are hard to fix. We've
> seen that already with FLINK-36318
> We should get rid off that. For serializing {{LogicalType}} I'd suggest using
> {{LogicalType#asSerializableString}}.
> For {{ArrayDataSerializerSnapshot}} and {{MapDataSerializerSnapshot}} we
> should properly implement {{CompositeTypeSerializerSnapshot}} interface
> instead of serializing nested {{TypeSerializers}}.
> Few of the affected classes:
> *
> https://github.com/apache/flink/blob/1ba890062d94edc4d9ea5431d44adaeb123d9607/flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/typeutils/MapDataSerializer.java#L283
> *
> https://github.com/apache/flink/blob/1ba890062d94edc4d9ea5431d44adaeb123d9607/flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/typeutils/ArrayDataSerializer.java#L302
> *
> https://github.com/apache/flink/blob/1ba890062d94edc4d9ea5431d44adaeb123d9607/flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/typeutils/RowDataSerializer.java#L304
--
This message was sent by Atlassian Jira
(v8.20.10#820010)