[
https://issues.apache.org/jira/browse/FLINK-27255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17554558#comment-17554558
]
David Anderson edited comment on FLINK-27255 at 6/15/22 12:47 PM:
------------------------------------------------------------------
master:
fd6571c33e998a9c7c0786e189569f918441a71d
1389f6818272d2277c64f3146ff8c9711c5db6a0
531cc90831960a978672e521ee09437d4b804993
1.15:
b9e4b181102292f7b4a164066cee125801853e3b
1.14:
e1572620b570e6a90ca2913d30c7930700ede699
4cefc6b5fa2c9fc95de4d614dd4442a616ca14a7
was (Author: danderson):
release-1.15 via b9e4b181102292f7b4a164066cee125801853e3b
> Flink-avro does not support serialization and deserialization of avro schema
> longer than 65535 characters
> ---------------------------------------------------------------------------------------------------------
>
> Key: FLINK-27255
> URL: https://issues.apache.org/jira/browse/FLINK-27255
> Project: Flink
> Issue Type: Bug
> Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile)
> Affects Versions: 1.14.4
> Reporter: Haizhou Zhao
> Assignee: Haizhou Zhao
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.16.0, 1.14.5, 1.15.1
>
>
> The underlying serialization of avro schema uses string serialization method
> of ObjectOutputStream.class, however, the default string serialization by
> ObjectOutputStream.class does not support handling string of more than 66535
> characters (64kb). As a result, constructing flink operators that
> input/output Avro Generic Record with huge schema is not possible.
>
> The purposed fix is two change the serialization and deserialization method
> of these following classes so that huge string could also be handled.
>
> [GenericRecordAvroTypeInfo|https://github.com/apache/flink/blob/master/flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/typeutils/GenericRecordAvroTypeInfo.java#L107]
> [SerializableAvroSchema|https://github.com/apache/flink/blob/master/flink-formats/flink-avro/src/main/java/org/apache/flink/formats/avro/typeutils/SerializableAvroSchema.java#L55]
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
