[ 
https://issues.apache.org/jira/browse/FLINK-16048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17092262#comment-17092262
 ] 

Guangbin Zhu commented on FLINK-16048:
--------------------------------------

Hi guys,

I have this problem in my production. My enviorment is :
 # Confluent Kafka 5.3.1 (corresponding apache kafka 2.3.0 ) with Confluent 
Kafka Schema Registry 
 # Flink 1.10.0

I implemented a new csravro table format and 
CSRAvroRowFormatFactory/CSRAvroRowDeserializationSchema/CSRAvroRowSerializationSchema
 . 

[https://github.com/zhuguangbin/flink/commit/79192601094da90368b81cd59f57b4b31c87004e]

Hope it helps., If available, should I submit a PR ?

> Support read/write confluent schema registry avro data  from Kafka
> ------------------------------------------------------------------
>
>                 Key: FLINK-16048
>                 URL: https://issues.apache.org/jira/browse/FLINK-16048
>             Project: Flink
>          Issue Type: Improvement
>          Components: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table 
> SQL / Ecosystem
>    Affects Versions: 1.11.0
>            Reporter: Leonard Xu
>            Priority: Major
>              Labels: usability
>             Fix For: 1.11.0
>
>
> I found SQL Kafka connector can not consume avro data that was serialized by 
> `KafkaAvroSerializer` and only can consume Row data with avro schema because 
> we use `AvroRowDeserializationSchema/AvroRowSerializationSchema` to se/de 
> data in  `AvroRowFormatFactory`. 
> I think we should support this because `KafkaAvroSerializer` is very common 
> in Kafka.
> and someone met same question in stackoverflow[1].
> [[1]https://stackoverflow.com/questions/56452571/caused-by-org-apache-avro-avroruntimeexception-malformed-data-length-is-negat/56478259|https://stackoverflow.com/questions/56452571/caused-by-org-apache-avro-avroruntimeexception-malformed-data-length-is-negat/56478259]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to