[
https://issues.apache.org/jira/browse/AVRO-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Oscar Westra van Holthe - Kind updated AVRO-2440:
-------------------------------------------------
Description:
At work we have a use case to read Avro records from Kafka, and to write them
to one of several BigQuery tables (based on compatibility). This means that
there is no single schema (with all data) that is compatible with all records
we'll be reading.
In order to allow this, we'd like to be able to use the BinaryMessageDecoder
without any read schema, and have it use the write schema of each record as the
read schema for that record.
-Pull request will follow.-
Pull request submitted.
was:
At work we have a use case to read Avro records from Kafka, and to write them
to one of several BigQuery tables (based on compatibility). This means that
there is no single schema (with all data) that is compatible with all records
we'll be reading.
In order to allow this, we'd like to be able to use the BinaryMessageDecoder
without any read schema, and have it use the write schema of each record as the
read schema for that record.
Pull request will follow.
> Allow BinaryMessageDecoder to read (generic) records with the same schema
> they were written with.
> -------------------------------------------------------------------------------------------------
>
> Key: AVRO-2440
> URL: https://issues.apache.org/jira/browse/AVRO-2440
> Project: Apache Avro
> Issue Type: Improvement
> Components: java
> Reporter: Oscar Westra van Holthe - Kind
> Priority: Minor
>
> At work we have a use case to read Avro records from Kafka, and to write them
> to one of several BigQuery tables (based on compatibility). This means that
> there is no single schema (with all data) that is compatible with all records
> we'll be reading.
> In order to allow this, we'd like to be able to use the BinaryMessageDecoder
> without any read schema, and have it use the write schema of each record as
> the read schema for that record.
> -Pull request will follow.-
> Pull request submitted.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
