### Motivation

In some use cases, the publishers and consumers don't know the type or schema 
of the messages ahead of time.
For example, in pulsar io connector, when connecting a topic to a jdbc table, 
the connector doesn't know
the tyep of the messages ahead of time; the connector can only fetch schema 
info from schema registry and
that is the only information connector knows. It is impossible for mapping the 
messages to a relational database
table.

So we need a way to present a generic `Struct` record with fields.

 ### Changes

Introduce `Field` and `GenericRecord` to represent `Struct` records 
deserialized with a schema.

 ### NotCovered

This change only introduces the interfaces. It doesn't integrate with the 
producer and consumer workflow.
That would be done in subsequent changes if we agree on the interfaces.



[ Full content available at: 
https://github.com/apache/incubator-pulsar/pull/2452 ]
This message was relayed via gitbox.apache.org for [email protected]

Reply via email to