eolivelli opened a new pull request #9481:
URL: https://github.com/apache/pulsar/pull/9481


   ### Motivation
   Currently Pulsar Source Connectors cannot produce messages using the 
GenericRecord API.
   
   Producing messages with the GenericRecord API will allow to dynamically 
generate data structures that can be consumed downstream using the supported 
encoding 
   
   ### Modifications
   
   Allow a Pulsar Source to be declared to produce "GenericRecord" instances, 
this in turn means to change PulsarSink that is the entity that receives 
message from the Source and writes to the Pulsar topic.
   
   - PulsarSink: do not precreate a Schema in case of GenericRecord data type 
(the schema will be created at the first write)
   - AvroWriter: support encoding any GenericRecord and not only 
GenericAvroRecords
   - Add integration test
   
   ### Verifying this change
   
   The change adds integration tests and new unit tests
   
   ### Documentation
   There is no need to add documentation, because it comes naturally for a 
developer to declare the source as `Source<GenericRecord>` and it is expected 
that it works


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to