david-streamlio opened a new pull request, #16179:
URL: https://github.com/apache/pulsar/pull/16179
### Motivation
The current implementation of the Cassandra Sink connector only supported a
single schema type (key, string). This is not useful for production. So I
modified the code to be able to support any schema type in Cassandra.
### Modifications
Added classes that interrogate the database to determine the schema type at
runtime. I also added a framework that will extract the values from the
supported incoming schema types (GenericRecord, and String) using the table
metadata.
### Verifying this change
- [ x] Make sure that the change passes the CI checks.
*(Please pick either of the following options)*
This change added tests and can be verified as follows:
*Added integration tests for testing against a Cassandra database*
### Does this pull request potentially affect one of the following parts:
*If `yes` was chosen, please highlight the changes*
- Dependencies (does it add or upgrade a dependency): (yes)
- The public API: (no)
- The schema: (yes)
- The default values of configurations: (no)
- The wire protocol: (no)
- The rest endpoints: (no)
- The admin cli options: ( no)
- Anything that affects deployment: (no)
### Documentation
Check the box below or label this PR directly.
Need to update docs?
- [ x] `doc-required`
(Your PR needs to update docs and you will update later)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
