Lzgpom opened a new pull request, #188: URL: https://github.com/apache/flink-connector-aws/pull/188
## Purpose of the change This PR implements the Kinesis deaggregation. The implementation was heavily based on the old kinesis connector. ## Verifying this change This change added tests and can be verified as follows: - Added integration tests for with record deaggregation - Added unit tests - Manually verified by running the Kinesis connector on a local Flink cluster. ## Further ToDos and Follow-ups Checkpoints do not take into consideration the sequence number of the deaggregated records. ## Brief change log - 767f576d4295aa6c0ad04ac34ebb183cc57bd0cd Implement record deaggregation using `AggregatorUtil` from the KCL 3.x - ddcb1a9cf291cd9eab73829925a08da76b2dc107 Implemented tests for `RecordBatch` regarding deaggregation. There was a need for aggregated records to test. So it was used https://github.com/awslabs/kinesis-aggregation to do so. Unfortunatly, it does have a version in the maven repository compatible with KCL 3.x so it was used a workaround. - fce6d035270509f31fd4cf3d9a13b0737cb985a1 Added integration tests. - ddcb1a9cf291cd9eab73829925a08da76b2dc107 fce6d035270509f31fd4cf3d9a13b0737cb985a1 Added unit tests. ## Significant changes - [x] Dependencies have been added or upgraded - [ ] Public API has been changed (Public API is any class annotated with `@Public(Evolving)`) - [ ] Serializers have been changed - [ ] New feature has been introduced - If yes, how is this documented? (not applicable / docs / JavaDocs / not documented) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
