JNSimba opened a new pull request, #95: URL: https://github.com/apache/doris-kafka-connector/pull/95
## Summary - Enable gzip compression by default for StreamLoad to reduce network transfer size and improve write performance - Uses Apache HttpClient's `GzipCompressingEntity` to compress data before sending, consistent with [Flink Connector's implementation](https://github.com/apache/doris-flink-connector/pull/434) - Users can override or disable via `sink.properties.compress_type` configuration ## Changes - `LoadConstants.java`: Add `COMPRESS_TYPE` and `COMPRESS_TYPE_GZ` constants - `DorisOptions.java`: Set `compress_type=gz` as default stream load property - `DorisStreamLoad.java`: Apply `GzipCompressingEntity` when gzip is enabled - `AsyncDorisStreamLoad.java`: Same compression support for async path ## Test plan - [x] `mvn compile` passes - [ ] Manual verification with Doris cluster to confirm compressed data loads correctly - [ ] Verify disabling compression via `sink.properties.compress_type=` works as expected 🤖 Generated with [Claude Code](https://claude.com/claude-code) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
