krishvishal opened a new issue, #4530: URL: https://github.com/apache/iggy/issues/4530
## Summary Some gateway limits are lower than Kafka's, so the gateway refuses requests that Kafka accepts: - `max_frame_size` is 8 MiB. Kafka accepts requests up to `socket.request.max.bytes`, which is 100 MiB. - The group caps have no environment variables: 1000 groups, 1000 members per group and 10,000 in total, 64 KiB per member blob, and 4 MiB per group. A large Kafka Streams assignment can pass 64 KiB. - CreateTopics takes at most 1000 partitions per topic and 100 topics per request. - A group id is at most 246 bytes, because its Iggy offset group `kafka.cg.<group>` must fit in 255 bytes. Kafka accepts longer ids. - Fetch polls at most 1000 messages per partition at a time, returns uncompressed batches, and has no fetch sessions. That costs bandwidth and CPU, not correctness. ## Scope - [ ] Environment variables for the group caps and the CreateTopics caps - [ ] Document each limit next to the Kafka value -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
