disha-chhabra-0002 commented on issue #2715: URL: https://github.com/apache/iggy/issues/2715#issuecomment-4066914303
I did some further testing and noticed a consistent pattern. **Setup** * iggy-server: **0.7.0** * Rust SDK: **0.9.0** * Poll strategy: **`PollingStrategy::offset`** * Batch size: **100** * Disk: **AWS EBS gp3** * Total messages in stream: **~45M** **Behavior** 1. When the **producer and consumer run simultaneously**, the consumer starts normally but after consuming around **~12M messages**, the **offset suddenly jumps close to the head of the stream**, skipping the remaining messages. 2. However, if I **stop the producer** and run the **consumer alone**, the consumer is able to **consume all ~45M messages sequentially without any offset jumps**. This suggests the issue appears only when **new messages are being appended while the consumer is reading older offsets**. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
