Re: creating a controlled lag in for a consumer group

2017-09-03 Thread Stephen Powis
Hey Ido. I haven't tried to do something like this, but we've worked out some future plans to do something similar, so I have a bit of interest in what you're saying. I feel like there are some details left out from your post. Are your consumers able to keep up w/ the throughput without the slee

creating a controlled lag in for a consumer group

2017-09-03 Thread Ido Barkan
Hey all. We are trying to create a controlled lag (a lag of 30 secs). We are doing that by inspecting a timestamp field for each msg on a specific topic and doing an actual Thread.sleep for a computed time in the consumer thread (until the msg is 30 secs old). We were hoping to see that eventually