Consider a log system which Kafka is designed for. I would like operations such as:
logtail -f <some_stream> logtail -f -n 1000 <some_stream> logtail -f -t10h <some_stream logtail -f -t0900 <some_stream in other words, I want to watch messages in real time off the log stream, but I also want to go back in time and watch them - for example suppose I have written CEP or other scripts that watch log messages for patterns and detect activity I am interested in. I may do so "on the fly" and I may want to "go back in time" to do so in case an event I am interested happened in the past and I want to validate the code I am writing. On Thu, Sep 22, 2011 at 6:07 AM, Chris Burroughs <chris.burrou...@gmail.com>wrote: > On 09/21/2011 10:06 PM, Taylor Gautier wrote: > > I see that kafka-87 addresses this with a request for having a time based > > index, this would be relatively useful, but I also would like to have a > way > > to go back say 1,000 messages. Other than walking backwards one segment > at > > a time, can then scanning forward from there, do you have any suggestions > > how this might be done or is it also a feature request? > > Could you elaborate a little on your use case where you need to rewind > by a fixed number of messages? >
