For a media analysis application that I am working on, I need the ability to
increase the tuple timeout dynamically since the analysis can take a short or
long while and I don't want to have to set the timeout for the worst possible
case as that will lead to long pauses in the event of failure. I am thinking to
use a simple heartbeat mechanism that adds another time increment periodically
such that in the event that a failure occurs, the timeout can still happen
within a short time frame.
I would like to implement this in something common like the kafka spout, but
was wondering if there are some existing communication channels back to the
spout that could be enhanced for this purpose or if I would have to add a whole
listening thread to do so.
Any pointers in this direction would be appreciated.
Thanks,
Jason
