Chris Riccomini created SAMZA-30:
------------------------------------
Summary: Back off in BrokerProxy when fetch fails
Key: SAMZA-30
URL: https://issues.apache.org/jira/browse/SAMZA-30
Project: Samza
Issue Type: Bug
Components: kafka
Affects Versions: 0.6.0
Reporter: Chris Riccomini
Fix For: 0.7.0
The BrokerProxy immediately recreates its simple consumer, and re-fetches when
an exception is thrown in its fetch loop (inside its thread). We should add a
backoff here. Rather than doing a fixed time (say sleep 10s), let's do an
exponential backoff with a cap (0s, 100s, 200s, 400s, 800s, 1.6s, .. up to
cap), so we don't introduce lag in the case where there's a one-off failure and
an immediate reconnect would work.
I suggest adding a config to allow the backoff time and max cap and to be
defined, but default it to 100ms, and 10s, respectively.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
