Abhishek Agarwal created STORM-971:
--------------------------------------
Summary: Storm-Kafka: Emit metric for failed messages which are
not retried
Key: STORM-971
URL: https://issues.apache.org/jira/browse/STORM-971
Project: Apache Storm
Issue Type: Improvement
Components: storm-kafka
Reporter: Abhishek Agarwal
{noformat}
if (offset < _emittedToOffset - _spoutConfig.maxOffsetBehind) {
LOG.info(
"Skipping failed tuple at offset=" + offset +
" because it's more than maxOffsetBehind=" +
_spoutConfig.maxOffsetBehind +
" behind _emittedToOffset=" + _emittedToOffset
);
}
{noformat}
I believe, having a count metric for skipped messages will help configure the
correct maxOffsetBehind for the topology. Since the skipped messages could
potentially be lost, number is important for the user
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
