Casey Stella created METRON-1501:
------------------------------------
Summary: Parser messages that fail to validate are dropped silently
Key: METRON-1501
URL: https://issues.apache.org/jira/browse/METRON-1501
Project: Metron
Issue Type: Bug
Reporter: Casey Stella
Currently we have two concepts of dealing with messages that are not going to
be passed through:
* Messages that fail global validation
* Messages that fail the parser's validation function
* Messages that are filtered out
Currently in the case of messages that fail global validation, we send them to
the error queue.
In the case of messages that fail the parser's validation function, we drop
them silently.
In the case of messages that are filtered out, we drop them silently as well.
Given the use-cases behind filtering (e.g. a kafka topic with multiple types of
messages where we want to pass along only one type), it makes sense to drop
them silently. However, in the case of the messages that fail the parser's
validation function, we should like to know that and treat those similarly to
those messages that fail global validation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
