[
https://issues.apache.org/jira/browse/METRON-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16411928#comment-16411928
]
ASF GitHub Bot commented on METRON-1501:
----------------------------------------
Github user ottobackwards commented on the issue:
https://github.com/apache/metron/pull/972
This seems like it should have some documentation to go with it
> Parser messages that fail to validate are dropped silently
> ----------------------------------------------------------
>
> Key: METRON-1501
> URL: https://issues.apache.org/jira/browse/METRON-1501
> Project: Metron
> Issue Type: Bug
> Reporter: Casey Stella
> Priority: Major
>
> Currently we have two concepts of dealing with messages that are not going to
> be passed through:
> * Messages that fail global validation
> * Messages that fail the parser's validation function
> * Messages that are filtered out
>
> Currently in the case of messages that fail global validation, we send them
> to the error queue.
> In the case of messages that fail the parser's validation function, we drop
> them silently.
> In the case of messages that are filtered out, we drop them silently as well.
>
> Given the use-cases behind filtering (e.g. a kafka topic with multiple types
> of messages where we want to pass along only one type), it makes sense to
> drop them silently. However, in the case of the messages that fail the
> parser's validation function, we should like to know that and treat those
> similarly to those messages that fail global validation.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
