[ https://issues.apache.org/jira/browse/METRON-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424096#comment-16424096 ]
ASF GitHub Bot commented on METRON-1501: ---------------------------------------- Github user asfgit closed the pull request at: https://github.com/apache/metron/pull/972 > Parser messages that fail to validate are dropped silently > ---------------------------------------------------------- > > Key: METRON-1501 > URL: https://issues.apache.org/jira/browse/METRON-1501 > Project: Metron > Issue Type: Bug > Reporter: Casey Stella > Priority: Major > > Currently we have two concepts of dealing with messages that are not going to > be passed through: > * Messages that fail global validation > * Messages that fail the parser's validation function > * Messages that are filtered out > > Currently in the case of messages that fail global validation, we send them > to the error queue. > In the case of messages that fail the parser's validation function, we drop > them silently. > In the case of messages that are filtered out, we drop them silently as well. > > Given the use-cases behind filtering (e.g. a kafka topic with multiple types > of messages where we want to pass along only one type), it makes sense to > drop them silently. However, in the case of the messages that fail the > parser's validation function, we should like to know that and treat those > similarly to those messages that fail global validation. -- This message was sent by Atlassian JIRA (v7.6.3#76005)