GitHub user ottobackwards opened a pull request:
https://github.com/apache/incubator-metron/pull/311
METRON-502 Make the ParserIntegrationTest more clear on errors
This is an attempt to enhance the Integration Test framework to support
exposing processor errors and invalid messages.
There are two goals here:
1. Expose errors that are in present but not exposed because the kafka
queues or other error sources are not check or exposed through the Processor run
2. Allow the integration tests to fail quicker as opposed to timing out (
if for example there are invalid messages or errors in the kafka queue such
that the message in never == message out the test will keep re-trying until
timeout ).
A new type ProcessorResult<T> has been added to the system as the return
from running a Processor. This type encapsulates the results, errors and
invalids from any given run.
All integration tests with master run.
As always any feedback is appreciated. Specifically in two areas:
- Is there a better way, or a way more consistent with the system than
introducing the ProcessorResult type?
- The integration project does not have any tests, should it ( unit tests?)
- What is the best way to test this? Should each individual test have a
'failure mode' test as well?
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ottobackwards/incubator-metron METRON-502
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-metron/pull/311.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #311
----
commit 5b993beb9017ad8554ed72f5d315169ba2b67c56
Author: Otto Fowler <[email protected]>
Date: 2016-10-15T13:19:58Z
first pass at refactoring to support error and invalid messages. Squid
Test is failing validation, but that is message content( json/json ) around
domain without subdomains, which may be addressed in a different PR - I need to
check
commit befe5f0408d8cf738df2c319e922240549771263
Author: Otto Fowler <[email protected]>
Date: 2016-10-16T16:24:04Z
update other tests - mvn integration-test now running completely
commit 964940067ce0cfac0eeb177dc76a80b3931e4385
Author: Otto Fowler <[email protected]>
Date: 2016-10-16T16:25:12Z
Merge remote-tracking branch 'apache/master' into METRON-502
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
