GitHub user ottobackwards opened a pull request:

    https://github.com/apache/incubator-metron/pull/311

    METRON-502 Make the ParserIntegrationTest more clear on errors

    This is an attempt to enhance the Integration Test framework to support 
exposing processor errors and invalid messages.
    
    There are two goals here:
    
    1. Expose errors that are in present but not exposed because the kafka 
queues or other error sources are not check or exposed through the Processor run
    2. Allow the integration tests to fail quicker as opposed to timing out ( 
if for example there are invalid messages or errors in the kafka queue such 
that the message in never == message out the test will keep re-trying until 
timeout ).
    
    A new type ProcessorResult<T> has been added to the system as the return 
from running a Processor.  This type encapsulates the results, errors and 
invalids from any given run.
    
    All integration tests with master run.
    
    As always any feedback is appreciated.  Specifically in two areas:
    
    - Is there a better way, or a way more consistent with the system than 
introducing the ProcessorResult type?
    - The integration project does not have any tests, should it ( unit tests?)
    - What is the best way to test this?  Should each individual test have a 
'failure mode' test as well?
    
     

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/ottobackwards/incubator-metron METRON-502

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/incubator-metron/pull/311.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #311
    
----
commit 5b993beb9017ad8554ed72f5d315169ba2b67c56
Author: Otto Fowler <ofow...@industrialdefender.com>
Date:   2016-10-15T13:19:58Z

    first pass at refactoring to support error and invalid messages.  Squid 
Test is failing validation, but that is message content( json/json ) around 
domain without subdomains, which may be addressed in a different PR - I need to 
check

commit befe5f0408d8cf738df2c319e922240549771263
Author: Otto Fowler <ofow...@industrialdefender.com>
Date:   2016-10-16T16:24:04Z

    update other tests - mvn integration-test now running completely

commit 964940067ce0cfac0eeb177dc76a80b3931e4385
Author: Otto Fowler <ofow...@industrialdefender.com>
Date:   2016-10-16T16:25:12Z

    Merge remote-tracking branch 'apache/master' into METRON-502

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Reply via email to