[ 
https://issues.apache.org/jira/browse/METRON-597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708707#comment-15708707
 ] 

Nick Allen commented on METRON-597:
-----------------------------------

I'm not so sure this will solve our problems.  I looked through at least the 
first page of pull request test failures in Travis and while I do see a good 
number of ProfilerIntegrationTest failures, I also see 
ElasticsearchIntegrationTest, EnrichmentIntegrationTest, AsaIntegrationTest, 
and ServiceDiscoveryIntegrationTest failures.  

{code}
Build #1203 --> 8 days ago
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)  
Time elapsed: 16.858 sec  <<< FAILURE!
Failed tests:   
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest): 
expected:<20.0> but was:<NaN>

Build #1205 --> 7 days ago
Running org.apache.metron.maas.discovery.ServiceDiscoveryIntegrationTest
2016-11-23 12:33:25,177 ERROR [Curator-TreeCache-0] discovery.ServiceDiscoverer 
(ServiceDiscoverer.java:updateState(171)) - 
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.432 sec <<< 
FAILURE! - in org.apache.metron.maas.discovery.ServiceDiscoveryIntegrationTest
testDiscovery(org.apache.metron.maas.discovery.ServiceDiscoveryIntegrationTest) 
 Time elapsed: 19.374 sec  <<< FAILURE!
java.lang.AssertionError: expected:<3> but was:<0>
Failed tests: ServiceDiscoveryIntegrationTest.testDiscovery:96 expected:<3> but 
was:<0>

Build #1206 --> 7 days ago
Running 
org.apache.metron.elasticsearch.integration.ElasticsearchIndexingIntegrationTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 137.782 sec <<< 
FAILURE!
test(org.apache.metron.elasticsearch.integration.ElasticsearchIndexingIntegrationTest)
  Time elapsed: 137.671 sec  <<< ERROR!
java.lang.RuntimeException: Took too long to complete: 120035 > 120000
  
test(org.apache.metron.elasticsearch.integration.ElasticsearchIndexingIntegrationTest):
 Took too long to complete: 120035 > 120000

Build #1207 --> 7 days ago
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 63.834 sec <<< 
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)  
Time elapsed: 16.956 sec  <<< FAILURE!
java.lang.AssertionError: expected:<20.0> but was:<NaN>
Failed tests:   
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest): 
expected:<20.0> but was:<NaN>

Build #1219 --> 1 day ago
test(org.apache.metron.parsers.integration.AsaIntegrationTest)  Time elapsed: 
78.72 sec  <<< ERROR!
java.lang.RuntimeException: Too many retries: 16
        at 
org.apache.metron.integration.ComponentRunner.process(ComponentRunner.java:140)
Tests in error: AsaIntegrationTest>ParserIntegrationTest.test:80 » Runtime Too 
many retries: 1...

Build #1220 --> 1 day ago
Running org.apache.metron.parsers.integration.AsaIntegrationTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 78.738 sec <<< 
FAILURE! - in org.apache.metron.parsers.integration.AsaIntegrationTest
test(org.apache.metron.parsers.integration.AsaIntegrationTest)  Time elapsed: 
78.738 sec  <<< ERROR!
java.lang.RuntimeException: Too many retries: 16
Tests in error: AsaIntegrationTest>ParserIntegrationTest.test:80 » Runtime Too 
many retries: 1...

Build #1222 -->
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 57.989 sec <<< 
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)  
Time elapsed: 14.505 sec  <<< FAILURE!
java.lang.AssertionError: expected:<20.0> but was:<NaN>
Failed tests:   
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest): 
expected:<20.0> but was:<NaN>

Build #1223 --> 19 hours ago
Running org.apache.metron.enrichment.integration.EnrichmentIntegrationTest
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 36.428 sec <<< 
FAILURE! - in org.apache.metron.enrichment.integration.EnrichmentIntegrationTest
test(org.apache.metron.enrichment.integration.EnrichmentIntegrationTest)  Time 
elapsed: 36.423 sec  <<< FAILURE!
java.lang.AssertionError: expected:<10> but was:<0>
Failed tests: EnrichmentIntegrationTest.test:173 expected:<10> but was:<0>

Build #1224 --> 19 hours ago
Running org.apache.metron.enrichment.integration.EnrichmentIntegrationTest
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 33.335 sec <<< 
FAILURE! - in org.apache.metron.enrichment.integration.EnrichmentIntegrationTest
test(org.apache.metron.enrichment.integration.EnrichmentIntegrationTest)  Time 
elapsed: 33.328 sec  <<< FAILURE!
Failed tests: EnrichmentIntegrationTest.test:173 expected:<10> but was:<0>

Build #1225 --> 19 hours ago
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 75.54 sec <<< 
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)  
Time elapsed: 19.152 sec  <<< FAILURE!
Failed tests:   
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest): 
expected:<20.0> but was:<NaN>

Build #1226 --> 19 hours ago
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 66.564 sec <<< 
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)  
Time elapsed: 16.759 sec  <<< FAILURE!
java.lang.AssertionError: expected:<20.0> but was:<NaN>
Failed tests:   
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest): 
expected:<20.0> but was:<NaN>
  
Build #1228 --> 14 hours ago
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 77.172 sec <<< 
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)  
Time elapsed: 19.711 sec  <<< FAILURE!
java.lang.AssertionError: expected:<20.0> but was:<NaN>
Failed tests:   
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest): 
expected:<20.0> but was:<NaN>

Build #1230 --> 12 hours ago
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 61.967 sec <<< 
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)  
Time elapsed: 15.764 sec  <<< FAILURE!
Failed tests:   
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest): 
expected:<20.0> but was:<NaN>
{code}

> Sporadic Failures of Profiler Integration Tests
> -----------------------------------------------
>
>                 Key: METRON-597
>                 URL: https://issues.apache.org/jira/browse/METRON-597
>             Project: Metron
>          Issue Type: Bug
>            Reporter: Nick Allen
>
> Seems to be some kind of timing issue.
> {code}
> -------------------------------------------------------
>  T E S T S
> -------------------------------------------------------
> Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 66.564 sec 
> <<< FAILURE!
> testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)  
> Time elapsed: 16.759 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<20.0> but was:<NaN>
>       at org.junit.Assert.fail(Assert.java:88)
>       at org.junit.Assert.failNotEquals(Assert.java:834)
>       at org.junit.Assert.assertEquals(Assert.java:553)
>       at org.junit.Assert.assertEquals(Assert.java:683)
>       at 
> org.apache.metron.profiler.integration.ProfilerIntegrationTest.testExample3(ProfilerIntegrationTest.java:203)
>       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>       at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>       at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>       at java.lang.reflect.Method.invoke(Method.java:483)
>       at 
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
>       at 
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
>       at 
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
>       at 
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
>       at 
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
>       at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
>       at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
>       at 
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
>       at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
>       at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
>       at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
>       at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
>       at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
>       at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
>       at 
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
>       at 
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
>       at 
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
>       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>       at 
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>       at 
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>       at java.lang.reflect.Method.invoke(Method.java:483)
>       at 
> org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
>       at 
> org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
>       at 
> org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
>       at 
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
>       at 
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
> Results :
> Failed tests:   
> testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest): 
> expected:<20.0> but was:<NaN>
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 0
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to