[
https://issues.apache.org/jira/browse/METRON-597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15708707#comment-15708707
]
Nick Allen commented on METRON-597:
-----------------------------------
I'm not so sure this will solve our problems. I looked through at least the
first page of pull request test failures in Travis and while I do see a good
number of ProfilerIntegrationTest failures, I also see
ElasticsearchIntegrationTest, EnrichmentIntegrationTest, AsaIntegrationTest,
and ServiceDiscoveryIntegrationTest failures.
{code}
Build #1203 --> 8 days ago
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)
Time elapsed: 16.858 sec <<< FAILURE!
Failed tests:
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest):
expected:<20.0> but was:<NaN>
Build #1205 --> 7 days ago
Running org.apache.metron.maas.discovery.ServiceDiscoveryIntegrationTest
2016-11-23 12:33:25,177 ERROR [Curator-TreeCache-0] discovery.ServiceDiscoverer
(ServiceDiscoverer.java:updateState(171)) -
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 19.432 sec <<<
FAILURE! - in org.apache.metron.maas.discovery.ServiceDiscoveryIntegrationTest
testDiscovery(org.apache.metron.maas.discovery.ServiceDiscoveryIntegrationTest)
Time elapsed: 19.374 sec <<< FAILURE!
java.lang.AssertionError: expected:<3> but was:<0>
Failed tests: ServiceDiscoveryIntegrationTest.testDiscovery:96 expected:<3> but
was:<0>
Build #1206 --> 7 days ago
Running
org.apache.metron.elasticsearch.integration.ElasticsearchIndexingIntegrationTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 137.782 sec <<<
FAILURE!
test(org.apache.metron.elasticsearch.integration.ElasticsearchIndexingIntegrationTest)
Time elapsed: 137.671 sec <<< ERROR!
java.lang.RuntimeException: Took too long to complete: 120035 > 120000
test(org.apache.metron.elasticsearch.integration.ElasticsearchIndexingIntegrationTest):
Took too long to complete: 120035 > 120000
Build #1207 --> 7 days ago
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 63.834 sec <<<
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)
Time elapsed: 16.956 sec <<< FAILURE!
java.lang.AssertionError: expected:<20.0> but was:<NaN>
Failed tests:
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest):
expected:<20.0> but was:<NaN>
Build #1219 --> 1 day ago
test(org.apache.metron.parsers.integration.AsaIntegrationTest) Time elapsed:
78.72 sec <<< ERROR!
java.lang.RuntimeException: Too many retries: 16
at
org.apache.metron.integration.ComponentRunner.process(ComponentRunner.java:140)
Tests in error: AsaIntegrationTest>ParserIntegrationTest.test:80 » Runtime Too
many retries: 1...
Build #1220 --> 1 day ago
Running org.apache.metron.parsers.integration.AsaIntegrationTest
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 78.738 sec <<<
FAILURE! - in org.apache.metron.parsers.integration.AsaIntegrationTest
test(org.apache.metron.parsers.integration.AsaIntegrationTest) Time elapsed:
78.738 sec <<< ERROR!
java.lang.RuntimeException: Too many retries: 16
Tests in error: AsaIntegrationTest>ParserIntegrationTest.test:80 » Runtime Too
many retries: 1...
Build #1222 -->
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 57.989 sec <<<
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)
Time elapsed: 14.505 sec <<< FAILURE!
java.lang.AssertionError: expected:<20.0> but was:<NaN>
Failed tests:
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest):
expected:<20.0> but was:<NaN>
Build #1223 --> 19 hours ago
Running org.apache.metron.enrichment.integration.EnrichmentIntegrationTest
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 36.428 sec <<<
FAILURE! - in org.apache.metron.enrichment.integration.EnrichmentIntegrationTest
test(org.apache.metron.enrichment.integration.EnrichmentIntegrationTest) Time
elapsed: 36.423 sec <<< FAILURE!
java.lang.AssertionError: expected:<10> but was:<0>
Failed tests: EnrichmentIntegrationTest.test:173 expected:<10> but was:<0>
Build #1224 --> 19 hours ago
Running org.apache.metron.enrichment.integration.EnrichmentIntegrationTest
Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 33.335 sec <<<
FAILURE! - in org.apache.metron.enrichment.integration.EnrichmentIntegrationTest
test(org.apache.metron.enrichment.integration.EnrichmentIntegrationTest) Time
elapsed: 33.328 sec <<< FAILURE!
Failed tests: EnrichmentIntegrationTest.test:173 expected:<10> but was:<0>
Build #1225 --> 19 hours ago
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 75.54 sec <<<
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)
Time elapsed: 19.152 sec <<< FAILURE!
Failed tests:
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest):
expected:<20.0> but was:<NaN>
Build #1226 --> 19 hours ago
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 66.564 sec <<<
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)
Time elapsed: 16.759 sec <<< FAILURE!
java.lang.AssertionError: expected:<20.0> but was:<NaN>
Failed tests:
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest):
expected:<20.0> but was:<NaN>
Build #1228 --> 14 hours ago
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 77.172 sec <<<
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)
Time elapsed: 19.711 sec <<< FAILURE!
java.lang.AssertionError: expected:<20.0> but was:<NaN>
Failed tests:
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest):
expected:<20.0> but was:<NaN>
Build #1230 --> 12 hours ago
Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 61.967 sec <<<
FAILURE!
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)
Time elapsed: 15.764 sec <<< FAILURE!
Failed tests:
testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest):
expected:<20.0> but was:<NaN>
{code}
> Sporadic Failures of Profiler Integration Tests
> -----------------------------------------------
>
> Key: METRON-597
> URL: https://issues.apache.org/jira/browse/METRON-597
> Project: Metron
> Issue Type: Bug
> Reporter: Nick Allen
>
> Seems to be some kind of timing issue.
> {code}
> -------------------------------------------------------
> T E S T S
> -------------------------------------------------------
> Running org.apache.metron.profiler.integration.ProfilerIntegrationTest
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 66.564 sec
> <<< FAILURE!
> testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest)
> Time elapsed: 16.759 sec <<< FAILURE!
> java.lang.AssertionError: expected:<20.0> but was:<NaN>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:834)
> at org.junit.Assert.assertEquals(Assert.java:553)
> at org.junit.Assert.assertEquals(Assert.java:683)
> at
> org.apache.metron.profiler.integration.ProfilerIntegrationTest.testExample3(ProfilerIntegrationTest.java:203)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:483)
> at
> org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
> at
> org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
> at
> org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
> at
> org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
> at
> org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
> at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
> at
> org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
> at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
> at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
> at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
> at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
> at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
> at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:252)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:141)
> at
> org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:112)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:483)
> at
> org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
> at
> org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
> at
> org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
> at
> org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:115)
> at
> org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:75)
> Results :
> Failed tests:
> testExample3(org.apache.metron.profiler.integration.ProfilerIntegrationTest):
> expected:<20.0> but was:<NaN>
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 0
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)