Tiancheng Dai created TIKA-4526:
-----------------------------------
Summary: Nondeterministic failures in TranslateResourceTest
Key: TIKA-4526
URL: https://issues.apache.org/jira/browse/TIKA-4526
Project: Tika
Issue Type: Test
Components: tika-server
Reporter: Tiancheng Dai
*Summary:*
TranslateResourceTest shows nondeterministic failures when run with
NonDex(shuffling nondeterministic method to find flakiness).
----
*Observation / How to Reproduce:*
Running the following command may intermittently fail with errors:
{{mvn edu.illinois:nondex-maven-plugin:2.2.1:nondex \
-pl tika-server/tika-server-core \
-Dtest=org.apache.tika.server.core.TranslateResourceTest \
-DnondexRuns=5}}
*Observed behavior:*
{{[INFO] -------------------------------------------------------}}
{{[INFO] T E S T S}}
{{[INFO] -------------------------------------------------------}}
{{[INFO] Running org.apache.tika.server.core.TranslateResourceTest}}
{{[ERROR] Tests run: 2, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 0.670
s <<< FAILURE! -- in org.apache.tika.server.core.TranslateResourceTest}}
{{[ERROR] org.apache.tika.server.core.TranslateResourceTest.testTranslateFull
-- Time elapsed: 0.644 s <<< FAILURE!}}
{{org.opentest4j.AssertionFailedError: expected: <This won't translate> but
was: <>}}
{{ at
org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:158)}}
{{ at
org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:139)}}
{{ at
org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:201)}}
{{ at
org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:184)}}
{{ at
org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:179)}}
{{ at
org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:1188)}}
{{{} at
org.apache.tika.server.core.TranslateResourceTest.testTranslateFull(TranslateResourceTest.java:73){}}}{{{}[ERROR]
org.apache.tika.server.core.TranslateResourceTest.testTranslateAutoLang --
Time elapsed: 0.017 s <<< FAILURE!{}}}
{{org.opentest4j.AssertionFailedError: expected: <This won't translate> but
was: <>}}
{{ at
org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:158)}}
{{ at
org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:139)}}
{{ at
org.junit.jupiter.api.AssertEquals.failNotEqual(AssertEquals.java:201)}}
{{ at
org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:184)}}
{{ at
org.junit.jupiter.api.AssertEquals.assertEquals(AssertEquals.java:179)}}
{{ at
org.junit.jupiter.api.Assertions.assertEquals(Assertions.java:1188)}}
{{{} at
org.apache.tika.server.core.TranslateResourceTest.testTranslateAutoLang(TranslateResourceTest.java:86){}}}{{{}[INFO]
{}}}
{{[INFO] Results:}}
{{[INFO] }}
{{[ERROR] Failures: }}
{{[ERROR] TranslateResourceTest.testTranslateAutoLang:86 expected: <This
won't translate> but was: <>}}
{{[ERROR] TranslateResourceTest.testTranslateFull:73 expected: <This won't
translate> but was: <>}}
{{[INFO] }}
{{{}[ERROR] Tests run: 2, Failures: 2, Errors: 0, Skipped: 0{}}}{{{}{}}}
*Expected behavior:*
*The test should deterministically pass under all NonDex seeds.*
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
