[
https://issues.apache.org/jira/browse/OPENNLP-1113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jeff Zemerick updated OPENNLP-1113:
-----------------------------------
Description:
When running the eval-tests for the 1.8.1 tag some of the tests consistently
fail on an EC2 instance. On another virtual machine the tests consistently
pass. When the tests fail the failures are consistent with the following:
{quote}Failed tests:
ArvoresDeitadasEval.evalPortugueseChunkerQnMultipleThreads:208->chunkerCrossEval:128
expected:<0.9649180953528779> but was:<0.9650518197155942>
ArvoresDeitadasEval.evalPortugueseSentenceDetectorMaxentQn:143->sentenceCrossEval:90
expected:<0.99261110833375> but was:<0.9927505074644777>
Conll02NameFinderEval.evalSpanishOrganizationMaxentQn:390->eval:90
expected:<0.682961897915169> but was:<0.6798418972332015>
ConllXPosTaggerEval.evalSwedishMaxentQn:152->eval:76
expected:<0.9347595473833098> but was:<0.9322842998585573>{quote}
Both systems are Ubuntu 16.04.2 running OpenJDK 1.8.0_131 but there must be
some other differences affecting the tests. Those differences need to be
identified.
*VM1 (Tests Consistently _Pass_)*
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-1022-aws", arch: "amd64", family: "unix"
LANG=en_US.UTF-8
*VM2 (Tests Consistently _Fail_)*
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-83-generic", arch: "amd64", family: "unix"
LANG=en_US.UTF-8
This VM also consistently fails when using Oracle JDK:
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-oracle/jre
*VM3 (Tests Consistently _Pass_)*
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-83-generic", arch: "amd64", family: "unix"
was:
When running the eval-tests for the 1.8.1 tag some of the tests consistently
fail on an EC2 instance. On another virtual machine the tests consistently
pass. When the tests fail the failures are consistent with the following:
{quote}Failed tests:
ArvoresDeitadasEval.evalPortugueseChunkerQnMultipleThreads:208->chunkerCrossEval:128
expected:<0.9649180953528779> but was:<0.9650518197155942>
ArvoresDeitadasEval.evalPortugueseSentenceDetectorMaxentQn:143->sentenceCrossEval:90
expected:<0.99261110833375> but was:<0.9927505074644777>
Conll02NameFinderEval.evalSpanishOrganizationMaxentQn:390->eval:90
expected:<0.682961897915169> but was:<0.6798418972332015>
ConllXPosTaggerEval.evalSwedishMaxentQn:152->eval:76
expected:<0.9347595473833098> but was:<0.9322842998585573>{quote}
Both systems are Ubuntu 16.04.2 running OpenJDK 1.8.0_131 but there must be
some other differences affecting the tests. Those differences need to be
identified.
*VM1 (Tests Consistently _Pass_)*
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-1022-aws", arch: "amd64", family: "unix"
LANG=en_US.UTF-8
*VM2 (Tests Consistently _Fail_)*
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-83-generic", arch: "amd64", family: "unix"
LANG=en_US.UTF-8
*VM3 (Tests Consistently _Pass_)*
Apache Maven 3.3.9
Maven home: /usr/share/maven
Java version: 1.8.0_131, vendor: Oracle Corporation
Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "4.4.0-83-generic", arch: "amd64", family: "unix"
> evalPortugueseChunkerQnMultipleThreads and other tests can fail
> ---------------------------------------------------------------
>
> Key: OPENNLP-1113
> URL: https://issues.apache.org/jira/browse/OPENNLP-1113
> Project: OpenNLP
> Issue Type: Test
> Affects Versions: 1.8.1
> Reporter: Jeff Zemerick
> Assignee: Jeff Zemerick
> Priority: Minor
>
> When running the eval-tests for the 1.8.1 tag some of the tests consistently
> fail on an EC2 instance. On another virtual machine the tests consistently
> pass. When the tests fail the failures are consistent with the following:
> {quote}Failed tests:
>
> ArvoresDeitadasEval.evalPortugueseChunkerQnMultipleThreads:208->chunkerCrossEval:128
> expected:<0.9649180953528779> but was:<0.9650518197155942>
>
> ArvoresDeitadasEval.evalPortugueseSentenceDetectorMaxentQn:143->sentenceCrossEval:90
> expected:<0.99261110833375> but was:<0.9927505074644777>
> Conll02NameFinderEval.evalSpanishOrganizationMaxentQn:390->eval:90
> expected:<0.682961897915169> but was:<0.6798418972332015>
> ConllXPosTaggerEval.evalSwedishMaxentQn:152->eval:76
> expected:<0.9347595473833098> but was:<0.9322842998585573>{quote}
> Both systems are Ubuntu 16.04.2 running OpenJDK 1.8.0_131 but there must be
> some other differences affecting the tests. Those differences need to be
> identified.
> *VM1 (Tests Consistently _Pass_)*
> Apache Maven 3.3.9
> Maven home: /usr/share/maven
> Java version: 1.8.0_131, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "4.4.0-1022-aws", arch: "amd64", family: "unix"
> LANG=en_US.UTF-8
> *VM2 (Tests Consistently _Fail_)*
> Apache Maven 3.3.9
> Maven home: /usr/share/maven
> Java version: 1.8.0_131, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "4.4.0-83-generic", arch: "amd64", family: "unix"
> LANG=en_US.UTF-8
> This VM also consistently fails when using Oracle JDK:
> Java version: 1.8.0_131, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-oracle/jre
> *VM3 (Tests Consistently _Pass_)*
> Apache Maven 3.3.9
> Maven home: /usr/share/maven
> Java version: 1.8.0_131, vendor: Oracle Corporation
> Java home: /usr/lib/jvm/java-8-openjdk-amd64/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux", version: "4.4.0-83-generic", arch: "amd64", family: "unix"
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
