Hi all, I've setup a job to run our eval tests on the ASF infrastructure [1]. It will run daily. It takes around 6h 17min to complete. Mails from Jenkins are sent to the dev@ list. Thanks to Bruno for communicating with INFRA to get us a Jenkins space.
Note, that the job runs under Linux/Ubuntu and most of the tests are fine ;) - however, it seems, that we need to have a look into the opennlp-dl module as we have some failures (probably require a delta/eps in the assertion) but also an error, which needs revision. I have created OPENNLP-1478 to track it [2]. [ERROR] Failures: [ERROR] DocumentCategorizerDLEval.categorize:86 array contents differ at index [0], expected: <0.3391093313694> but was: <0.33910930156707764> [ERROR] DocumentCategorizerDLEval.categorizeWithInferenceOptions:154 array contents differ at index [1], expected: <0.11486853659152985> but was: <0.11486850678920746> [ERROR] DocumentCategorizerDLEval.scoreMap:179 expected: <0.04995147883892059> but was: <0.049951449036598206> [ERROR] NameFinderDLEval.tokenNameFinder1Test:67 expected: <8.251646041870117> but was: <8.251642227172852> [ERROR] Errors: [ERROR] DocumentCategorizerDLEval.sortedScoreMap:202 NullPointer Cannot invoke "java.u... [INFO] [ERROR] Tests run: 15, Failures: 4, Errors: 1, Skipped: 1 [INFO] [INFO] ---------------------------------------------------------------- -------- [INFO] Reactor Summary for Apache OpenNLP Reactor 2.1.2-SNAPSHOT: [INFO] [INFO] Apache OpenNLP Reactor ............................. SUCCESS [ 3.000 s] [INFO] Apache OpenNLP Tools ............................... SUCCESS [ 06:10 h] [INFO] Apache OpenNLP UIMA Annotators ..................... SUCCESS [ 4.584 s] [INFO] Apache OpenNLP Brat Annotator ...................... SUCCESS [ 5.109 s] [INFO] Apache OpenNLP Morfologik Addon .................... SUCCESS [ 8.617 s] [INFO] Apache OpenNLP Documentation ....................... SUCCESS [ 0.103 s] [INFO] Apache OpenNLP Distribution ........................ SUCCESS [ 15.329 s] [INFO] Apache OpenNLP DL .................................. FAILURE [ 30.542 s] [INFO] ---------------------------------------------------------------- -------- [INFO] BUILD FAILURE [INFO] ---------------------------------------------------------------- -------- [INFO] Total time: 06:11 h [INFO] Finished at: 2023-03-04T05:05:19Z [INFO] ---------------------------------------------------------------- -------- Gruß Richard [1] https://ci-builds.apache.org/job/OpenNLP/job/eval-tests/ [2] https://issues.apache.org/jira/browse/OPENNLP-1478
