This is an automated email from the ASF dual-hosted git repository.
krickert pushed a change to branch feat/GH-1391-embed-batch-cap
in repository https://gitbox.apache.org/repos/asf/opennlp.git
from 7a560bd7a OPENNLP-1935: Regex removal (10/10): Forbid java.util.regex
in production code (#1348)
add 576206d29 GH-1389, GH-1390: Let SentenceVectorsDL run on a GPU and fix
the first CUDA request in a fresh JVM
add 99d88ba09 GH-1389: Skip the opennlp-dl-gpu tests where onnxruntime_gpu
has no native library
new 28a73a6c5 GH-1391: Test that embedAll caps the token positions of one
inference
new ca6486cc9 GH-1391: Cap the token positions of one embedAll inference
new 0bb417c15 GH-1391: Shorten the embedAll Javadoc and compute the
expected batch sizes
new ff24bab8b GH-1391: Test the batch boundaries and split groups of
embedAll
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
opennlp-core/opennlp-ml/opennlp-dl-gpu/pom.xml | 33 ++
.../src/main/java/opennlp/dl/AbstractDL.java | 6 +-
.../java/opennlp/dl/vectors/SentenceVectorsDL.java | 92 +++++-
.../opennlp/dl/AbstractDLColdStartCudaTest.java | 73 +++++
.../test/java/opennlp/dl/ColdStartCudaProbe.java | 58 ++++
.../src/test/java/opennlp/dl/GpuRequestTest.java | 112 +++++++
.../dl/vectors/OnnxTextEmbedderProviderTest.java | 11 +
.../vectors/SentenceVectorsDLBatchLimitTest.java | 293 +++++++++++++++++
.../dl/vectors/SentenceVectorsDLEmbedderTest.java | 57 ++++
.../SentenceVectorsDLInferenceOptionsTest.java | 349 +++++++++++++++++++++
opennlp-docs/src/docbkx/machine-learning.xml | 16 +
11 files changed, 1091 insertions(+), 9 deletions(-)
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/AbstractDLColdStartCudaTest.java
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/ColdStartCudaProbe.java
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/GpuRequestTest.java
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/vectors/SentenceVectorsDLBatchLimitTest.java
create mode 100644
opennlp-core/opennlp-ml/opennlp-dl/src/test/java/opennlp/dl/vectors/SentenceVectorsDLInferenceOptionsTest.java
