This is an automated email from the ASF dual-hosted git repository.
krickert pushed a change to branch OPENNLP-1833-grpc-expansion
in repository https://gitbox.apache.org/repos/asf/opennlp-sandbox.git
from b8e02272 OPENNLP-1833: Write integration test config with
Properties.store
add 5e2e9fcb OPENNLP-1833: Sync BertTokenizer copy with upstream review
fixes
No new revisions were added by this update.
Summary of changes:
opennlp-grpc/README.md | 14 ++
.../embedding/AbstractOnnxEmbeddingProvider.java | 64 ++++-
.../opennlp/grpc/embedding/BertTokenizer.java | 272 +++++++++++++++++++++
.../grpc/embedding/OnnxSentenceEmbedder.java | 102 ++++++--
.../opennlp/grpc/embedding/BertTokenizerTest.java | 135 ++++++++++
5 files changed, 550 insertions(+), 37 deletions(-)
create mode 100644
opennlp-grpc/opennlp-grpc-service/src/main/java/org/apache/opennlp/grpc/embedding/BertTokenizer.java
create mode 100644
opennlp-grpc/opennlp-grpc-service/src/test/java/org/apache/opennlp/grpc/embedding/BertTokenizerTest.java
