This is an automated email from the ASF dual-hosted git repository.
krickert pushed a change to branch sentencepiece
in repository https://gitbox.apache.org/repos/asf/opennlp.git
from e82aa10fb OPENNLP-1885: Align null contracts and annotations with the
review conventions
add a42d40f2a OPENNLP-1885: Address review: checked InvalidFormatException
for malformed models, tag helpers, javadoc throws
No new revisions were added by this update.
Summary of changes:
.../opennlp/tools/tokenize/WordpieceTokenizer.java | 7 +-
.../opennlp/subword/sentencepiece/ByteBuilder.java | 14 ++-
.../subword/sentencepiece/DoubleArrayTrie.java | 3 +
.../opennlp/subword/sentencepiece/IntBuilder.java | 12 ++-
.../subword/sentencepiece/ModelProtoReader.java | 103 +++++++++++++--------
.../opennlp/subword/sentencepiece/PieceTrie.java | 8 +-
.../sentencepiece/SentencePieceNormalizer.java | 4 +-
.../sentencepiece/SentencePieceTokenizer.java | 29 +++---
.../SentencePieceModelValidationTest.java | 11 ++-
9 files changed, 123 insertions(+), 68 deletions(-)
