This is an automated email from the ASF dual-hosted git repository.
krickert pushed a change to branch OPENNLP-1868
in repository https://gitbox.apache.org/repos/asf/opennlp.git
discard f9e03384b OPENNLP-1868: Bundled full case-folding rung with provenance
and audit
discard 4fd394555 OPENNLP-1850 Manual: qualify the dash-fold offset claim for
supplementary-plane dashes
discard 96913cb33 OPENNLP-1850 Align normalizer.xml DOCTYPE to the
OPENNLP-1854 local DTD catalog form
discard 07f6c5694 OPENNLP-1850 Review nits: manual uses
defaultChain()/matchingAnalyzer(); drop BM25/search framing
discard 4b35c4c81 OPENNLP-1850 Docs review nits: declare xmlns:xlink; populate
second ids2Labels example
discard bd099a199 OPENNLP-1850 Docs review nits: populate ids2Labels example;
rule-based hyphenation
discard 907d93f0b OPENNLP-1850 Mirror the Extended_Pictographic emoji caveat
in the tokenizer manual
discard 81c73f552 OPENNLP-1850 Tighten normalizer manual wording (review nits)
discard da78084ee OPENNLP-1850 Document the supplementary-dash offset shift in
the DL fold options
discard 42b631be0 OPENNLP-1850 Document the offset-aware substitution folds
(quotes, digits, ellipsis, bullets, umlaut)
discard ef68583cc OPENNLP-1850 Name the OffsetMappingNameFinder capability
interface in the manual
discard c60446cd0 OPENNLP-1850 Document the offset-aware normalization
pipeline (buildAligned)
discard a99f3f230 OPENNLP-1850 Document Unicode normalization, the UAX #29
tokenizer, and DL handling
discard 52f9281db OPENNLP-1850 Follow AlignedText.normalized() -> CharSequence
in NameFinderDL
discard b3a07d910 OPENNLP-1850 Review nits: extract testable DL guards;
merge-copy; capitalize msgs; migration note
discard e9cbd9cf0 OPENNLP-1850 Make mergeOverlappingSpans O(n log n) (dl)
discard 50d81eb48 OPENNLP-1850 Reject non-finite logits in softmax, not just
NaN (dl)
discard 99c2b0277 OPENNLP-1850 Fully-qualify TokenNameFinder javadoc links in
NameFinderDL
discard e6adaafb0 OPENNLP-1850 Fail loud on corrupt document-classification
model output
discard 157576442 OPENNLP-1850 Fail fast on null finder input; fix the GPU
eval test options
discard 4e33cd2af OPENNLP-1850 Harden fail-loud paths in the DL components
discard b922d516e OPENNLP-1850 Add real-model chunk-boundary eval tests; drop
dead label constants
discard 405f76f88 OPENNLP-1850 Resolve overlapping chunk spans and compose the
input alignment
discard 844d393af OPENNLP-1850 Add OffsetMappingNameFinder capability
interface and a findInOriginal end-to-end test
discard 39e7b7c6b OPENNLP-1850 Offset-safe, Unicode-aware input normalization
in the DL components
discard d5215693f OPENNLP-1850 Review nits: rename
searchAnalyzer->matchingAnalyzer; drop 'search' framing in profile docs
discard 5a68a357d OPENNLP-1850 Review nits: add Turkish profile; derive
coverage from the enum (profiles)
discard 8c89007f9 OPENNLP-1850 Resolve Norwegian nb/nn to the Norwegian
profile (profiles)
discard 4d5d5d21c OPENNLP-1850 Per-language NormalizationProfile registry (2c)
add 1b1f99fcd OPENNLP-1850 Term model hardening: fail loud on a
contract-violating Lemmatizer
add a6ed01e4d OPENNLP-1850 Per-language NormalizationProfile registry (2c)
add 32eac82de OPENNLP-1850 Resolve Norwegian nb/nn to the Norwegian
profile (profiles)
add 4d67305f4 OPENNLP-1850 Review nits: add Turkish profile; derive
coverage from the enum (profiles)
add 99d108c6c OPENNLP-1850 Review nits: rename
searchAnalyzer->matchingAnalyzer; drop 'search' framing in profile docs
add 9e89e779d OPENNLP-1850 Offset-safe, Unicode-aware input normalization
in the DL components
add 93c141ad3 OPENNLP-1850 Add OffsetMappingNameFinder capability
interface and a findInOriginal end-to-end test
add d28988c47 OPENNLP-1850 Resolve overlapping chunk spans and compose the
input alignment
add 35e8e64b9 OPENNLP-1850 Add real-model chunk-boundary eval tests; drop
dead label constants
add b213e99ba OPENNLP-1850 Harden fail-loud paths in the DL components
add 200d05219 OPENNLP-1850 Fail fast on null finder input; fix the GPU
eval test options
add 6f2dd62a0 OPENNLP-1850 Fail loud on corrupt document-classification
model output
add fa87d9887 OPENNLP-1850 Fully-qualify TokenNameFinder javadoc links in
NameFinderDL
add 97d86eb19 OPENNLP-1850 Reject non-finite logits in softmax, not just
NaN (dl)
add 9b783fe06 OPENNLP-1850 Make mergeOverlappingSpans O(n log n) (dl)
add 9aec5a624 OPENNLP-1850 Review nits: extract testable DL guards;
merge-copy; capitalize msgs; migration note
add 4515f61dd OPENNLP-1850 Follow AlignedText.normalized() -> CharSequence
in NameFinderDL
add 125162bd8 OPENNLP-1850 DL hardening: IllegalArgumentException null
contract and null-element guards
add dac1ddf22 OPENNLP-1850 Document Unicode normalization, the UAX #29
tokenizer, and DL handling
add 3a813f33c OPENNLP-1850 Document the offset-aware normalization
pipeline (buildAligned)
add 0a88e363f OPENNLP-1850 Name the OffsetMappingNameFinder capability
interface in the manual
add ebfa852f4 OPENNLP-1850 Document the offset-aware substitution folds
(quotes, digits, ellipsis, bullets, umlaut)
add dd95cb8fc OPENNLP-1850 Document the supplementary-dash offset shift in
the DL fold options
add b46138824 OPENNLP-1850 Tighten normalizer manual wording (review nits)
add 08c58b41b OPENNLP-1850 Mirror the Extended_Pictographic emoji caveat
in the tokenizer manual
add ed6ed0384 OPENNLP-1850 Docs review nits: populate ids2Labels example;
rule-based hyphenation
add 14a2721be OPENNLP-1850 Docs review nits: declare xmlns:xlink; populate
second ids2Labels example
add c5c58d463 OPENNLP-1850 Review nits: manual uses
defaultChain()/matchingAnalyzer(); drop BM25/search framing
add ea971822a OPENNLP-1850 Align normalizer.xml DOCTYPE to the
OPENNLP-1854 local DTD catalog form
add dc4df3cbb OPENNLP-1850 Manual: qualify the dash-fold offset claim for
supplementary-plane dashes
add 458e40709 OPENNLP-1868: Bundled full case-folding rung with provenance
and audit
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f9e03384b)
\
N -- N -- N refs/heads/OPENNLP-1868 (458e40709)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
opennlp-core/opennlp-ml/opennlp-dl/README.md | 4 ++++
.../src/main/java/opennlp/dl/AbstractDL.java | 20 +++++++++++------
.../opennlp/dl/doccat/DocumentCategorizerDL.java | 14 +++++++-----
.../java/opennlp/dl/namefinder/NameFinderDL.java | 26 +++++++++++++++-------
.../dl/doccat/DocumentCategorizerDLTest.java | 4 +++-
.../opennlp/dl/namefinder/NameFinderDLTest.java | 9 ++++++++
.../tools/util/normalizer/TermAnalyzer.java | 15 ++++++++++---
.../tools/util/normalizer/TermAnalyzerTest.java | 25 +++++++++++++++++++++
.../opennlp/dl/namefinder/NameFinderDLEval.java | 5 +++--
9 files changed, 96 insertions(+), 26 deletions(-)
