This is an automated email from the ASF dual-hosted git repository.
krickert pushed a change to branch OPENNLP-1893-hunspell
in repository https://gitbox.apache.org/repos/asf/opennlp.git
discard 872272560 OPENNLP-1893: Add {@inheritDoc} to the stemmer overrides and
trim empty javadoc lines
discard d020e16ee OPENNLP-1893: Apply the review-convention pass: factual
license prose, split null contracts, thread-safety annotations
discard 0f958cc6a OPENNLP-1893: Add hunspell manual coverage with
mirror-tested examples
discard 369d61934 OPENNLP-1893: Honor the blocking flags, circumfixes, and
compound positioning
discard bd222fd67 OPENNLP-1893: Decompose unanalyzed words into two flagged
compound parts
discard 50b148c2d OPENNLP-1893: Walk only the affix rules that can apply,
bucketed by their boundary character
discard 7175791b6 OPENNLP-1893: Resolve numeric dictionary flags through the
AF alias table
discard 3c2da75e7 OPENNLP-1893: Read flags as code points, tolerate trailing
morphology, and stem nothing from nothing
discard 9cf76647b OPENNLP-1893: Cut morphology like hunspell does, accept
UTF-8 flags and strip-only rules, and read the parser through the whitespace
seam
discard 8bee7cb5b OPENNLP-1893: Document Hunspell dictionary acquisition with
a license-preserving download helper
discard 3c47dc305 OPENNLP-1893: Usage, threading, and malformed-input tests
for the Hunspell engine, precise javadoc
discard f85e909d3 OPENNLP-1893: Twofold suffix analysis through Hunspell
continuation classes
discard 24930835e OPENNLP-1893: Hunspell-format affix engine over
user-supplied dictionaries
add 9951bfd0a OPENNLP-1870: Add opt-in emoji annotations for NameFinder,
Doccat, and Sentiment (#1177)
add 8eef045b6 Minor: Regenerated NOTICE File for
9951bfd0ae0aee8ca77eb436702e5544fbea2afc
add 66526b528 [maven-release-plugin] prepare release opennlp-3.0.0-M5
add a8642301f [maven-release-plugin] prepare for next development iteration
add 143138f34 OPENNLP-1893: Hunspell-format affix engine over
user-supplied dictionaries
add ab4f0014c OPENNLP-1893: Twofold suffix analysis through Hunspell
continuation classes
add be2a69bdd OPENNLP-1893: Usage, threading, and malformed-input tests
for the Hunspell engine, precise javadoc
add ddcef9379 OPENNLP-1893: Document Hunspell dictionary acquisition with
a license-preserving download helper
add 4bdebceda OPENNLP-1893: Cut morphology like hunspell does, accept
UTF-8 flags and strip-only rules, and read the parser through the whitespace
seam
add 71cc6bcc7 OPENNLP-1893: Read flags as code points, tolerate trailing
morphology, and stem nothing from nothing
add 0fc3a0fce OPENNLP-1893: Resolve numeric dictionary flags through the
AF alias table
add 6ec7a09c1 OPENNLP-1893: Walk only the affix rules that can apply,
bucketed by their boundary character
add 4b8bdd2b5 OPENNLP-1893: Decompose unanalyzed words into two flagged
compound parts
add eab714729 OPENNLP-1893: Honor the blocking flags, circumfixes, and
compound positioning
add 47fea9796 OPENNLP-1893: Add hunspell manual coverage with
mirror-tested examples
add b2c9d36d7 OPENNLP-1893: Apply the review-convention pass: factual
license prose, split null contracts, thread-safety annotations
add 65a1c3144 OPENNLP-1893: Add {@inheritDoc} to the stemmer overrides and
trim empty javadoc lines
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (872272560)
\
N -- N -- N refs/heads/OPENNLP-1893-hunspell (65a1c3144)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
LICENSE | 8 +-
NOTICE | 9 +
.../tools/doccat/EmojiFeatureGenerator.java | 82 +++++++
.../sentiment/EmojiSentimentContextGenerator.java | 87 +++++++
.../tools/sentiment/EmojiSentimentFactory.java} | 46 ++--
.../EmojiAnnotationFeatureGenerator.java | 83 +++++++
...=> EmojiAnnotationFeatureGeneratorFactory.java} | 24 +-
.../tools/util/normalizer/EmojiAnnotation.java | 197 ++++++++++++++++
.../tools/util/normalizer/EmojiAnnotationJoin.java | 51 ++++
.../tools/util/normalizer/EmojiAnnotations.java | 256 +++++++++++++++++++++
.../tools/util/normalizer/EmojiAnnotator.java | 197 ++++++++++++++++
.../tools/util/normalizer/EmojiCategory.java | 62 +++++
.../tools/util/normalizer/EmojiEntityType.java | 57 +++++
.../opennlp/tools/util/normalizer/EmojiFlags.java | 227 ++++++++++++++++++
.../tools/util/normalizer/emoji-annotations.txt | 212 +++++++++++++++++
.../tools/doccat/EmojiFeatureGeneratorTest.java | 80 +++++++
.../EmojiSentimentContextGeneratorTest.java | 72 ++++++
.../EmojiAnnotationFeatureGeneratorTest.java | 127 ++++++++++
.../util/normalizer/EmojiAnnotationsTest.java | 256 +++++++++++++++++++++
.../tools/util/normalizer/EmojiAnnotatorTest.java | 176 ++++++++++++++
.../normalizer/EmojiAnnotatorUsageExampleTest.java | 65 ++++++
.../tools/util/normalizer/EmojiFlagsTest.java | 147 ++++++++++++
.../tools/util/normalizer/NormalizerTestUtil.java | 29 ++-
opennlp-distr/src/main/readme/LICENSE | 5 +-
opennlp-distr/src/main/readme/NOTICE | 9 +
opennlp-docs/src/docbkx/normalizer.xml | 67 +++++-
src/license/NOTICE.template | 9 +
27 files changed, 2586 insertions(+), 54 deletions(-)
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/doccat/EmojiFeatureGenerator.java
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/sentiment/EmojiSentimentContextGenerator.java
copy
opennlp-core/{opennlp-ml/opennlp-ml-commons/src/main/java/opennlp/tools/ml/model/ObjectDataReader.java
=>
opennlp-runtime/src/main/java/opennlp/tools/sentiment/EmojiSentimentFactory.java}
(50%)
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/featuregen/EmojiAnnotationFeatureGenerator.java
copy
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/featuregen/{CharacterNgramFeatureGeneratorFactory.java
=> EmojiAnnotationFeatureGeneratorFactory.java} (60%)
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/normalizer/EmojiAnnotation.java
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/normalizer/EmojiAnnotationJoin.java
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/normalizer/EmojiAnnotations.java
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/normalizer/EmojiAnnotator.java
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/normalizer/EmojiCategory.java
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/normalizer/EmojiEntityType.java
create mode 100644
opennlp-core/opennlp-runtime/src/main/java/opennlp/tools/util/normalizer/EmojiFlags.java
create mode 100644
opennlp-core/opennlp-runtime/src/main/resources/opennlp/tools/util/normalizer/emoji-annotations.txt
create mode 100644
opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/doccat/EmojiFeatureGeneratorTest.java
create mode 100644
opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/sentiment/EmojiSentimentContextGeneratorTest.java
create mode 100644
opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/util/featuregen/EmojiAnnotationFeatureGeneratorTest.java
create mode 100644
opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/util/normalizer/EmojiAnnotationsTest.java
create mode 100644
opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/util/normalizer/EmojiAnnotatorTest.java
create mode 100644
opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/util/normalizer/EmojiAnnotatorUsageExampleTest.java
create mode 100644
opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/util/normalizer/EmojiFlagsTest.java
copy
opennlp-api/src/main/java/opennlp/tools/util/normalizer/CharSequenceNormalizer.java
=>
opennlp-core/opennlp-runtime/src/test/java/opennlp/tools/util/normalizer/NormalizerTestUtil.java
(57%)
