This is an automated email from the ASF dual-hosted git repository.
nightowl888 pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/lucenenet.git.
from 5c43454 Ported Lucene.Net.Analysis.OpenNLP + tests
new ef98efb Lucene.Net.Support.TreeDictionary: Normalized whitespace
new 8286214 Lucene.Net.Support.TreeSet: Finished implementation of
ISet<T> and added tests (LUCENENET-616)
new 88e7e4e Lucene.Net.Support.TreeSet: Fixed potential thread safety
issue with IntersectWith() by utilizing existing RetainAll() method.
new 7635aa7 Lucene.Net.Support.TreeDictionary: Created facade
TreeDictionary around C5's TreeDictionary with the same API as
System.Collections.Generic.SortedDictionary including input/output types and
exceptions. (LUCENENET-612, LUCENENET-616)
new aa630a0 Lucene.Net.Support.HashMap, Lucene.Net.Support.LinkedHashMap:
Corrected documentation - TreeDictionary doesn't allow duplicate keys.
new 1e1931c Lucene.Net.Support.TreeSet: Normalized whitespace
new 70b00ee Lucene.Net.Tests.Grouping.GroupFacetCollectorTest: Fixed
logging print issue
new 4c0084c Lucene.Net.Support.EnumerableExtensions: Added
TakeAllButLast() extension methods to IEnumerable<T>
new 0ab4eb7 BUG:
Lucene.Net.Highlighter.PostingsHighlight.PostingsHighlighter: SortedSet<T> has
the wrong behavior for getting a range of values (second argument is supposed
to be exclusive), so swapped in TreeSet<T> (LUCENENET-619)
new 7aae74a
Lucene.Net.Tests.Highlighter.VectorHighlight.SimpleFragmentsBuilderTest::TestRandomDiscreteMultiValueHighlighting():
Utilize BCL .Append(), ToString(), Count to reduce chances of issues caused by
bugs in extension methods
new b56aa78 Lucene.Net.Support.IdentityComparer: Added singleton pattern
to prevent creating unnecessary instances of IdentityComparer at runtime.
new bce6015 Lucene.Net.Support.Collections: Factored out AddAll(ISet<T>,
IEnumerable<T>) in favor of set.UnionWith()
new d33defb Corrected example in lucene-cli docs for
analysis-kuromoji-build-dictionary
new 1cb33f6 Lucene.Net.Analysis.Kuromoji: Changed GetInstance() >
Instance property for ConnectionCosts, TokenInfoDictionary, and
UnknownDictionary
new a5b7496 Lucene.Net.Analysis.SmartCn, Lucene.Net.Benchmark: Removed
out of date package release notes that only applied to icu-dotnet (we are now
using ICU4N instead).
new 77d57ac Lucene.Net.Util.Int32sRef: Added TODO about making the main
field into an indexer.
new 85b38e6 BUG: Updated platform detection on .NET Framework
new 71fcc19 Ported Lucene.Net.Analysis.Morfologik + tests
new 40dad16 Lucene.Net.Analysis.OpenNLP: Added Lucene compatibility
version, made some minor code improvements
new aa6b856
Lucene.Net.Analysis.Common.Analysis.Miscellaneous.PerFieldAnalyzerWrapper:
Added documentation to clarify that the IDictionary<TKey, TValue> type that is
provided will determine how the component behaves. (LUCENENET-612,
LUCENENET-616)
The 20 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
Lucene.Net.sln | 16 +-
build/Dependencies.props | 3 +
.../publish-test-results-for-test-projects.yml | 20 +
build/build.ps1 | 12 +
global.json | 9 +-
.../Miscellaneous/PerFieldAnalyzerWrapper.cs | 32 +-
.../Dict/CharacterDefinition.cs | 5 +-
.../Dict/ConnectionCosts.cs | 5 +-
.../Dict/TokenInfoDictionary.cs | 10 +-
.../Dict/UnknownDictionary.cs | 7 +-
.../JapaneseTokenizer.cs | 6 +-
.../Lucene.Net.Analysis.Morfologik.csproj} | 43 +-
.../Morfologik/MorfologikAnalyzer.cs | 79 ++
.../Morfologik/MorfologikFilter.cs | 183 +++
.../Morfologik/MorfologikFilterFactory.cs | 105 ++
.../IMorphosyntacticTagsAttribute.cs} | 36 +-
.../MorphosyntacticTagsAttribute.cs | 105 ++
src/Lucene.Net.Analysis.Morfologik/Uk/README | 11 +
.../Uk/UkrainianMorfologikAnalyzer.cs | 177 +++
.../Uk/mapping_uk.txt} | 12 +-
.../Uk/stopwords.txt | 1269 ++++++++++++++++++++
src/Lucene.Net.Analysis.Morfologik/Uk/tagset.txt | 170 +++
.../Uk/ukrainian.dict | Bin 0 -> 6929502 bytes
.../Uk/ukrainian.info | 10 +
.../OpenNLPChunkerFilter.cs | 7 +-
.../OpenNLPChunkerFilterFactory.cs | 5 +-
.../OpenNLPLemmatizerFilter.cs | 4 +-
.../OpenNLPLemmatizerFilterFactory.cs | 7 +-
.../OpenNLPPOSFilter.cs | 7 +-
.../OpenNLPPOSFilterFactory.cs | 5 +-
.../OpenNLPSentenceBreakIterator.cs | 3 +-
.../OpenNLPTokenizer.cs | 7 +-
.../OpenNLPTokenizerFactory.cs | 3 +-
.../Tools/NLPChunkerOp.cs | 5 +-
.../Tools/NLPLemmatizerOp.cs | 3 +-
.../Tools/NLPNERTaggerOp.cs | 3 +-
.../Tools/NLPPOSTaggerOp.cs | 5 +-
.../Tools/NLPSentenceDetectorOp.cs | 3 +-
.../Tools/NLPTokenizerOp.cs | 3 +-
.../Tools/OpenNLPOpsFactory.cs | 25 +-
.../Lucene.Net.Analysis.SmartCn.csproj | 1 -
.../Lucene.Net.Benchmark.csproj | 1 -
.../PostingsHighlight/PostingsHighlighter.cs | 7 +-
src/Lucene.Net.Queries/Function/ValueSource.cs | 2 +-
.../Properties/AssemblyInfo.cs | 2 +
.../Analysis/MockCharFilter.cs | 5 +-
.../Store/MockDirectoryWrapper.cs | 2 +-
.../Dict/TestTokenInfoDictionary.cs | 4 +-
.../TestJapaneseTokenizer.cs | 2 +-
.../Lucene.Net.Tests.Analysis.Morfologik.csproj | 47 +
.../Morfologik/TestMorfologikAnalyzer.cs | 235 ++++
.../Morfologik/TestMorfologikFilterFactory.cs | 107 ++
.../Morfologik/custom-dictionary.dict | Bin 0 -> 90 bytes
.../Morfologik/custom-dictionary.info | 24 +
.../Morfologik/custom-dictionary.input | 2 +
.../Uk/TestUkrainianAnalyzer.cs | 92 ++
.../TestOpenNLPChunkerFilterFactory.cs | 2 +-
.../TestOpenNLPLemmatizerFilterFactory.cs | 6 +-
.../TestOpenNLPPOSFilterFactory.cs | 4 +-
.../TestOpenNLPSentenceBreakIterator.cs | 3 +-
.../TestOpenNLPTokenizerFactory.cs | 3 +-
.../GroupFacetCollectorTest.cs | 2 +-
.../VectorHighlight/SimpleFragmentsBuilderTest.cs | 24 +-
.../Support/{ => C5}/TestTreeDictionary.cs | 2 +-
.../Support/TestEnumerableExtensions.cs} | 36 +-
src/Lucene.Net.Tests/Support/TestTreeDictionary.cs | 699 +++++++----
src/Lucene.Net.Tests/Support/TestTreeSet.cs | 202 ++++
src/Lucene.Net/Index/DocumentsWriterPerThread.cs | 4 +-
src/Lucene.Net/Index/ParallelAtomicReader.cs | 4 +-
src/Lucene.Net/Index/ParallelCompositeReader.cs | 6 +-
src/Lucene.Net/Index/SegmentCommitInfo.cs | 2 +-
src/Lucene.Net/Index/SegmentCoreReaders.cs | 2 +-
src/Lucene.Net/Support/Collections.cs | 10 -
src/Lucene.Net/Support/EnumerableExtensions.cs | 67 +-
src/Lucene.Net/Support/HashMap.cs | 2 +-
src/Lucene.Net/Support/IdentityComparer.cs | 40 +-
src/Lucene.Net/Support/IdentityHashMap.cs | 8 +-
src/Lucene.Net/Support/IdentityHashSet.cs | 6 +-
src/Lucene.Net/Support/LinkedHashMap.cs | 2 +-
src/Lucene.Net/Support/TreeDictionary.cs | 1229 ++++++++++++++++++-
src/Lucene.Net/Support/TreeSet.cs | 385 ++++--
src/Lucene.Net/Util/Constants.cs | 8 +-
src/Lucene.Net/Util/IntsRef.cs | 2 +-
.../docs/analysis/kuromoji-build-dictionary.md | 2 +-
84 files changed, 5241 insertions(+), 474 deletions(-)
copy src/{Lucene.Net.Analysis.OpenNLP/Lucene.Net.Analysis.OpenNLP.csproj =>
Lucene.Net.Analysis.Morfologik/Lucene.Net.Analysis.Morfologik.csproj} (50%)
create mode 100644
src/Lucene.Net.Analysis.Morfologik/Morfologik/MorfologikAnalyzer.cs
create mode 100644
src/Lucene.Net.Analysis.Morfologik/Morfologik/MorfologikFilter.cs
create mode 100644
src/Lucene.Net.Analysis.Morfologik/Morfologik/MorfologikFilterFactory.cs
copy
src/{Lucene.Net.Analysis.ICU/Analysis/Icu/TokenAttributes/ScriptAttribute.cs =>
Lucene.Net.Analysis.Morfologik/Morfologik/TokenAttributes/IMorphosyntacticTagsAttribute.cs}
(53%)
create mode 100644
src/Lucene.Net.Analysis.Morfologik/Morfologik/TokenAttributes/MorphosyntacticTagsAttribute.cs
create mode 100644 src/Lucene.Net.Analysis.Morfologik/Uk/README
create mode 100644
src/Lucene.Net.Analysis.Morfologik/Uk/UkrainianMorfologikAnalyzer.cs
copy src/{Lucene.Net.Tests.Analysis.Common/Analysis/Miscellaneous/keep-1.txt
=> Lucene.Net.Analysis.Morfologik/Uk/mapping_uk.txt} (72%)
create mode 100644 src/Lucene.Net.Analysis.Morfologik/Uk/stopwords.txt
create mode 100644 src/Lucene.Net.Analysis.Morfologik/Uk/tagset.txt
create mode 100644 src/Lucene.Net.Analysis.Morfologik/Uk/ukrainian.dict
create mode 100644 src/Lucene.Net.Analysis.Morfologik/Uk/ukrainian.info
create mode 100644
src/Lucene.Net.Tests.Analysis.Morfologik/Lucene.Net.Tests.Analysis.Morfologik.csproj
create mode 100644
src/Lucene.Net.Tests.Analysis.Morfologik/Morfologik/TestMorfologikAnalyzer.cs
create mode 100644
src/Lucene.Net.Tests.Analysis.Morfologik/Morfologik/TestMorfologikFilterFactory.cs
create mode 100644
src/Lucene.Net.Tests.Analysis.Morfologik/Morfologik/custom-dictionary.dict
create mode 100644
src/Lucene.Net.Tests.Analysis.Morfologik/Morfologik/custom-dictionary.info
create mode 100644
src/Lucene.Net.Tests.Analysis.Morfologik/Morfologik/custom-dictionary.input
create mode 100644
src/Lucene.Net.Tests.Analysis.Morfologik/Uk/TestUkrainianAnalyzer.cs
copy src/Lucene.Net.Tests/Support/{ => C5}/TestTreeDictionary.cs (99%)
copy
src/{Lucene.Net.Tests.Benchmark/Support/TestEnglishNumberFormatExtensions.cs =>
Lucene.Net.Tests/Support/TestEnumerableExtensions.cs} (52%)
