[
https://issues.apache.org/jira/browse/TIKA-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris A. Mattmann resolved TIKA-1723.
-------------------------------------
Resolution: Fixed
Fix Version/s: 1.13
This is now done, Ken's Optimaize langdetect, N-gram langdetect and Text.jl
from MIT are all now integrated:
{noformat}
LMC-053601:tika1.13 mattmann$ git commit -m "Resolve conflicts in CHANGES.txt"
[master 2caf3da] Resolve conflicts in CHANGES.txt
LMC-053601:tika1.13 mattmann$ git push -u origin master
Counting objects: 477, done.
Delta compression using up to 8 threads.
Compressing objects: 100% (237/237), done.
Writing objects: 100% (477/477), 113.91 KiB | 0 bytes/s, done.
Total 477 (delta 134), reused 320 (delta 67)
remote: tika git commit: Resolve conflicts in CHANGES.txt
remote: tika git commit: Update with information about TIKA-1872, TIKA-1696 and
TIKA-1723.
remote: tika git commit: Merge branch 'TIKA-1872'
remote: tika git commit: Merge branch 'TIKA-1872' of
https://github.com/trevorlewis/tika into TIKA-1872
remote: tika git commit: Updated TextLangDetector and fixed build errors
remote: tika git commit: Merge branch 'master' of
https://git-wip-us.apache.org/repos/asf/tika into TIKA-1872
remote: tika git commit: Depend on 1.13-SNAPSHOT, not 2.0.
remote: tika git commit: Merge branch 'TIKA-1872' of
https://github.com/trevorlewis/tika into TIKA-1872
remote: tika git commit: Added missing license headers
remote: tika git commit: Add missing license headers
remote: tika git commit: fix for TIKA-1872 contributed by trevorlewis
remote: tika git commit: Make detector "discoverable", use that everywhere
remote: tika git commit: Move base lang detect classes to core
remote: tika git commit: Remove built-in lang detector
remote: tika git commit: Add tika-langdetect dependency in other modules
remote: tika git commit: Add project.build.sourceEncoding to properties
remote: tika git commit: Roll in new lang detect support in new module
remote: tika git commit: Add missing dependency on tika-test-resources
To https://git-wip-us.apache.org/repos/asf/tika.git
c9d508d..2caf3da master -> master
Branch master set up to track remote
{noformat}
Thanks [~kkrugler] and [~lewistre]!
> Integrate language-detector into Tika
> -------------------------------------
>
> Key: TIKA-1723
> URL: https://issues.apache.org/jira/browse/TIKA-1723
> Project: Tika
> Issue Type: Improvement
> Components: languageidentifier
> Affects Versions: 1.11
> Reporter: Ken Krugler
> Assignee: Ken Krugler
> Priority: Minor
> Fix For: 1.13
>
> Attachments: TIKA-1723-2.patch, TIKA-1723-3.patch, TIKA-1723.patch,
> TIKA-1723v2.patch
>
>
> The language-detector project at
> https://github.com/optimaize/language-detector is faster, has more languages
> (70 vs 13) and better accuracy than the built-in language detector.
> This is a stab at integrating it, with some initial findings. There are a
> number of issues this raises, especially if [~chrismattmann] moves forward
> with turning language detection into a pluggable extension point.
> I'll add comments with results below.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
