[
https://issues.apache.org/jira/browse/TIKA-2790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856107#comment-16856107
]
Ken Krugler commented on TIKA-2790:
-----------------------------------
[[email protected]] - I'd have to look at the code used to generate the
timing table, because there's a pretty high overhead for creating the detector.
So if you aren't re-using the detector, then for shorter strings you're mostly
measuring the startup time. If I just consider the last four entries (length
10K -> 100K) then it's a pretty good linear relationship (R^2 = .91).
> Consider switching lang-detection in tika-eval to open-nlp
> ----------------------------------------------------------
>
> Key: TIKA-2790
> URL: https://issues.apache.org/jira/browse/TIKA-2790
> Project: Tika
> Issue Type: Improvement
> Reporter: Tim Allison
> Priority: Major
> Attachments: fra_mixed_100000_0.0_0.txt, langid_20190509.zip,
> langid_20190510.zip, langid_20190514.zip, langid_20190514_plus_minus_1.zip
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
