Tim Allison created TIKA-2325:
---------------------------------

             Summary: Allow specification of default lang for common words 
                 Key: TIKA-2325
                 URL: https://issues.apache.org/jira/browse/TIKA-2325
             Project: Tika
          Issue Type: Bug
          Components: tika-eval
            Reporter: Tim Allison
            Priority: Trivial


In tika-eval, we count "common words" based on the output of language id.  If 
we don't have a "common words" file for the identified language, we back off to 
the default language.  This was hard-coded as "en", let's make this 
configurable.

While we're at it, fix a bug that prevents counting common words in zh.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to