[
https://issues.apache.org/jira/browse/NUTCH-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Markus Jelsma closed NUTCH-144.
-------------------------------
Resolution: Won't Fix
Bulk close of legacy issues:
http://www.lucidimagination.com/search/document/2738eeb014805854/clean_up_open_legacy_issues_in_jira
> corrupt language identifier tri files and bad language recognition for german
> -----------------------------------------------------------------------------
>
> Key: NUTCH-144
> URL: https://issues.apache.org/jira/browse/NUTCH-144
> Project: Nutch
> Issue Type: Improvement
> Affects Versions: 0.8
> Reporter: Bernhard Messer
> Priority: Minor
>
> Hi,
> i had a look at the generated language guesser tri files. As far as i can
> say, several of them (de.ngp, da.ngp, es.ngp) seems to be corrupt which leeds
> to bad language recognition ratio. For example the german tri file should
> contain the german special characters "ä", "ö", "ü" with their frequency. The
> text "grüne Hüte" which is typical german, is recognized as danish. May be
> the problem comes from wrong character encoding during training.
> Jerome, could you provide the training files so that the language identifier
> can be retrained ?
> regards
> Bernhard
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
