[
https://issues.apache.org/jira/browse/TIKA-5062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Allison updated TIKA-5062:
------------------------------
Priority: Minor (was: Major)
> Improve text/binary classification
> ----------------------------------
>
> Key: TIKA-5062
> URL: https://issues.apache.org/jira/browse/TIKA-5062
> Project: Tika
> Issue Type: Task
> Reporter: Tim Allison
> Priority: Minor
>
> Since the beginning of time, Tika has used a heuristic fallback TextDetector
> if MimeTypes couldn't find a match. The heuristics were based on ascii and
> utf-8, not legacy encoded text.
> We should experiment to see if we can get a small model to outperform the
> current heuristic and be robust against legacy encoded text.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
