[
https://issues.apache.org/jira/browse/TIKA-3213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17648268#comment-17648268
]
Tim Allison commented on TIKA-3213:
-----------------------------------
I removed the svg files from the content-diffs file. There are some files that
show regressions, but overall there's substantial improvement. The other point
to consider is that we only have diffs in ~1100 (non-svg) files out of
~1million. I'll make the commit. We can back it out if there are objections.
> Consider migrating universalcharsetdetector to a live fork
> ----------------------------------------------------------
>
> Key: TIKA-3213
> URL: https://issues.apache.org/jira/browse/TIKA-3213
> Project: Tika
> Issue Type: Task
> Reporter: Tim Allison
> Priority: Major
> Attachments: content_diffs_no_exceptions-no-svg.xlsx
>
>
> I just came across this living fork of the aged juniversalchardet (2011!!!):
> https://github.com/albfernandez/juniversalchardet
> It has a mozilla license, has decent star count and is published on maven
> central.
> Obv, we'll want to run a comparison on our corpus before making this change,
> but I wanted to open this issue for discussion.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
