[
https://issues.apache.org/jira/browse/TIKA-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18139915#comment-18139915
]
Hudson commented on TIKA-5029:
------------------------------
SUCCESS: Integrated in Jenkins build Tika ยป tika-main-jdk17 #1781 (See
[https://ci-builds.apache.org/job/Tika/job/tika-main-jdk17/1781/])
TIKA-5029 (#3533) (github:
[https://github.com/apache/tika/commit/e2fd85f94a01b22d3e45bb078ee6a502e9f3aaed])
* (edit) tika-core/src/test/java/org/apache/tika/mime/MimeDetectionTest.java
* (edit) CHANGES.txt
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-integration-tests/src/test/java/org/apache/tika/parser/ParsingReaderTest.java
* (edit)
tika-parsers/tika-parsers-standard/tika-parsers-standard-modules/tika-parser-cad-module/pom.xml
* (edit) tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.xml
* (add) tika-core/src/test/java/org/apache/tika/mime/MimeTypesLintTest.java
* (edit) tika-core/src/test/java/org/apache/tika/mime/MimeTypesReaderTest.java
* (add)
tika-core/src/test/java/org/apache/tika/mime/NicheFormatDetectionTest.java
* (edit) tika-core/src/main/java/org/apache/tika/mime/MimeTypesReader.java
> Mine octet-stream in commoncrawl to improve detection
> -----------------------------------------------------
>
> Key: TIKA-5029
> URL: https://issues.apache.org/jira/browse/TIKA-5029
> Project: Tika
> Issue Type: Task
> Reporter: Tim Allison
> Priority: Minor
>
> With the advent of agents, we can have point them at files that were
> identified as application/octet-stream in commoncrawl and look for patterns.
> The mime_detected field in commoncrawl derives from Tika, so we know at least
> that an earlier version of Tika couldn't identify these files.
> Just looking at the 10k octet-streams in our regression corpus has found some
> nice improvements.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
