[
https://issues.apache.org/jira/browse/TIKA-5027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18138380#comment-18138380
]
Hudson commented on TIKA-5027:
------------------------------
SUCCESS: Integrated in Jenkins build Tika ยป tika-main-jdk17 #1773 (See
[https://ci-builds.apache.org/job/Tika/job/tika-main-jdk17/1773/])
TIKA-5027: junk detector treats scripts without a usable table as unmodeled,
not junk (#3522) (github:
[https://github.com/apache/tika/commit/b739f6f25700f2a0736a737c02cb2672ec60c94b])
* (add)
tika-ml/tika-ml-junkdetect/src/test/java/org/apache/tika/ml/junkdetect/UnmodeledScriptTest.java
* (edit)
tika-eval/tika-eval-core/src/main/java/org/apache/tika/eval/core/metadata/TikaEvalMetadataFilter.java
* (edit)
tika-ml/tika-ml-junkdetect/src/main/java/org/apache/tika/ml/junkdetect/BigramTables.java
* (edit) tika-core/src/main/java/org/apache/tika/quality/TextQualityScore.java
* (edit)
tika-eval/tika-eval-app/src/main/java/org/apache/tika/eval/app/ProfilerBase.java
* (edit)
tika-ml/tika-ml-junkdetect-tools/src/main/java/org/apache/tika/ml/junkdetect/tools/TrainJunkModel.java
* (edit) CHANGES.txt
* (edit)
tika-ml/tika-ml-junkdetect-tools/src/test/java/org/apache/tika/ml/junkdetect/JunkDetectorRoundTripTest.java
* (edit)
tika-ml/tika-ml-junkdetect/src/main/java/org/apache/tika/ml/junkdetect/JunkDetector.java
TIKA-5027 provenance (#3525) (github:
[https://github.com/apache/tika/commit/f499ebaeee1608c9976c93c4ec28ecadbfbc282c])
* (edit)
tika-ml/tika-ml-junkdetect-tools/src/main/java/org/apache/tika/ml/junkdetect/tools/BuildJunkTrainingData.java
* (edit)
tika-ml/tika-ml-junkdetect-tools/src/main/java/org/apache/tika/ml/junkdetect/tools/TrainJunkModel.java
* (add)
tika-ml/tika-ml-junkdetect-tools/src/test/java/org/apache/tika/ml/junkdetect/tools/TrainingProvenanceTest.java
* (add)
tika-ml/tika-ml-junkdetect/src/test/java/org/apache/tika/ml/junkdetect/ModelProvenanceTest.java
* (add) tika-ml/tika-ml-junkdetect-tools/train-junk-model.sh
* (edit) tika-ml/tika-ml-junkdetect/pom.xml
* (add)
tika-ml/tika-ml-junkdetect-tools/src/main/java/org/apache/tika/ml/junkdetect/tools/TrainingProvenance.java
* (edit) docs/modules/ROOT/pages/advanced/junk-detection-build.adoc
* (add)
tika-ml/tika-ml-junkdetect/src/main/resources/org/apache/tika/ml/junkdetect/junkdetect.bin.provenance
> Improve junk detector
> ---------------------
>
> Key: TIKA-5027
> URL: https://issues.apache.org/jira/browse/TIKA-5027
> Project: Tika
> Issue Type: Task
> Reporter: Tim Allison
> Priority: Major
>
> In looking at charset detection, I found a number of things we could improve
> in junk detection.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
