[
https://issues.apache.org/jira/browse/TIKA-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18100243#comment-18100243
]
Hudson commented on TIKA-4774:
------------------------------
SUCCESS: Integrated in Jenkins build Tika » tika-main-jdk17 #1505 (See
[https://ci-builds.apache.org/job/Tika/job/tika-main-jdk17/1505/])
TIKA-4774 -- defer to structural a bit more (#2976) (github:
[https://github.com/apache/tika/commit/758a57904fe4cbb189e2602a97e55c631ea8dcc1])
* (edit)
tika-ml/tika-ml-junkdetect/src/main/java/org/apache/tika/ml/junkdetect/JunkFilterEncodingDetector.java
* (edit)
tika-encoding-detectors/tika-encoding-detector-mojibuster/src/main/java/org/apache/tika/ml/chardetect/StructuralEncodingRules.java
* (edit)
tika-ml/tika-ml-junkdetect/src/test/java/org/apache/tika/ml/junkdetect/JunkFilterEncodingDetectorTest.java
> Metadata names encoding might have changed
> ------------------------------------------
>
> Key: TIKA-4774
> URL: https://issues.apache.org/jira/browse/TIKA-4774
> Project: Tika
> Issue Type: Bug
> Affects Versions: 4.0.0
> Reporter: David Pilato
> Assignee: Tim Allison
> Priority: Major
> Attachments: test.doc, test.html
>
>
> I'm trying to move FSCrawler to Tika 4.0.0-beta-1 to check if everything
> looks good on my side.
>
> While running some unit tests, I found that the metadata name encoding might
> be wrong (or I need to fix this on my side and I don't know it yet ;) )
>
> {{java.lang.AssertionError: }}
> {{Expecting map:}}
> {{{} {"Content-Encoding"="x-MacRoman", "Content-Location"="Web%20page",
> "Content-Type"="text/html; charset=x-MacRoman",
> "Content-Type-Hint"="text/html; charset=macintosh",
> "Content-Type-Magic-Detected"="text/html",
> "X-TIKA:Parsed-By"="org.apache.tika.parser.DefaultParser",
> "X-TIKA:Parsed-By-Full-Set"="org.apache.tika.parser.DefaultParser",
> "X-TIKA:detectedEncoding"="x-MacRoman",
> "X-TIKA:encodingDetectionTrace"="HtmlEncodingDetector->x-MacRoman[DECLARATIVE],
> MojibusterEncodingDetector->UTF-8[STRUCTURAL]
> [junk-filter-prefer-declarative]",
> "X-TIKA:encodingDetector"="HtmlEncodingDetector",
> "X-TIKA:resourceName"="test.html", "dc:title"="Test Tika title",
> "html:Generator"="Microsoft Word 15", "html:Mots clés"="keyword1, keyword2",
> "html:Originator"="Microsoft Word 15", "html:ProgId"="Word.Document",
> "html:Titre"="Test Tika title"{}}}}
> {{to contain entries:}}
> {{ ["html:Mots clés"="keyword1, keyword2"]}}
> {{but could not find the following map entries:}}
> {{ ["html:Mots clés"="keyword1, keyword2"]}}
> Note that i'm not seeing the same behavior with a doc (MSOffice). The
> metadata names are correctly encoded with the .doc file.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
