[
https://issues.apache.org/jira/browse/TIKA-4370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17924073#comment-17924073
]
Tim Allison edited comment on TIKA-4370 at 2/5/25 1:45 PM:
-----------------------------------------------------------
bq. Haha new thing called TextAndCSVParser
Sorry. I thought you were eventually parsing stuff. I'm guessing, now, you're
only doing detection?
bq. can we do TXTParser and if type is determined to Shift-JIS we return
text/plain.
Perhaps, if the file is application/octet-stream, run the charset detector on
the bytes and if the charset is detected as Shift-JIS then return text/pain.
Maybe? The problem is that you'll likely get at least one charset detector to
"detect" something on every file. Maybe you could limit the trigger of
text/plain to specific charsets for your use case?
I'd be really worried about this as a general solution within default Tika.
You can certainly try it out... I would definitely put the the text parser
module on your class path so that its charset detectors are available.
was (Author: [email protected]):
bq. Haha new thing called TextAndCSVParser
Sorry. I thought you were eventually parsing stuff. I'm guessing, now, you're
only doing detection?
bq. can we do TXTParser and if type is determined to Shift-JIS we return
text/plain.
Perhaps, if the file is application/octet-stream, run the charset detector on
the bytes and if the charset is detected as Shift-JIS then return text/pain.
Maybe? The problem is that you'll likely get at least one charset detector to
"detect" something on every file.
You can certainly try it out... I would definitely put the the text parser
module on your class path so that its charset detectors are available.
> SJIS Encoded Files Can't be Detected
> ------------------------------------
>
> Key: TIKA-4370
> URL: https://issues.apache.org/jira/browse/TIKA-4370
> Project: Tika
> Issue Type: Bug
> Reporter: Subbu
> Priority: Major
>
> When character encoding of file is SJIS, without file name in the metadata,
> most files content-type detected as application/octet-stream. Is there zero
> support for SJIS?
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
