[
https://issues.apache.org/jira/browse/TIKA-683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13092320#comment-13092320
]
Michael McCandless commented on TIKA-683:
-----------------------------------------
I'm now testing the approach of just making our own simple RTF tokenizer, that
handles those control words relevant to the text that we need... I'll post a
patch once I have something sort of working.
> RTF Parser issues with non european characters
> ----------------------------------------------
>
> Key: TIKA-683
> URL: https://issues.apache.org/jira/browse/TIKA-683
> Project: Tika
> Issue Type: Bug
> Components: parser
> Affects Versions: 0.9
> Reporter: Nick Burch
> Assignee: Chris A. Mattmann
> Attachments: TIKA-683-unicode-testcase.patch, TIKA-683.patch,
> TIKA-683.patch, testRTFJapanese.rtf,
> testUnicodeUCNControlWordCharacterDoubling.rtf,
> testWORD_bold_character_runs.docx, testWORD_bold_character_runs2.docx
>
>
> As reported on user@ in "non-West European languages support":
>
> http://mail-archives.apache.org/mod_mbox/tika-user/201107.mbox/%3cof0c0a3275.da7810e9-onc22578cc.0051eede-c22578cc.00525...@il.ibm.com%3E
> The RTF Parser seems to be doubling up some non-european characters
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
