[
https://issues.apache.org/jira/browse/TIKA-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Wolanin updated TIKA-324:
-------------------------------
Attachment: TIKA-324.patch
TIKA-324-0.5.patch
Here is a patch for tika 0.5/trunk that resolves the bug (1 line change) and a
revised patch for 0.4 that sets indent to "true" for consistency.
For a quick test PDF - look at: http://nlp.stanford.edu/IR-book/pdf/00front.pdf
Without the patch, the math symbols like ω,ωk are obliterated.
> Tika CLI mangles utf-8 content in text (-t) mode
> ------------------------------------------------
>
> Key: TIKA-324
> URL: https://issues.apache.org/jira/browse/TIKA-324
> Project: Tika
> Issue Type: Bug
> Components: cli
> Affects Versions: 0.3, 0.4
> Environment: Mac OS 10.5, java version "1.6.0_15"
> Reporter: Peter Wolanin
> Priority: Critical
> Fix For: 0.5
>
> Attachments: test.txt, TIKA-324-0.5.patch, TIKA-324.patch,
> TIKA-324.patch
>
> Original Estimate: 2h
> Remaining Estimate: 2h
>
> When using the -t flag to tika, multi-byte content is destroyed in the output.
> Example:
> $ java -jar tika-app-0.4.jar -t ./test.txt
> I?t?rn?ti?n?liz?ti?n
> $ java -jar tika-app-0.4.jar -x ./test.txt
> <?xml version="1.0" encoding="UTF-8"?>
> <html xmlns="http://www.w3.org/1999/xhtml";>
> <head>
> <title/>
> </head>
> <body>
> <p>Iñtërnâtiônàlizætiøn
> </p>
> </body>
> </html>
> see also: http://drupal.org/node/622508#comment-2267918
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
