[ 
https://issues.apache.org/jira/browse/TIKA-1946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15770526#comment-15770526
 ] 

Tim Allison commented on TIKA-1946:
-----------------------------------

Much better.  I put the updated extracts in http://vmaddress/share as well as 
the updated db.

{noformat}
select mime_string, count(1) cnt
from profiles p
join mimes m on m.mime_type_id=p.mime_type_id
group by mime_string
order by cnt desc;
{noformat}

||MIME ||CNT||  
|application/vnd.wordperfect; version=5.1|      299|
|application/vnd.wordperfect; version=6.x|      178|
|application/x-quattro-pro; version=9|  54|
|application/x-quattro-pro; version=7-8|        17|
|application/vnd.wordperfect; version=5.0|      9|
|application/x-tika-msoffice|   2|

14 parse exceptions.

A few files look to have dodgy content.

Try 
{noformat}
select * from contents c
join profiles p on c.id = p.id
order by token_length_mean;
{noformat}

At least four appear to have missing charsets (note this only pulls back those 
where "todo" was in the top 10 terms...we'll need to do a full grep on the 
extracts).

{noformat}
select * from contents c
join profiles p on c.id = p.id
where top_n_words like '%todo%';
{noformat}




> Add mime detection and parser for WordPerfect
> ---------------------------------------------
>
>                 Key: TIKA-1946
>                 URL: https://issues.apache.org/jira/browse/TIKA-1946
>             Project: Tika
>          Issue Type: Improvement
>          Components: mime, parser
>            Reporter: Nick C
>             Fix For: 2.0, 1.15
>
>         Attachments: TIKA-1946-pascal.essiembre-01.patch, 
> wordperfect_mimes_fuller.zip, wordperfect_signatures_by_versions.xlsx
>
>
> I noticed some code on github for parsing WordPerfect files 
> (https://github.com/Norconex/importer) Also looks like the author 
> [~pascal.essiembre] has contributed to Tika before



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to