[
https://issues.apache.org/jira/browse/PDFBOX-3058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14978696#comment-14978696
]
Tim Allison commented on PDFBOX-3058:
-------------------------------------
Since the last run, I made some changes to our slice of Common Crawl corpus:
# I stripped out all file extensions
# I removed files that were close to 1MB on the theory that they were probably
truncated
There may still very well be corrupt files.
I also changed our content handler to the BodyContentHandler so that the title
metadata field doesn't sneak into the body content.
I finished a comparison of [1.8.10 and 2.0 build
19356_1797|https://github.com/tballison/share/blob/master/pdfbox_comparisons/reports_pdfbox_1_8_10V2_0_193546_1797.zip]
I haven't had a chance to join in Tilman's notes. I also haven't had a chance
to make the tables slightly more user friendly by adding actual hyperlinks, but
I thought I'd share what I have now. Work in progress...
As we start to process fresh warcs from Common Crawl, I plan to extract only
those not marked truncated and then to run a repull of those that were
identified as truncated.
> Support TIKA Migration to PDFBox 2.0
> ------------------------------------
>
> Key: PDFBOX-3058
> URL: https://issues.apache.org/jira/browse/PDFBOX-3058
> Project: PDFBox
> Issue Type: Bug
> Affects Versions: 2.0.0
> Reporter: Maruan Sahyoun
> Attachments: NZAZKTQYKDD2HSBCSJJN6XSEA4KJEONU_1_8_10.json,
> NZAZKTQYKDD2HSBCSJJN6XSEA4KJEONU_2_0.json, content_diffs-1.8-to-2.0.xlsx
>
>
> This issue is to track fixing issues which came up as part of TIKA-1285
> (Upgrade to PDFBox 2.0.0 when available) mainly
> - new exceptions compared to PDFBox 1.8.x
> - regressions in text extraction
> - lower quality text extraction
> There should be individual issues to track tasks/bugs arising from that.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
