Sebastian Nagel created NUTCH-1389:
--------------------------------------
Summary: parsechecker and indexchecker to report truncated content
Key: NUTCH-1389
URL: https://issues.apache.org/jira/browse/NUTCH-1389
Project: Nutch
Issue Type: Improvement
Components: indexer, parser
Affects Versions: 1.5, nutchgora
Reporter: Sebastian Nagel
Priority: Minor
ParserChecker and IndexingFiltersChecker should report when a document is
truncated due to {http,file,ftp}.content.limit.
Truncated content may cause text and metadata extraction to fail for PDF and
other binary document formats.
A hint that truncation (and not a broken plugin) is the possible reason would
be useful.
See NUTCH-965 and {{ParseSegment.isTruncated(content)}}.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
