[
https://issues.apache.org/jira/browse/NUTCH-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Osy updated NUTCH-1623:
-----------------------
Description:
For Nutch 2.2.1 in nutch-default.xml there is a description for this
functionality (!! NO IMPLEMENTED YET !!):
If true, no file content will be saved during fetch.
And it is probably what we want to set most of time, since [file://|file:///]
URLs
are meant to be local and we can always use them directly at parsing
and indexing stages. Otherwise file contents will be saved.
Exactly what I need.
Thanks
> Implement file.content.ignored function
> ---------------------------------------
>
> Key: NUTCH-1623
> URL: https://issues.apache.org/jira/browse/NUTCH-1623
> Project: Nutch
> Issue Type: New Feature
> Components: crawldb, fetcher
> Affects Versions: 2.2, 2.2.1
> Reporter: Osy
> Priority: Major
>
> For Nutch 2.2.1 in nutch-default.xml there is a description for this
> functionality (!! NO IMPLEMENTED YET !!):
> If true, no file content will be saved during fetch.
> And it is probably what we want to set most of time, since [file://|file:///]
> URLs
> are meant to be local and we can always use them directly at parsing
> and indexing stages. Otherwise file contents will be saved.
> Exactly what I need.
> Thanks
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)