[
https://issues.apache.org/jira/browse/NUTCH-872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13446407#comment-13446407
]
Christian Johnsson commented on NUTCH-872:
------------------------------------------
I got a little follow-up question on this.
If i use fetcher.store.content / false couse i want to save space in my
database i also need to set fetcher.parse to true since if it doesn't save the
fetched content i can't parse it later, only during the fetch.
Is this correct?
> Change the default fetcher.parse to FALSE
> -----------------------------------------
>
> Key: NUTCH-872
> URL: https://issues.apache.org/jira/browse/NUTCH-872
> Project: Nutch
> Issue Type: Improvement
> Affects Versions: 1.2, 1.3, nutchgora
> Reporter: Andrzej Bialecki
>
> I propose to change this property to false. The reason is that it's a safer
> default - parsing issues don't lead to a loss of the downloaded content. For
> larger crawls this is the recommended way to run Fetcher. Users that run
> smaller crawls can still override it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
