[
https://issues.apache.org/jira/browse/NUTCH-872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451340#comment-13451340
]
Christian Johnsson commented on NUTCH-872:
------------------------------------------
Ok, sorry. Will use mailing list next time.
It works when i use this.
bin/nutch fetch -Dfetcher.parse=true -Dfetcher.store.content=false $batchId
but with only 'bin/nutch fetch $batchid' and relying on the settings in the
config it doesn't work.
My config is:
<property>
<name>fetcher.parse</name>
<value>true</value>
<description>If true, fetcher will parse content. NOTE: previous releases
would
default to true. Since 2.0 this is set to false as a safer
default.</description>
</property>
<property>
<name>fetcher.store.content</name>
<value>false</value>
<description>If true, fetcher will store content.</description>
</property>
> Change the default fetcher.parse to FALSE
> -----------------------------------------
>
> Key: NUTCH-872
> URL: https://issues.apache.org/jira/browse/NUTCH-872
> Project: Nutch
> Issue Type: Improvement
> Affects Versions: 1.2, 1.3, nutchgora
> Reporter: Andrzej Bialecki
>
> I propose to change this property to false. The reason is that it's a safer
> default - parsing issues don't lead to a loss of the downloaded content. For
> larger crawls this is the recommended way to run Fetcher. Users that run
> smaller crawls can still override it.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
