db.score.link.internal and db.score.link.external are ignored
-------------------------------------------------------------
Key: NUTCH-324
URL: http://issues.apache.org/jira/browse/NUTCH-324
Project: Nutch
Issue Type: Improvement
Components: fetcher
Reporter: Stefan Groschupf
Priority: Critical
Configuration properties db.score.link.external and db.score.link.internal are
ignored.
In case of e.g. message board webpages or pages that have larger navigation
menus on each page having a lower impact of internal links makes a lot of sense
for scoring.
Also for web spam this is a serious problem, since now spammers can setup just
one domain with dynamically generated pages and this highly manipulate the
nutch scores.
So I also suggest that we give db.score.link.internal by default a value of
something like 0.25.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
