I would guess any page that has more than 100 links on it is not done for humans but for spamming search engines.

Am 27.12.2005 um 11:38 schrieb K.A.Hussain Ali:


HI all.

Do the db.max.outlinks.per.page value in the Nutch-default.xml has limitation ?

when i crawl using the default value of 100 it fail to get many links ?

Do this value controls the number of links to be fetched from a page ?

Any suggestion would greatly help.
Thanks in advance

regards
-Hussain


Reply via email to