Hi all, I wonder if there is anything that can deal with the max number
of outlinks and inlinks per page? I understand that I can simply set the max
number of fetched pages per layer in command line by using -topN parameter. I
looked for the answer to my question using google. The possible answer I found
was "db.max.outlinks.per.parse" parameter which is the max number of outlinks
per page, and its default value is 100. Consider that some important pages
in web can have over thousands outlinks, only fetch 100 of them is not a good
idea. So I ought to adjust this default value to a relatively large value. But,
I have got no information about it. Would anyone has encountered this problem
before? Would anyone has the solutions of this problem? I have struggleed with
it for hours. Have a good weeked. yong
_________________________________________________________________
MSN 中文网,最新时尚生活资讯,白领聚集门户。
http://cn.msn.com