Hi Yong, I am not sure what the question is here. It sounds you like have all pieces of info that you need.
Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch ----- Original Message ---- > From: wangyong <[EMAIL PROTECTED]> > To: [email protected] > Sent: Friday, April 18, 2008 9:53:59 AM > Subject: how to deal with the max number of outlinks and inlinks per page? > > > Hi all, I wonder if there is anything that can deal with the max > number > of outlinks and inlinks per page? I understand that I can simply set the max > number of fetched pages per layer in command line by using -topN parameter. I > looked for the answer to my question using google. The possible answer I > found > was "db.max.outlinks.per.parse" parameter which is the max number of outlinks > per page, and its default value is 100. Consider that some important > pages > in web can have over thousands outlinks, only fetch 100 of them is not a good > idea. So I ought to adjust this default value to a relatively large value. > But, > I have got no information about it. Would anyone has encountered this problem > before? Would anyone has the solutions of this problem? I have struggleed > with > it for hours. Have a good weeked. yong > _________________________________________________________________ > MSN 中文网,最新时尚生活资讯,白领聚集门户。 > http://cn.msn.com
