I think that should be topN in generate. the generate.max.count will fetch those many pages for each fetch, not necessarily for each domain. The topN will only pull topN urls to be fetched for the fetch pass.
On Fri, Jul 5, 2013 at 1:13 AM, Markus Jelsma <[email protected]>wrote: > generate.max.count? > > > -----Original message----- > > From:Dennis Yurichev <[email protected]> > > Sent: Friday 5th July 2013 5:25 > > To: [email protected] > > Subject: limit to fetch only N pages from each host? > > > > Hi. > > > > How to limit nutch 2.x to fetch only N (5-10) pages from each host or > > domain? > > I fail to figure it out from config files. > > > > TIA! > > > > -- > > -- http://www.yurichev.com > > >
