What does your crawl-urlfilter.txt file look like? On Sun, Sep 21, 2008 at 12:05 PM, nutch_newbie <[EMAIL PROTECTED]>wrote:
> > Hello everyone > I'm having some trouble with something in my nutch application, but have a > hard time finding it, let alone fixing it. So if anyone can help with any > suggestions, i would really appreciate it. > My nutch is working just fine, it fetched and crawled, etc. and displays > results. Only its not growing. > My understanding is that when it has a url, as time goes by, it also > somehow > starts including links on that url... like if i give it samplewebsite.com, > and that website has a link on it (ex: someotherwebsite.com), it will > eventlually display it during a search. so over time, instead of 6 results > per keyword, i would get 7 or 8 or 9, and it would continue growing. Well, > its not doing so. By the way, i set my nutch up for a whole-web crawling. > So > is there some sort of trick or plugin? > I've spent a good few months experimenting and trying different configs, > etc, but no luck. > I would really appreciate if someone could help me out. > Thank you in advance. > -- > View this message in context: > http://www.nabble.com/Nutch-and-its-Growing-Capabilities-tp19597372p19597372.html > Sent from the Nutch - User mailing list archive at Nabble.com. > >
