brainstorm
Sun, 29 Jun 2008 08:57:25 -0700
Hi! I guess it is implemented, but cannot find it by myself on nutch API docs nor wiki :-/ ... Is there any mechanism implemented in nutch to detect spider traps[1] ? Thanks, Roman [1] http://en.wikipedia.org/wiki/Spider_trap