Hi! I guess it is implemented, but cannot find it by myself on nutch API docs nor wiki :-/ ... Is there any mechanism implemented in nutch to detect spider traps[1] ?
Thanks, Roman [1] http://en.wikipedia.org/wiki/Spider_trap
Hi! I guess it is implemented, but cannot find it by myself on nutch API docs nor wiki :-/ ... Is there any mechanism implemented in nutch to detect spider traps[1] ?
Thanks, Roman [1] http://en.wikipedia.org/wiki/Spider_trap