The web DB itself handle duplicate urls by ignoring the duplicates.
So incase you inject 100 times yahoo.in the webdb will only have one
entry.
Am 16.12.2005 um 09:04 schrieb Arun Kumar Sharma:
Hi
I have list of urls which may contain duplicate urls. I want
to check that there is no duplicate url insertion through
WebDBInjector. Is there any way to achieve this using nutch
functionality???
answer awaited anxiously...
Regards,
Arun Kumar Sharma (Tech Lead -Java/J2EE)
Mob: +91.981.529.5761
Send instant messages to your online friends http://
in.messenger.yahoo.com