The web DB itself handle duplicate urls by ignoring the duplicates. So incase you inject 100 times yahoo.in the webdb will only have one entry.

Am 16.12.2005 um 09:04 schrieb Arun Kumar Sharma:

Hi
I have list of urls which may contain duplicate urls. I want to check that there is no duplicate url insertion through WebDBInjector. Is there any way to achieve this using nutch functionality???
     answer awaited anxiously...


Regards,

Arun Kumar Sharma (Tech Lead -Java/J2EE)
Mob: +91.981.529.5761




Send instant messages to your online friends http:// in.messenger.yahoo.com

Reply via email to