The web DB itself handle duplicate urls by ignoring the duplicates.
So incase you inject 100 times yahoo.in the webdb will only have one
entry.
Am 16.12.2005 um 09:04 schrieb Arun Kumar Sharma:
Hi
I have list of urls which may contain duplicate urls. I want
to check that there is no duplicate url insertion through
WebDBInjector. Is there any way to achieve this using nutch
functionality???
answer awaited anxiously...
Regards,
Arun Kumar Sharma (Tech Lead -Java/J2EE)
Mob: +91.981.529.5761
Send instant messages to your online friends http://
in.messenger.yahoo.com
-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
