Insurance Squared Inc. wrote:
I'm trying to determine if there's a better way to whitelist a large number of domains than just adding them as a regular expression in the filter.
Have a look at the urlfilter-prefix plugin. This is more efficient for filtering urls by a large list of domains.
Doug ------------------------------------------------------- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://ads.osdn.com/?ad_id=7637&alloc_id=16865&op=click _______________________________________________ Nutch-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/nutch-general
