So, +^http://([a-z0-9]*\.)*ecasebriefs.com/blog/law/ +^http://([a-z0-9]*\.)*lawnix.com/cases/cases-index/
Will only crawl the urls from that particular domain and directory? Thank you. -----Original Message----- From: Edward Drapkin [mailto:[email protected]] Sent: Thursday, November 04, 2010 5:13 PM To: [email protected] Subject: Re: Forcing to crawl just FQDN On 11/4/2010 7:10 PM, Eric Martin wrote: > Hello, > > > > Thanks for all the help so far. Between google here and Solr mailing, I have > learned a tremendous amount. > > > > I was wondering how I can just search fqdn in the seed list? So, if I was > crawling xyz.com it would only crawl the urls's with xyz.com and skip those > urls leading off site. If I knew how to better phrase ti I am sure I could > find more info on google. > > > > Eric > > Use the urlfilter files in the configuration directory. Thanks, Eddie
