Unfortunately, no. I will only crawl that downloads.html page. 
 
-----Original message-----
> From:anish_88 <[email protected]>
> Sent: Friday 13th December 2013 13:23
> To: [email protected]
> Subject: RE: Crawl and Index specific links on specific page
> 
> ok Let me put it this way
> 
> I have a urls folder in which their is a nutch.txt file having url 
> http://nutch.apache.org/
> 
> Now in regex-urfilter I have this entry  
> +^http://([a-z0-9]*\.)*nutch.apache.org/downloads.html
> 
> Desn't crawler go to   nutch.apache.org/downloads.html and crawl all the
> link  underlying this page if I invoke the command
> 
> ./nutch crawl url -dir newcrawler depth 3
> 
> 
> 
> 
> --
> View this message in context: 
> http://lucene.472066.n3.nabble.com/Crawl-and-Index-specific-links-on-specific-page-tp4106524p4106584.html
> Sent from the Nutch - User mailing list archive at Nabble.com.
> 

Reply via email to