There is no web crawler built into Solr. You can look at Apache Nutch
(originally created by Doug Cutting who also created Lucene, and I
believe relatively simple to integrate with Solr), or Heritrix, or
Scrapy, or something else - there are many crawlers out there.
Cheers
Charlie
On 26/05/2021 07:18, heena wrote:
Is there any update on this?
--
Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html
--
Charlie Hull - Managing Consultant at OpenSource Connections Limited
<www.o19s.com>
Founding member of The Search Network <https://thesearchnetwork.com/>
and co-author of Searching the Enterprise
<https://opensourceconnections.com/about-us/books-resources/>
tel/fax: +44 (0)8700 118334
mobile: +44 (0)7767 825828
