There is no way that you can do that in solr. You'll have to write something at the app level, where you're crawling your docs or write a custom update handler that will preprocess the crawled docs and throw out the irrelevant ones.
One way you can do that is look at the doc title and the url for certain keywords that might tell you that the particular article belongs to the fashion domain etc. If the content is well structured then you might also have certain fields in the raw crawled doc that tell you the doc category. To look at the raw crawled doc you can use the DocumentAnalysisRequestHandler. On Mon, 4 Jan 2016, 18:07 <liviuchrist...@yahoo.com.invalid> wrote: > Hi everyone, I'm working on a search engine based on solr which indexes > documents from a large variety of websites. > The engine is focused on cook recipes. However, one problem is that these > websites provide not only content related to cooking recipes but also > content related to: fashion, travel, politics, liberty rights etc etc which > are not what the user expects to find on a cooking recipes dedicated search > engine. > Is there any way to filter out content which is not related to the core > business of the search engine? > Something like parental control software maybe? > Kind regards,Christian Christian Fotache Tel: 0728.297.207 Fax: > 0351.411.570 -- Regards, Binoy Dalal
