Sounds like SOLR-303 is a must for you. Have you looked at Nutch? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
----- Original Message ---- From: Dietrich <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Tuesday, March 25, 2008 4:15:23 PM Subject: How to index multiple sites with option of combining results in search I am planning to index 275+ different sites with Solr, each of which might have anywhere up to 200 000 documents. When performing searches, I need to be able to search against any combination of sites. Does anybody have suggestions what the best practice for a scenario like that would be, considering both indexing and querying performance? Put everything into one index and filter when performing the queries, or creating a separate index for each one and combining results when performing the query?