Re: advice on creating a solr index when data source is from many unrelated db tables

2010-08-01 Thread Erick Erickson
Yes, there might be 50 fields. This is not a problem for SOLR/Lucene. HOWEVER: SOLR is NOT a database and shouldn't be used like one. Your emails hint that you're thinking like a DB person, not a search person. I guarantee that if you just index the database information into 9 different document t

Re: advice on creating a solr index when data source is from many unrelated db tables

2010-08-01 Thread Kerwin
Hi, This is something that I am working on too.I have been trying to combine results from 3 different tables and trying to avoid the usual SQL union clauses. One thing I have tried to do is watch out for common fields like, for example, first name and last name that could be present in all tables

Re: advice on creating a solr index when data source is from many unrelated db tables

2010-07-30 Thread S Ahmed
So I have tables like this: Users UserSales UserHistory UserAddresses UserNotes ClientAddress CalenderEvent Articles Blogs Just seems odd to me, jamming on these tables into a single index. But I guess the idea of using a 'type' field to quality exactly what I am searching is a good idea, in cas

Re: advice on creating a solr index when data source is from many unrelated db tables

2010-07-30 Thread Gora Mohanty
On Thu, 29 Jul 2010 15:33:42 -0400 S Ahmed wrote: > I understand (and its straightforward) when you want to create a > index for something simple like Products. > > But how do you go about creating a Solr index when you have data > coming from 10-15 database tables, and the tables have unrelated

Re: advice on creating a solr index when data source is from many unrelated db tables

2010-07-30 Thread Chantal Ackermann
Hi Ahmed, fields that are empty do not impact the index. It's different from a database. I have text fields for different languages and per document there is always only one of the languages set (the text fields for the other languages are empty/not set). It works all very well and fast. I wonder

Re: advice on creating a solr index when data source is from many unrelated db tables

2010-07-29 Thread Geert-Jan Brits
I can interprete your question in 2 different ways: 1. Do you want to index several heterogenous documents all coming from different tables? So documents of type "tableA" are created and indexed alongside documents of type "tableB", "tableC", etc. 2. Do you want to combine unrelated data from 15 ta

advice on creating a solr index when data source is from many unrelated db tables

2010-07-29 Thread S Ahmed
I understand (and its straightforward) when you want to create a index for something simple like Products. But how do you go about creating a Solr index when you have data coming from 10-15 database tables, and the tables have unrelated data? The issue is then you would have many 'columns' in you