Re: Entity with multiple datasources

2012-02-16 Thread Dmitry Kan
no problem, hope it helps, you're welcome. On Thu, Feb 16, 2012 at 5:03 PM, Radu Toev wrote: > Really good point on the ids, I completely overlooked that matter. > I will give it a try. > Thanks again. > > On Thu, Feb 16, 2012 at 5:00 PM, Dmitry Kan wrote: > > > Each document in SOLR will corre

Re: Entity with multiple datasources

2012-02-16 Thread Radu Toev
Really good point on the ids, I completely overlooked that matter. I will give it a try. Thanks again. On Thu, Feb 16, 2012 at 5:00 PM, Dmitry Kan wrote: > Each document in SOLR will correspond to one db record and since both > databases have the same schema, you can't index two records from two

Re: Entity with multiple datasources

2012-02-16 Thread Dmitry Kan
Each document in SOLR will correspond to one db record and since both databases have the same schema, you can't index two records from two databases into the same SOLR document. So after indexing, you should have 7k different documents, each of which holds data from a db record. Also one problem

Re: Entity with multiple datasources

2012-02-16 Thread Radu Toev
I'm not sure I follow. The idea is to have only one document. Do the multiple documents have the same structure then(different datasources), and if so how are they actually indexed? Thanks. On Thu, Feb 16, 2012 at 4:40 PM, Dmitry Kan wrote: > I think the problem here is that initially you tryin

Re: Entity with multiple datasources

2012-02-16 Thread Dmitry Kan
I think the problem here is that initially you trying to create separate documents for two different tables, while your config is aiming to create only one document. Here there is one solution (not tried by me): -- You can have multiple documents generated by the same data-config:

Re: Entity with multiple datasources

2012-02-16 Thread Radu Toev
I've removed the connection params The unique key is id. On Thu, Feb 16, 2012 at 2:27 PM, Dmitry Kan wrote: > OK, maybe you can show the db-data-config.xml just in case? > Also in schema.xml, does you correspond to the unique fi

Re: Entity with multiple datasources

2012-02-16 Thread Dmitry Kan
OK, maybe you can show the db-data-config.xml just in case? Also in schema.xml, does you correspond to the unique field in the db? On Thu, Feb 16, 2012 at 2:13 PM, Radu Toev wrote: > I tried running with just one datasource(the one that has 6k entries) and > it indexes them ok. > The same, if I

Re: Entity with multiple datasources

2012-02-16 Thread Radu Toev
I tried running with just one datasource(the one that has 6k entries) and it indexes them ok. The same, if I do sepparately the 1k database. It indexes ok. On Thu, Feb 16, 2012 at 2:11 PM, Dmitry Kan wrote: > It sounds a bit, as if SOLR stopped processing data once it queried all > from the smal

Re: Entity with multiple datasources

2012-02-16 Thread Dmitry Kan
It sounds a bit, as if SOLR stopped processing data once it queried all from the smaller dataset. That's why you have 2000. If you just have a handler pointed to the bigger data set (6k), do you manage to get all 6k db entries into solr? On Thu, Feb 16, 2012 at 1:46 PM, Radu Toev wrote: > 1. Not

Re: Entity with multiple datasources

2012-02-16 Thread Radu Toev
1. Nothing in the logs 2. No. On Thu, Feb 16, 2012 at 12:44 PM, Dmitry Kan wrote: > 1. Do you see any errors / exceptions in the logs? > 2. Could you have duplicates? > > On Thu, Feb 16, 2012 at 10:15 AM, Radu Toev wrote: > > > Hello, > > > > I created a data-config.xml file where I define a da

Re: Entity with multiple datasources

2012-02-16 Thread Dmitry Kan
1. Do you see any errors / exceptions in the logs? 2. Could you have duplicates? On Thu, Feb 16, 2012 at 10:15 AM, Radu Toev wrote: > Hello, > > I created a data-config.xml file where I define a datasource and an entity > with 12 fields. > In my use case I have 2 databases with the same schema,

Entity with multiple datasources

2012-02-16 Thread Radu Toev
Hello, I created a data-config.xml file where I define a datasource and an entity with 12 fields. In my use case I have 2 databases with the same schema, so I want to combine in one index the 2 databases. I defined a second dataSource tag and duplicateed the entity with its field(changed the name