Often, the easiest solution when DIH gets really complex is to do one of
two things:
1> Use SolrJ instead. You can do complex things more easily much of
the time with DIH.
2> You could consider using a custom Transformer in conjunction with your
primary delta query to access the second table, see:
http://wiki.apache.org/solr/DIHCustomTransformer
Best
Erick
On Tue, Jul 26, 2011 at 7:27 PM, spravin <spravin.li...@gmail.com> wrote:
> Hi All
>
> I am stuck with an issue with delta-import while configuring solr in an
> environment where multiple databases exist.
>
> My schema looks like this:
> <id, name, keyword>
> names exist in one DB and keywords in a table in the other DB (with id as
> foreign key).
>
> For delta import, I would need to check against the updated column in both
> the tables. But they are in two different databases, so I can't do this in a
> single deltaquery.
> So I'm not able to detect if the field in the second database has changed.
>
> The relevant part of my dataconfig xml looks like this:
>
> <dataConfig>
> <dataSource ds1... />
> <dataSource ds2... />
> <document>
> <entity name="name" dataSource="ds1"
> query="SELECT ID, Name, Updated FROM records"
> deltaImportQuery="SELECT ID, Name, Updated FROM records WHERE ID
> = '${dataimporter.delta.ID <http://dataimporter.delta.id/>}'"
> deltaQuery="SELECT ID FROM records WHERE Updated >
> '${dataimporter.last_index_time}'">
>
> <entity name="keywords" dataSource="ds2"
> query="SELECT Keyword,Updated AS KeywordUpdated FROM
> keywords WHERE ID = '${name.ID}'">
> </entity>
>
> </entity>
> </document>
> </dataConfig>
>
> I'm hoping someone in this list could point me to a solution: a way to
> specify deltaQuery across multiple databases.
>
> (In the above example, I would like to add "OR ID IN (SELECT ID FROM
> keywords WHERE Updated > '${dataimporter.last_index_time}')" to the
> deltaQuery, but this table can be accessed only from a different dataSource.
>
> Thanks
> - PS
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Solr-DataImport-with-multiple-DBs-tp3201843p3201843.html
> Sent from the Solr - User mailing list archive at Nabble.com.
