On 12/1/2017 11:51 AM, @Nandan@ wrote: > I am working on an Ecommerce database . I have more then 40 tables and > around 20GB of data. > I want to index data with solr for more effective search feature. > Please tell me how to index MySQL data with Apache solr.
There are multiple possible ways to do this. One of the most straightforward is to use the dataimport handler. DIH is reasonably efficient, although the one major limitation it has is that it's single threaded. Depending on how your multiple tables relate to each other, it may be a little bit challenging to configure properly. The best results with DIH are obtained when you can write a single SQL query (possibly using the view feature in MySQL) that can retrieve every bit of data you want to index. For best performance, you would want to write a custom program that can retrieve the data from your database and then start multiple threads or multiple processes to do indexing in parallel. You may even want to use multiple threads for the retrieval process, depending on how fast a single request against the database can return data. Thanks, Shawn
