You should not use the dataimporter. It is deprecated and will be removed soon. Please use an external script that reads from the database and then pushes the data in batches to Solr via the Services Solr provided. Alternatively you can use Apache ManifoldCF, Logstash or any other open source / commercial solution.
You will find any error messages in the Solr log. > Am 06.03.2021 um 12:39 schrieb Anuj Bhargava <[email protected]>: > > I am having some problem importing data via dataimporter. I have a database > (data_archive) containing records for the last 9 years. I am unable to > import all the data via dataimporter. The solr stops. However, I can import > data for the last 12 months and it takes around 20 minutes. How can I add > all the data from the data_archive database and then just add new records > that get added everyday in the data_archive database. > > The script I am using is - > > <entity name="data_archive" dataSource="ds8" pk="posting_id" > query="SELECT * FROM data_archive WHERE doc_date BETWEEN (CURDATE() - > INTERVAL 12 MONTH) AND CURDATE()" > deltaImportQuery="SELECT * FROM data_archive > WHERE ID = '${dataimporter.delta.posting_id}' AND doc_date BETWEEN > (CURDATE() - INTERVAL 12 MONTH) AND CURDATE()" > deltaQuery="SELECT posting_id FROM data_archive > WHERE last_modified > '${dataimporter.last_index_time}' AND > doc_date BETWEEN (CURDATE() - INTERVAL 12 MONTH) AND CURDATE()"> > </entity> > > Can someone please modify the above script. > > Regards, > > Anuj
