[ 
https://issues.apache.org/jira/browse/SOLR-13397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16816171#comment-16816171
 ] 

Anuj B commented on SOLR-13397:
-------------------------------

Tried but getting errors -

data-config.xml

{{<dataConfig> }}

{{<dataSource type="JdbcDataSource" driver="com.mysql.jdbc.Driver" 
batchSize="-1" autoReconnect="true" socketTimeout="0" connectTimeout="0" 
url="jdbc:mysql://xxxx/livenews?zeroDateTimeBehavior=convertToNull" 
user="admin" password="admin"/> }}

{{<document> <entity name="news" query="select * from news"> <field 
column="posting_id" name="posting_id"/> <field column="date" name="date"/> 
<field column="name" name="name"/> <field column="currency" name="currency"/> 
<field column="country" name="country"/> <field column="expiry" name="expiry"/> 
</entity> </document> </dataConfig> }}

 

While doing full import getting the following message -
Last Update: 11:31:09
Requests: 1 , Fetched: 951,104 , Skipped: 0 , Processed: 951,104 
Started: 4 minutes ago 



However the overview shows
Last Modified: 2 minutes ago 
Num Docs: 941601
Max Doc: 941601



Not all records are getting indexed. Logging shows the following message -

{{WARN false SimplePropertiesWriter Unable to read: dataimport.properties ERROR 
false EntityProcessorBase getNext() failed for query 'select * from 
news':org.apache.solr.handler.dataimport.DataImportHandlerException: 
java.sql.SQLException: Operation not allowed after ResultSet closed }}

{{ERROR false DocBuilder Exception while processing: news document : 
SolrInputDocument(fields: 
[]):org.apache.solr.handler.dataimport.DataImportHandlerException: 
java.sql.SQLException: Operation not allowed after ResultSet closed }}

{{ERROR false DataImporter Full Import failed:java.lang.RuntimeException: 
java.lang.RuntimeException: 
org.apache.solr.handler.dataimport.DataImportHandlerException: 
java.sql.SQLException: Operation not allowed after ResultSet closed }}

{{ERROR false CommitTracker auto commit 
error...:org.apache.solr.common.SolrException: Error opening new searcher}}

> Solr Syncing Script/Function
> ----------------------------
>
>                 Key: SOLR-13397
>                 URL: https://issues.apache.org/jira/browse/SOLR-13397
>             Project: Solr
>          Issue Type: Improvement
>      Security Level: Public(Default Security Level. Issues are Public) 
>            Reporter: Anuj B
>            Priority: Major
>
> A syncing script/function would be a nice addon feature. It should 
> automatically check the MySql database and index the contents according to 
> the changes/additions/deletions made in the main MySql database



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to