gets time out error in full import with data import hadler
Hello all, i am using data import hadler, jdbc to get data from db for indexing. i have one query which takes more time to get data, when i do full import, it gives me timeout error. please help me to solve this problem, if i can set timeout anywhere or any other way. Thanks, Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/gets-time-out-error-in-full-import-with-data-import-hadler-tp3451345p3451345.html Sent from the Solr - User mailing list archive at Nabble.com.
how to update specific document (record) of solr
hello all, i want to update specific fields of particular document (having uniquekey). how to do it? e.g. suppose one document with following fields, ID--- unique key in solr Name Address Mobile Email i want to update only email field of document which has ID=5 Thanks, Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-update-specific-document-record-of-solr-tp3467929p3467929.html Sent from the Solr - User mailing list archive at Nabble.com.
how to apply sort and search both on multivalued field in solr
Hello all, i did googling and also as per wiki, we can not apply sorting on multivalued field. workaround for that is we need to add two more fields for particular multivalued field, min and max. e.g. multivalued field have 4 values "abc", "cde", "efg", "pqr" than min="abc" and max="pqr"and we can make sort on it. this is fine if there is only required to sort on multivalued field. but i want to do searching and sorting on same multivalued field, then result would not fine. how to solve this problem ? Thanks vishal parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-apply-sort-and-search-both-on-multivalued-field-in-solr-tp3473652p3473652.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: how to apply sort and search both on multivalued field in solr
Thanks Erick, what i given 'abc',...etc... its values of one multivalued field in one document, but might be its confusing. lets say, i have one field named Array1 has multivalued=true now i want to Search on Array1 , but i want only affected values (which i can get in "highlighting"), now i also want to sort on filed Array1, now whatever be the response should be sorted on only affected values (which contains search term). also without search sorting on Array1 sometimes works fine, sometimes not. Thanks Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-apply-sort-and-search-both-on-multivalued-field-in-solr-tp3473652p3477747.html Sent from the Solr - User mailing list archive at Nabble.com.
XSLT caching mechanism
Hello All, i am using xslt to transform solr xml response, when made search;getting below warning WARNING [org.apache.solr.util.xslt.TransformerProvider] The TransformerProvider's simplistic XSLT caching mechanism is not appropriate for high load scenarios, unless a single XSLT transform is used and xsltCacheLifetimeSeconds is set to a sufficiently high value. how can i apply effective xslt caching for solr ? Thanks, Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/XSLT-caching-mechanism-tp3506979p3506979.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: how to apply fuzzy search with slop
Thanks Erick, i have download ComplexPhraseQueryParser from your give link, apply maven package to create jar file and add it to WEB-INF/lib folder and generate war file and deploy to jboss server also i added QueryParser into solrconfig.xml file, now when i do normal search, it works fine but when i add defType=ComplexPhrase, it gives me error nosuchfielderror: luceneMatchVersion i am using solr 1.4 how to solve above error? Thanks, Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-apply-fuzzy-search-with-slop-tp3542286p3548074.html Sent from the Solr - User mailing list archive at Nabble.com.
how to configure saxon xslt processor for solr
Hello all, i want to configure saxon xslt processor for solr; how to do that? its taking xalan as default processor. also if its needed to set classpath, please provide me path where can i set classpath? and also how can we check that which xslt processor default use. i am using solr 1.4 and jboss 6. Thanks & Regards, Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-configure-saxon-xslt-processor-for-solr-tp3619117p3619117.html Sent from the Solr - User mailing list archive at Nabble.com.
xpathentityprocessor with flattern true
Hello all, i want to get whole xmldata into one field, for that i am using xpathentityprocessor with flattern=true but still it doesn't work as expected. e.g. sample xml isabcabc bcd def main part i want is i want all "id" nodes into single field CommonIDs is single valued field, should contain "abc bcd def" if it takes root node also it will also fine for me. please help me to solve this problem, Thanks Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/xpathentityprocessor-with-flattern-true-tp3637928p3637928.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: xpathentityprocessor with flattern true
am i making any mistake with xpathentityprocessor? i am using solr 1.4 please help me to solve this problem? Thanks & Regards, Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/xpathentityprocessor-with-flattern-true-tp3637928p3645013.html Sent from the Solr - User mailing list archive at Nabble.com.
how to use RemoveDuplicatesTokenFilterFactory?
I want to avoid duplicate values in one multivalued field. i am using dataimport handler to import data, the particular multivalued field are being filled from xml source. now that xml has duplicate values, but i want to have unique valued in this multivalued field. e.g. xml a1 b1 a1 a1 i have added RemoveDuplicatesTokenFilterFactory in data type of the field, in index analyzer. still it gives below o/p. a1 b1 a1 a1 i am using solr 3.5. how can i avoid importing duplicate values in the field? -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-use-RemoveDuplicatesTokenFilterFactory-tp4029004.html Sent from the Solr - User mailing list archive at Nabble.com.
how to import data from database combine with file content in solr
Hello, I am new to solr, my requirements are, 1. at regular interval need solr to fetch data from sql server database and do indexing on it. 2. fetch only those records which is not yet indexed 3. for each record there is one file associated, so with database table fields also want to index content of that particular file e.g. there is one table "Customer" in database and customerid is primary key for each customerid there is associated file of that customerprofile named with customerid, 4. as i metioned above that when solr fetch data from sql server database table , should fetch only data which is not yet indexed, (we have one older lucene code, in which there is one field in table that isindexed so when fetching data in select clause there is one condition that isindexed=false, and when indexing is done update particular record of database with isindexed=true) is there any mechanism in solr for that? how to achieve same ? do i need to write custom code for that or it can be done with configuration provided by solr? Thanks, Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-import-data-from-database-combine-with-file-content-in-solr-tp2824749p2824749.html Sent from the Solr - User mailing list archive at Nabble.com.
Unable to load EntityProcessor implementation for entity:16865747177753
hello i have one datasource - is sql server db and second datasource - is file but dynamic means based on first datasource db record i want to fetch one file that's why i try to use tikaentityprocessor but got following error org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to load EntityProcessor implementation for entity:16865747177753 Processing Document # 1 at org.apache.solr.handler.dataimport.DocBuilder.getEntityProcessor(DocBuilder.java:576) at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:314) at org.apache.solr.handler.dataimport.DocBuilder.buildDocument(DocBuilder.java:383) at org.apache.solr.handler.dataimport.DocBuilder.doFullDump(DocBuilder.java:242) at org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:180) at org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:331) at org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:389) at org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:370) Caused by: java.lang.ClassNotFoundException: Unable to load TikaEntityProcessor or org.apache.solr.handler.dataimport.TikaEntityProcessor at org.apache.solr.handler.dataimport.DocBuilder.loadClass(DocBuilder.java:738) at org.apache.solr.handler.dataimport.DocBuilder.getEntityProcessor(DocBuilder.java:573) ... 7 more Caused by: org.apache.solr.common.SolrException: Error loading class 'TikaEntityProcessor' at org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:375) at org.apache.solr.handler.dataimport.DocBuilder.loadClass(DocBuilder.java:728) ... 8 more Caused by: java.lang.ClassNotFoundException: TikaEntityProcessor at java.net.URLClassLoader$1.run(URLClassLoader.java:202) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:190) at java.lang.ClassLoader.loadClass(ClassLoader.java:307)... data config file please help me to solve this problem Thanks Vishal -- View this message in context: http://lucene.472066.n3.nabble.com/Unable-to-load-EntityProcessor-implementation-for-entity-16865747177753-tp2846513p2846513.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Unable to load EntityProcessor implementation for entity:16865747177753
Thanks firdous_kind86 i replace tikaentityprocessor with xpathentityprocessor and works fine -- View this message in context: http://lucene.472066.n3.nabble.com/Unable-to-load-EntityProcessor-implementation-for-entity-16865747177753-tp2846513p2861229.html Sent from the Solr - User mailing list archive at Nabble.com.
how to concatenate two nodes of xml with xpathentityprocessor
hello , i am using Xpathentityprocessor to do index xml files below is my xml file CustomerA ThisB AnyC now i want to concatenate in index so that when i search it gives below result CData with id attribute--- like CustomerAThisB or something like that is it possible by RegexTransformer or templatetransformer? i did googling little for both but could not get excat/useful solution Thanks Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-concatenate-two-nodes-of-xml-with-xpathentityprocessor-tp2861260p2861260.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: how to concatenate two nodes of xml with xpathentityprocessor
Thanks Stefan currently in dataconfig file part of xPathEntityProcessor and when i do make search i get following search result CustomerA AnyC 1 3 but i want following result 1,CustomerA 3,AnyC OR CustomerA AnyC or any other format but i want both combine, Thanks Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-concatenate-two-nodes-of-xml-with-xpathentityprocessor-tp2861260p2865508.html Sent from the Solr - User mailing list archive at Nabble.com.
org.apache.solr.common.SolrException: Error loading class 'org.apache.solr.handler.dataimport.DataImportHandler'
Hello, i got following source org.apache.solr.common.SolrException: Error loading class 'org.apache.solr.handler.dataimport.DataImportHandler' at org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:389) at org.apache.solr.core.SolrCore.createInstance(SolrCore.java:423) at org.apache.solr.core.SolrCore.createRequestHandler(SolrCore.java:459) . actually this error comes in solr 3.1 only in solr 1.4.1 it works fine how to solve this problem? Thanks Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/org-apache-solr-common-SolrException-Error-loading-class-org-apache-solr-handler-dataimport-DataImpo-tp2865625p2865625.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: org.apache.solr.common.SolrException: Error loading class 'org.apache.solr.handler.dataimport.DataImportHandler'
thanks stefan i done same and dataimporthandler error gone ,then i got slf4j error and done same and error gone i got requesthandler error, but now i have some configuration problem,i try to fix it out -- View this message in context: http://lucene.472066.n3.nabble.com/org-apache-solr-common-SolrException-Error-loading-class-org-apache-solr-handler-dataimport-DataImpo-tp2865625p2870280.html Sent from the Solr - User mailing list archive at Nabble.com.
how to update database record after indexing
Hello, i am using dataimporthandler to import data from sql server database. my requirement is when solr completed indexing on particular database record i want to update that record in database or after indexing all records if i can get all ids and update all records how to achieve same ? Thanks Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-update-database-record-after-indexing-tp2874171p2874171.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: org.apache.solr.common.SolrException: Error loading class 'org.apache.solr.handler.dataimport.DataImportHandler'
now its working gr8, thanks stefan,scott -- View this message in context: http://lucene.472066.n3.nabble.com/org-apache-solr-common-SolrException-Error-loading-class-org-apache-solr-handler-dataimport-DataImpo-tp2865625p2922985.html Sent from the Solr - User mailing list archive at Nabble.com.
how to do offline adding/updating index
Hello all, indexing with dataimporthandler runs every hour (new records will be added, some records will be updated) note :large data requirement is when indexing is in progress, searching (on already indexed data) should not affect so should i use multicore-with merge and swap or delta query or any other way? Thanks -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-do-offline-adding-updating-index-tp2923035p2923035.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: how to update database record after indexing
actually every hour some records are inserted into database, so every hour solr indexing will be called with delta import, notes: records and data are very large (in GBs) so each time to find all solr index and update database records process will be slow. is there any eventlistners or snapshooter can help me to solve this problem ? Thanks, Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-update-database-record-after-indexing-tp2874171p2931537.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: how to update database record after indexing
Hey Erick, i written separate process as you suggested, and achieved task. Thanks a lot Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-update-database-record-after-indexing-tp2874171p3019217.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: how to do offline adding/updating index
Thanks to all, i done by using multicore, vishal parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-do-offline-adding-updating-index-tp2923035p3019219.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: how to concatenate two nodes of xml with xpathentityprocessor
Thanks kbootz your suggestion works fine, vishal parekh -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-concatenate-two-nodes-of-xml-with-xpathentityprocessor-tp2861260p3019223.html Sent from the Solr - User mailing list archive at Nabble.com.
Highlighting is case sensitive when search with double quote
when i search with "abc cde", solr will return result but highlighting portion is as per below, and when i search with "ABC cde" it will have below response ... ... ABC cde . seems highlighting returns response is case sensitive. in above both case other query parameters are same. how can i get case insensitive response. Thanks, Vishal Parekh -- View this message in context: http://lucene.472066.n3.nabble.com/Highlighting-is-case-sensitive-when-search-with-double-quote-tp4002576.html Sent from the Solr - User mailing list archive at Nabble.com.
