Embedded Vs External Solr Server
Hello, I am planning to use Solr for an application that would be indexing a lot of documents. I am trying to understand the advantage/disadvantage of embedding the Solr Server into my application. When does one use one over the other? Speed of Search and Result Retrieval is of course of paramount importance. Thanks Vijay
Re: Search both diacritics and non-diacritics
I tried but it still not correct :( hossman wrote: : I am developing a seach engine with Solr, and now I want to search both with : and without diacritics, for example: if I query kho, it will response kho, : khó, khò,... But if I query khó, it will response only khó. : : Who anyone have solution? I have used filter : class=solr.ISOLatin1AccentFilterFactory/ but it is not correct :( try ASCIIFoldingFilterFactory instead. -Hoss -- View this message in context: http://old.nabble.com/Search-both-diacritics-and-non-diacritics-tp26897627p26941627.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Embedded Vs External Solr Server
result retrieval - same speed of search - embeeded maintenance cost and flexibility - http []s, Lucas Frare Teixeira .·. - lucas...@gmail.com - lucastex.com.br - blog.lucastex.com - twitter.com/lucastex On Mon, Dec 28, 2009 at 6:07 AM, Vijay Rao raovi...@gmail.com wrote: Hello, I am planning to use Solr for an application that would be indexing a lot of documents. I am trying to understand the advantage/disadvantage of embedding the Solr Server into my application. When does one use one over the other? Speed of Search and Result Retrieval is of course of paramount importance. Thanks Vijay
Re: Spatial Solr (JTeam)
Seems to work for me... (I mean, I don't get a NoClassDefFoundError but I have other issues). I just put spatial-solr-1.0-RC3.jar in the core's lib directory and it worked. On Wed, Dec 23, 2009 at 8:25 PM, Thomas Rabaix thomas.rab...@gmail.comwrote: Hello, I would like to set up the spatial solr plugin from http://www.jteam.nl/news/spatialsolr on solr 1.4. However I am getting a error message when solr start. SEVERE: java.lang.NoClassDefFoundError: org/apache/solr/search/QParserPlugin I guess nl.jteam.search.solrext.spatial.SpatialTierQueryParserPlugin extends QParserPlugin. I have checked into the solr.war file (the one provided by solr download webpage) and the class is present. Do you know if the current version SSP version 1.0-RC3 is compatible with solr 1.4 ? Thanks -- Thomas Rabaix
field based boosting
Hello All, I am having a trouble in following an approach for field boosting. I have possibility of two cases in searching. One is similar to DisMax, which uses field boosting, and the second one is normal. To go for which of them is based on user query ( probably inside query parser). So I can not use DisMax as default, but I need to provide field based boosting. To be brief, looking at query string, 1) if there are no fields supplied as part of the query, I need to search for the input-query terms in a set of default field list including support for field boosting. 2) If the user has supplied some field name as part of the query then I do some other modifications to the query like query expansion, etc. As , whether the field name is provided are not is to be judged in query parser ( as far as I know ), which might be the right way of providing both of above features. Thanks.
Dynamic facets?
Hi, I was wondering if there is a way to retrieve the facets from a query based on their mincount without specifying facet.field? I submit a query and want to retrieve all the faceted fields with mincounts 2, but don't know what they might be since I also use dynamic fields. Is this possible? thanks, Darren
Spatial / Local Solr radius
Hi everyone, I'm getting inconsistent behavior from Spatial Solr when searching with different radii. For the same lat/long I get: radius=1 - 1 result radius=10 - 0 result radius=25 - 2 results radius=100 - 2 results radius=250 - 0 results I don't understand why radius=10 and 250 return no results. Is this a known bug? I'm using the default configuration as specified in the PDF. BTW I also tried LocalSolr with the same results. Thanks Mauricio
RE: Search both diacritics and non-diacritics
Hi Olala, You can get something similar to what you want by copying the original field to another one where, as Hoss suggests, you apply ASCIIFoldingFilterFactory, and the rewrite queries to match against both fields, with higher boost given to the original field. @Hoss: Olala would benefit from a feature that AFAICT Solr doesn't currently have: the ability to add synonyms based on arbritrary transforms. Steve On 12/28/2009 at 5:33 AM, Olala wrote: I tried but it still not correct :( hossman wrote: I am developing a seach engine with Solr, and now I want to search both with and without diacritics, for example: if I query kho, it will response kho, khó, khò,... But if I query khó, it will response only khó. Who anyone have solution? I have used filter class=solr.ISOLatin1AccentFilterFactory/ but it is not correct ( try ASCIIFoldingFilterFactory instead. -Hoss
RE: Reverse sort facet query [SOLR-1672]
in Solr 1.4 the boolean syntax was deprecated in place of keywords that are more meaninful... http://wiki.apache.org/solr/SimpleFacetParameters#facet.sort ... count and index replaced true and false Yes, I thought about adding some 'new syntax', but I opted for a separate 'facet.sortorder' parameter, mainly because I'm not familiar enough with the codebase to know what effect this might have on backward compatibility. It would be easy enough to modify the patch I created to do it this way. [see SOLR-1672] Thanks, Peter Date: Thu, 24 Dec 2009 22:24:25 -0800 From: hossman_luc...@fucit.org To: solr-user@lucene.apache.org Subject: RE: Reverse sort facet query : I'll have a look at SimpleFacets.java to look at patching it. I should : think the sorting bit will be relatively straightforward. The tricky bit : is how to submit the request via the query interface - there's only a : boolean in Solr 1.4 the boolean syntax was deprecated in place of keywords that are more meaninful... http://wiki.apache.org/solr/SimpleFacetParameters#facet.sort ... count and index replaced true and false we could always start supporting count desc and count asc (with count as an alias for count desct : The reverse facet query is for when you want to know which event (or : group of event types) has happened the least got it, thanks. -Hoss _ Add your Gmail and Yahoo! Mail email accounts into Hotmail - it's easy http://clk.atdmt.com/UKM/go/186394592/direct/01/
Solr an Greek Chars
Hi there I’m using solr 1.4 under tomcat server in windows server 2008 and I want to index some data that contain Greek chars When I try to index my data and query all of them with *:* all the greek chars returned like hieroglyphics can anybody help ??? thanks in advance - Γεώργιος Ζαρογκίκας Τμήμα Μηχανογράφησης 6936801497 g.zarogki...@multirama.gr 23o Xλμ Εθ. Οδού Αθήνων Λαμίας ΤΚ. 14564Driveme http://www.forthnet.gr/templates/driveme.aspx?c=10008226initialCenterX=486756.445initialCenterY=4221978.13initialZoomLevel=2 P Please consider the environment before printing this e-mail
Re: Spatial / Local Solr radius
What do your queries look like? On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote: Hi everyone, I'm getting inconsistent behavior from Spatial Solr when searching with different radii. For the same lat/long I get: radius=1 - 1 result radius=10 - 0 result radius=25 - 2 results radius=100 - 2 results radius=250 - 0 results I don't understand why radius=10 and 250 return no results. Is this a known bug? I'm using the default configuration as specified in the PDF. BTW I also tried LocalSolr with the same results. Thanks Mauricio
Re: Solr an Greek Chars
Hi, Did you post your documents in UTF-8? Also, for querying through GET using non-ascii you must reconfigure Tomcat6 as per the manual [1]. Cheers, [1] http://wiki.apache.org/solr/SolrTomcat#URI_Charset_Config ZAROGKIKAS,GIORGOS zei: Hi there Iâm using solr 1.4 under tomcat server in windows server 2008 and I want to index some data that contain Greek chars When I try to index my data and query all of them with *:* all the greek chars returned like hieroglyphics can anybody help ??? thanks in advance - ÎεÏÏÎ³Î¹Î¿Ï ÎαÏÎ¿Î³ÎºÎ¯ÎºÎ±Ï Î¤Î¼Î®Î¼Î± ÎηÏανογÏάÏηÏÎ·Ï 6936801497 g.zarogki...@multirama.gr 23o Xλμ Îθ. ÎÎ´Î¿Ï ÎθήνÏν ÎÎ±Î¼Î¯Î±Ï Î¤Î. 14564Driveme http://www.forthnet.gr/templates/driveme.aspx?c=10008226initialCenterX=486756.445initialCenterY=4221978.13initialZoomLevel=2 P Please consider the environment before printing this e-mail
Re: Spatial / Local Solr radius
q={!spatial lat=43.705 long=116.3635 radius=100}*:* with no other parameters. When changing the radius to 250 I get no results. In my config I have startTier = 9 and endTier = 17 (default values) On Mon, Dec 28, 2009 at 1:24 PM, Grant Ingersoll gsi...@gmail.com wrote: What do your queries look like? On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote: Hi everyone, I'm getting inconsistent behavior from Spatial Solr when searching with different radii. For the same lat/long I get: radius=1 - 1 result radius=10 - 0 result radius=25 - 2 results radius=100 - 2 results radius=250 - 0 results I don't understand why radius=10 and 250 return no results. Is this a known bug? I'm using the default configuration as specified in the PDF. BTW I also tried LocalSolr with the same results. Thanks Mauricio
Re: NOT highlighting synonym
Thanks Unfortunately thats not the case. We are using the same field to do search on and display that text. So looks like in this case this is not possible Am i correct We have a custom field type with synonyms defined at query time. Erik Hatcher-4 wrote: On Dec 23, 2009, at 2:26 PM, darniz wrote: i have a requirement where we dont want to hightlight synonym matches. for example i search for caddy and i dont want to highlight matched synonym like cadillac. Looking at highlighting parameters i didn't find any support for this. anyone can offer any advice. You can control what gets highlighted by which analyzer is used. You may need a different field for highlighting than you use for searching in this case - but you can just create another field type without the synonym filter in it and use that for highlighting. Erik -- View this message in context: http://old.nabble.com/NOT-highlighting-synonym-tp26906321p26945921.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Implementing Autocomplete/Query Suggest using Solr
On Wed, Dec 23, 2009 at 10:52 PM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: On Thu, Dec 24, 2009 at 2:39 AM, Prasanna R plistma...@gmail.com wrote: On Tue, Dec 22, 2009 at 11:49 PM, Shalin Shekhar Mangar shalinman...@gmail.com wrote: I am curious how an approach that simply uses the wildcard query functionality on an indexed field would work. It works fine as long as the terms are not repeated across documents. I do not follow why terms repeating across documents would be an issue. As long as you can differentiate between multiple matches and rank them properly it should work right? A prefix search would return documents. If a field X being used for auto-complete has the same value in two documents then the user will see the same value being suggested twice. That is right. I will have to handle removing duplicate values from the results returned by the result handler. We do auto-complete through prefix searches on shingles. Just to confirm, do you mean using EdgeNgram filter to produce letter ngrams of the tokens in the chosen field? No, I'm talking about prefix search on tokens produced by a ShingleFilter. I did not know about the Prefix query parser in Solr. Thanks a lot for pointing out the same. I find relatively little online material about the Solr/Lucene prefix query parser. Kindly point me to any useful resource that I might be missing. Thanks again for all your help. Regards, Prasanna.
Remove the deleted docs from the Solr Index
I am using Solr 1.4 and DIH to build the index from a table. I use full import once to create the index and then i keep using delta import to update the index. All woks fine as long a the table gets added with only new rows. if there are some rows in the table that get deleted then the index does not get updated and has stale data. I have looked into the below options: 1] deletedPkQuery and deltaImportQuery :- Both are of no use, as there is no way any DB SQL query can return the row from the table, if the row is already deleted from the table. 2] preImportDeleteQuery and postImportDeleteQuery :- Both are of no use, as they work only with full import. ( Also there is no way any DB SQL query can return the row from the table, if the row is already deleted from the table) 3] Creating a new field in the table, named delete, and setting it as true and instead of actually deleting the row from the table:- This is not possible as that table is a sort of getting updated from external content management system, with news updates and has 1000 of new rows added and 1000 deleted every hour. Cant keep the rows in the table when when the content has expired. Am I missing something? How to keep the Index updated when the rows are deleted from the table. --
Re: Remove the deleted docs from the Solr Index
Here's a couple more options: http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents/ http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents/ Cheers, Mauricio On Mon, Dec 28, 2009 at 5:51 PM, Mohamed Parvez par...@gmail.com wrote: I am using Solr 1.4 and DIH to build the index from a table. I use full import once to create the index and then i keep using delta import to update the index. All woks fine as long a the table gets added with only new rows. if there are some rows in the table that get deleted then the index does not get updated and has stale data. I have looked into the below options: 1] deletedPkQuery and deltaImportQuery :- Both are of no use, as there is no way any DB SQL query can return the row from the table, if the row is already deleted from the table. 2] preImportDeleteQuery and postImportDeleteQuery :- Both are of no use, as they work only with full import. ( Also there is no way any DB SQL query can return the row from the table, if the row is already deleted from the table) 3] Creating a new field in the table, named delete, and setting it as true and instead of actually deleting the row from the table:- This is not possible as that table is a sort of getting updated from external content management system, with news updates and has 1000 of new rows added and 1000 deleted every hour. Cant keep the rows in the table when when the content has expired. Am I missing something? How to keep the Index updated when the rows are deleted from the table. --
Unable to delete from index
I'm having trouble performing deletes on a Solr 1.4 index. Whether I perform the deletes by query or by id, the document in question doesn't seem to get removed from the index. Even after a commit. I thought the problem might be the fact that I wasn't committing with expungeDeletes=true, but I've since changed that and I'm still having no luck. Any ideas? Thanks in advance and happy holidays, -Gio.
Re: Remove the deleted docs from the Solr Index
I have looked in the that thread earlier. But there is no option there for a solution from Solr side. I mean the two more options there are 1] Use database triggers instead of DIH to manage updating the index :- This out of question as we cant run 1000 odd triggers every hour to delete. 2] Some sort of ORM use its interception:- This is also out of question as the deletes happens form external system or directly on the database, not through our application. To Say in Short, Solr Should have something thing to keep the index synced with the database. As of now its one way street, updates rows, on DB will go to the index. Deleted rows in the DB, will not be deleted from the Index --- Thanks On Mon, Dec 28, 2009 at 3:23 PM, Mauricio Scheffer mauricioschef...@gmail.com wrote: Here's a couple more options: http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents/ http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents/ Cheers, Mauricio On Mon, Dec 28, 2009 at 5:51 PM, Mohamed Parvez par...@gmail.com wrote: I am using Solr 1.4 and DIH to build the index from a table. I use full import once to create the index and then i keep using delta import to update the index. All woks fine as long a the table gets added with only new rows. if there are some rows in the table that get deleted then the index does not get updated and has stale data. I have looked into the below options: 1] deletedPkQuery and deltaImportQuery :- Both are of no use, as there is no way any DB SQL query can return the row from the table, if the row is already deleted from the table. 2] preImportDeleteQuery and postImportDeleteQuery :- Both are of no use, as they work only with full import. ( Also there is no way any DB SQL query can return the row from the table, if the row is already deleted from the table) 3] Creating a new field in the table, named delete, and setting it as true and instead of actually deleting the row from the table:- This is not possible as that table is a sort of getting updated from external content management system, with news updates and has 1000 of new rows added and 1000 deleted every hour. Cant keep the rows in the table when when the content has expired. Am I missing something? How to keep the Index updated when the rows are deleted from the table. --
RE: Unable to delete from index
Are you deleting from correct index.[Meaning verify - Solr home] Also inspect thru luke to check the contents Ankit -Original Message- From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] Sent: Monday, December 28, 2009 4:28 PM To: solr-user@lucene.apache.org Subject: Unable to delete from index I'm having trouble performing deletes on a Solr 1.4 index. Whether I perform the deletes by query or by id, the document in question doesn't seem to get removed from the index. Even after a commit. I thought the problem might be the fact that I wasn't committing with expungeDeletes=true, but I've since changed that and I'm still having no luck. Any ideas? Thanks in advance and happy holidays, -Gio.
RE: Unable to delete from index
I opened up my index using Luke, found a document by searching for a specific ID (versionId:2002366155), and then I deleted it using Luke. After committing, performing the search again in Luke yielded no results. However, when I perform that same search using Solr, I get a result. That got me thinking that I was opening up the wrong directory in Luke but I've double-checked it a few times. Is it a problem that I have my data directory defined in solr.xml and not in solrconfig.xml? -Gio. -Original Message- From: Ankit Bhatnagar [mailto:abhatna...@vantage.com] Sent: Monday, December 28, 2009 4:54 PM To: 'solr-user@lucene.apache.org' Subject: RE: Unable to delete from index Are you deleting from correct index.[Meaning verify - Solr home] Also inspect thru luke to check the contents Ankit -Original Message- From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] Sent: Monday, December 28, 2009 4:28 PM To: solr-user@lucene.apache.org Subject: Unable to delete from index I'm having trouble performing deletes on a Solr 1.4 index. Whether I perform the deletes by query or by id, the document in question doesn't seem to get removed from the index. Even after a commit. I thought the problem might be the fact that I wasn't committing with expungeDeletes=true, but I've since changed that and I'm still having no luck. Any ideas? Thanks in advance and happy holidays, -Gio.
RE: Unable to delete from index
I opened up my index using Luke, found a document by searching for a specific ID (versionId:2002366155), and then I deleted it using Luke. After committing, performing the search again in Luke yielded no results. However, when I perform that same search using Solr, I get a result. That got me thinking that I was opening up the wrong directory in Luke but I've double-checked it a few times. Is it a problem that I have my data directory defined in solr.xml and not in solrconfig.xml? If you are querying solr from a browser can you disable http caching in solrconfig.xml httpCaching never304=true and then try again?
RE: Unable to delete from index
My HTTP caching is currently configured for Open Time httpCaching lastModifiedFrom=openTime etagSeed=Solr So that shouldn't be the problem, right? -Original Message- From: AHMET ARSLAN [mailto:iori...@yahoo.com] Sent: Monday, December 28, 2009 5:31 PM To: solr-user@lucene.apache.org Subject: RE: Unable to delete from index I opened up my index using Luke, found a document by searching for a specific ID (versionId:2002366155), and then I deleted it using Luke. After committing, performing the search again in Luke yielded no results. However, when I perform that same search using Solr, I get a result. That got me thinking that I was opening up the wrong directory in Luke but I've double-checked it a few times. Is it a problem that I have my data directory defined in solr.xml and not in solrconfig.xml? If you are querying solr from a browser can you disable http caching in solrconfig.xml httpCaching never304=true and then try again?
fl parameter and dynamic fields
I use dynamic fields heavily in my SOLR config. I would like to be able to specify which fields should be returned from a query based on a pattern for the field name. For instance, given: dynamicField name=Bool_* type=boolean indexed=true stored=true / I might be able to construct a query like: http://localhost:8080/solr/select?q=Bool_*:truerows=10 Is there something like this in SOLR? Thanks, Tim Harsch
RE: Unable to delete from index
Sorry - hit reply too early. I edited my config as you suggested, rebooted Tomcat, and I can still find the doc through the Solr Admin interface even though I can't find it in Luke. -Original Message- From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] Sent: Monday, December 28, 2009 5:44 PM To: solr-user@lucene.apache.org Subject: RE: Unable to delete from index My HTTP caching is currently configured for Open Time httpCaching lastModifiedFrom=openTime etagSeed=Solr So that shouldn't be the problem, right? -Original Message- From: AHMET ARSLAN [mailto:iori...@yahoo.com] Sent: Monday, December 28, 2009 5:31 PM To: solr-user@lucene.apache.org Subject: RE: Unable to delete from index I opened up my index using Luke, found a document by searching for a specific ID (versionId:2002366155), and then I deleted it using Luke. After committing, performing the search again in Luke yielded no results. However, when I perform that same search using Solr, I get a result. That got me thinking that I was opening up the wrong directory in Luke but I've double-checked it a few times. Is it a problem that I have my data directory defined in solr.xml and not in solrconfig.xml? If you are querying solr from a browser can you disable http caching in solrconfig.xml httpCaching never304=true and then try again?
Re: Spatial / Local Solr radius
On Dec 28, 2009, at 11:47 AM, Mauricio Scheffer wrote: q={!spatial lat=43.705 long=116.3635 radius=100}*:* What's QParser is the spatial plugin? I don't know of any such QParser in Solr. Is this a third party tool? If so, I'd suggest asking on that list. with no other parameters. When changing the radius to 250 I get no results. In my config I have startTier = 9 and endTier = 17 (default values) On Mon, Dec 28, 2009 at 1:24 PM, Grant Ingersoll gsi...@gmail.com wrote: What do your queries look like? On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote: Hi everyone, I'm getting inconsistent behavior from Spatial Solr when searching with different radii. For the same lat/long I get: radius=1 - 1 result radius=10 - 0 result radius=25 - 2 results radius=100 - 2 results radius=250 - 0 results I don't understand why radius=10 and 250 return no results. Is this a known bug? I'm using the default configuration as specified in the PDF. BTW I also tried LocalSolr with the same results. Thanks Mauricio -- Grant Ingersoll http://www.lucidimagination.com/ Search the Lucene ecosystem using Solr/Lucene: http://www.lucidimagination.com/search
Re: Spatial / Local Solr radius
It's jteam's plugin ( http://www.jteam.nl/news/spatialsolr ) which AFAIK is just the latest patch for SOLR-773 packaged as a stand-alone plugin. I'll try to contact jteam directly. Thanks Mauricio On Mon, Dec 28, 2009 at 8:02 PM, Grant Ingersoll gsing...@apache.orgwrote: On Dec 28, 2009, at 11:47 AM, Mauricio Scheffer wrote: q={!spatial lat=43.705 long=116.3635 radius=100}*:* What's QParser is the spatial plugin? I don't know of any such QParser in Solr. Is this a third party tool? If so, I'd suggest asking on that list. with no other parameters. When changing the radius to 250 I get no results. In my config I have startTier = 9 and endTier = 17 (default values) On Mon, Dec 28, 2009 at 1:24 PM, Grant Ingersoll gsi...@gmail.com wrote: What do your queries look like? On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote: Hi everyone, I'm getting inconsistent behavior from Spatial Solr when searching with different radii. For the same lat/long I get: radius=1 - 1 result radius=10 - 0 result radius=25 - 2 results radius=100 - 2 results radius=250 - 0 results I don't understand why radius=10 and 250 return no results. Is this a known bug? I'm using the default configuration as specified in the PDF. BTW I also tried LocalSolr with the same results. Thanks Mauricio -- Grant Ingersoll http://www.lucidimagination.com/ Search the Lucene ecosystem using Solr/Lucene: http://www.lucidimagination.com/search
RE: Unable to delete from index
Could you share both your solr.xml and solrconfig.xml Ankit -Original Message- From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] Sent: Monday, December 28, 2009 5:46 PM To: solr-user@lucene.apache.org Subject: RE: Unable to delete from index Sorry - hit reply too early. I edited my config as you suggested, rebooted Tomcat, and I can still find the doc through the Solr Admin interface even though I can't find it in Luke. -Original Message- From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] Sent: Monday, December 28, 2009 5:44 PM To: solr-user@lucene.apache.org Subject: RE: Unable to delete from index My HTTP caching is currently configured for Open Time httpCaching lastModifiedFrom=openTime etagSeed=Solr So that shouldn't be the problem, right? -Original Message- From: AHMET ARSLAN [mailto:iori...@yahoo.com] Sent: Monday, December 28, 2009 5:31 PM To: solr-user@lucene.apache.org Subject: RE: Unable to delete from index I opened up my index using Luke, found a document by searching for a specific ID (versionId:2002366155), and then I deleted it using Luke. After committing, performing the search again in Luke yielded no results. However, when I perform that same search using Solr, I get a result. That got me thinking that I was opening up the wrong directory in Luke but I've double-checked it a few times. Is it a problem that I have my data directory defined in solr.xml and not in solrconfig.xml? If you are querying solr from a browser can you disable http caching in solrconfig.xml httpCaching never304=true and then try again?
RE: Unable to delete from index
Here you go. Thanks for your help! Gio. -Original Message- From: Ankit Bhatnagar [mailto:abhatna...@vantage.com] Sent: Monday, December 28, 2009 10:09 PM To: 'solr-user@lucene.apache.org' Subject: RE: Unable to delete from index Could you share both your solr.xml and solrconfig.xml Ankit -Original Message- From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] Sent: Monday, December 28, 2009 5:46 PM To: solr-user@lucene.apache.org Subject: RE: Unable to delete from index Sorry - hit reply too early. I edited my config as you suggested, rebooted Tomcat, and I can still find the doc through the Solr Admin interface even though I can't find it in Luke. -Original Message- From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] Sent: Monday, December 28, 2009 5:44 PM To: solr-user@lucene.apache.org Subject: RE: Unable to delete from index My HTTP caching is currently configured for Open Time httpCaching lastModifiedFrom=openTime etagSeed=Solr So that shouldn't be the problem, right? -Original Message- From: AHMET ARSLAN [mailto:iori...@yahoo.com] Sent: Monday, December 28, 2009 5:31 PM To: solr-user@lucene.apache.org Subject: RE: Unable to delete from index I opened up my index using Luke, found a document by searching for a specific ID (versionId:2002366155), and then I deleted it using Luke. After committing, performing the search again in Luke yielded no results. However, when I perform that same search using Solr, I get a result. That got me thinking that I was opening up the wrong directory in Luke but I've double-checked it a few times. Is it a problem that I have my data directory defined in solr.xml and not in solrconfig.xml? If you are querying solr from a browser can you disable http caching in solrconfig.xml httpCaching never304=true and then try again? ?xml version=1.0 encoding=UTF-8 ? !-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the License); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an AS IS BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -- !-- All (relative) paths are relative to the installation path persistent: Save changes made via the API to this file sharedLib: path to a lib directory that will be shared across all cores -- solr persistent=true !-- adminPath: RequestHandler path to manage cores. If 'null' (or absent), cores will not be manageable via request handler -- cores adminPath=/admin/cores core name=FilingsCore1 instanceDir=FilingsCore dataDir=D:\solrData\FilingsCore1/ core name=FilingsCore2 instanceDir=FilingsCore dataDir=D:\solrData\FilingsCore2/ core name=FilingsCoreTestOnly instanceDir=FilingsCore dataDir=D:\solrData\FilingsCoreTestOnly/ /cores /solr ?xml version=1.0 encoding=UTF-8 ? !-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright ownership. The ASF licenses this file to You under the Apache License, Version 2.0 (the License); you may not use this file except in compliance with the License. You may obtain a copy of the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an AS IS BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. -- config !-- Set this to 'false' if you want solr to continue working after it has encountered an severe configuration error. In a production environment, you may want solr to keep working even if one handler is mis-configured. You may also set this to false using by setting the system property: -Dsolr.abortOnConfigurationError=false -- abortOnConfigurationError${solr.abortOnConfigurationError:true}/abortOnConfigurationError !-- Used to specify an alternate directory to hold all index data other than the default ./data under the Solr home. If replication is in use, this should match the replication configuration. -- !--dataDir${solr.data.dir:./solr/data}/Core0/dataDir-- indexDefaults !--
How use implement Lucene for perl.
I am new for Lucene. I haven't any idea about Lucene. I want to implement Lucene in my search script. Please guide me what I needs to be do for Lucene implementation. Actually, I want to integrate lucene search with message board system where people come to post new topic, edit that topic and delete that on needs. I want, to update search index at every action. So I need some valuable help. -- View this message in context: http://old.nabble.com/How-use-implement-Lucene-for-perl.-tp26951130p26951130.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: How use implement Lucene for perl.
I think you need to send a message to the lucene mailing list instead if you want to use Lucene directly. java-u...@lucene.apache.org The API core Javadoc page has a very simple example which you can use to get started with a few modifications. http://lucene.apache.org/java/3_0_0/api/core/index.html Use the documentation to select the appropriate constructor and method signatures. On the other hand, I think Solr can do everything that you need without the need to interact directly with the lucene API On Mon, Dec 28, 2009 at 11:42 PM, Maheshwar maheshwar2...@gmail.com wrote: I am new for Lucene. I haven't any idea about Lucene. I want to implement Lucene in my search script. Please guide me what I needs to be do for Lucene implementation. Actually, I want to integrate lucene search with message board system where people come to post new topic, edit that topic and delete that on needs. I want, to update search index at every action. So I need some valuable help. -- View this message in context: http://old.nabble.com/How-use-implement-Lucene-for-perl.-tp26951130p26951130.html Sent from the Solr - User mailing list archive at Nabble.com. -- Good Enough is not good enough. To give anything less than your best is to sacrifice the gift. Quality First. Measure Twice. Cut Once. http://www.israelekpo.com/
Re: NOT highlighting synonym
I think what Erik was referring to was for you to create a separate copy field with different analyzers and just copy the original value to that copy field and index it differently. That way you can use one field for search and another one to display the highlighting results. On Mon, Dec 28, 2009 at 1:00 PM, darniz rnizamud...@edmunds.com wrote: Thanks Unfortunately thats not the case. We are using the same field to do search on and display that text. So looks like in this case this is not possible Am i correct We have a custom field type with synonyms defined at query time. Erik Hatcher-4 wrote: On Dec 23, 2009, at 2:26 PM, darniz wrote: i have a requirement where we dont want to hightlight synonym matches. for example i search for caddy and i dont want to highlight matched synonym like cadillac. Looking at highlighting parameters i didn't find any support for this. anyone can offer any advice. You can control what gets highlighted by which analyzer is used. You may need a different field for highlighting than you use for searching in this case - but you can just create another field type without the synonym filter in it and use that for highlighting. Erik -- View this message in context: http://old.nabble.com/NOT-highlighting-synonym-tp26906321p26945921.html Sent from the Solr - User mailing list archive at Nabble.com. -- Good Enough is not good enough. To give anything less than your best is to sacrifice the gift. Quality First. Measure Twice. Cut Once. http://www.israelekpo.com/
Re: How use implement Lucene for perl.
On Tue, Dec 29, 2009 at 3:42 PM, Maheshwar maheshwar2...@gmail.com wrote: I am new for Lucene. I haven't any idea about Lucene. I want to implement Lucene in my search script. Please guide me what I needs to be do for Lucene implementation. Yes probably the wrong list or not, but for both Lucene or Solr the best place for you to possibly look for Perl is on CPAN: http://search.cpan.org/~bricas/WebService-Lucene-0.10/lib/WebService/Lucene.pm and http://search.cpan.org/~bricas/WebService-Solr-0.09/lib/WebService/Solr.pm provide appropriate interfaces and documentation. Among others. Actually, I want to integrate lucene search with message board system where people come to post new topic, edit that topic and delete that on needs. I want, to update search index at every action. So I need some valuable help. -- View this message in context: http://old.nabble.com/How-use-implement-Lucene-for-perl.-tp26951130p26951130.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Remove the deleted docs from the Solr Index
On Tue, Dec 29, 2009 at 3:03 AM, Mohamed Parvez par...@gmail.com wrote: I have looked in the that thread earlier. But there is no option there for a solution from Solr side. I mean the two more options there are 1] Use database triggers instead of DIH to manage updating the index :- This out of question as we cant run 1000 odd triggers every hour to delete. 2] Some sort of ORM use its interception:- This is also out of question as the deletes happens form external system or directly on the database, not through our application. To Say in Short, Solr Should have something thing to keep the index synced with the database. As of now its one way street, updates rows, on DB will go to the index. Deleted rows in the DB, will not be deleted from the Index How can Solr figure out what has been deleted? Should it go through each row and comparing against each doc? Even then some things are not possible (think indexed fields). It would be far efficient to just do a full-import each time instead. -- Regards, Shalin Shekhar Mangar.
Re: fl parameter and dynamic fields
On Tue, Dec 29, 2009 at 4:14 AM, Harsch, Timothy J. (ARC-TI)[PEROT SYSTEMS] timothy.j.har...@nasa.gov wrote: I use dynamic fields heavily in my SOLR config. I would like to be able to specify which fields should be returned from a query based on a pattern for the field name. For instance, given: dynamicField name=Bool_* type=boolean indexed=true stored=true / I might be able to construct a query like: http://localhost:8080/solr/select?q=Bool_*:truerows=10 Is there something like this in SOLR? Nope. There has been discussed a couple of times though. See http://wiki.apache.org/solr/FieldAliasesAndGlobsInParams -- Regards, Shalin Shekhar Mangar.
Re: Dynamic facets?
On Mon, Dec 28, 2009 at 7:55 PM, Darren Govoni dar...@ontrenet.com wrote: Hi, I was wondering if there is a way to retrieve the facets from a query based on their mincount without specifying facet.field? I submit a query and want to retrieve all the faceted fields with mincounts 2, but don't know what they might be since I also use dynamic fields. Is this possible? No, one must specify the field name on which one wants to facet. It seems that you don't care about the field names, just the individual term and count. If so, you can create a copy field for all the dynamic fields you have. -- Regards, Shalin Shekhar Mangar.