Embedded Vs External Solr Server

2009-12-28 Thread Vijay Rao
Hello,

I am planning to use Solr for an application that would be indexing a lot of
documents. I am trying to understand the advantage/disadvantage of embedding
the Solr Server into my application.

When does one use one over the other? Speed of Search and Result Retrieval
is of course of paramount importance.

Thanks
Vijay


Re: Search both diacritics and non-diacritics

2009-12-28 Thread Olala

I tried but it still not correct :(


hossman wrote:
 
 
 : I am developing a seach engine with Solr, and now I want to search both
 with
 : and without diacritics, for example: if I query kho, it will response
 kho,
 : khó, khò,... But if I query khó, it will response only khó.
 : 
 : Who anyone have solution? I have used filter
 : class=solr.ISOLatin1AccentFilterFactory/ but it is not correct :(
 
 try ASCIIFoldingFilterFactory instead.
 
 
 -Hoss
 
 

-- 
View this message in context: 
http://old.nabble.com/Search-both-diacritics-and-non-diacritics-tp26897627p26941627.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: Embedded Vs External Solr Server

2009-12-28 Thread Lucas F. A. Teixeira
result retrieval - same
speed of search - embeeded
maintenance cost and flexibility - http

[]s,

Lucas Frare Teixeira .·.
- lucas...@gmail.com
- lucastex.com.br
- blog.lucastex.com
- twitter.com/lucastex


On Mon, Dec 28, 2009 at 6:07 AM, Vijay Rao raovi...@gmail.com wrote:

 Hello,

 I am planning to use Solr for an application that would be indexing a lot
 of
 documents. I am trying to understand the advantage/disadvantage of
 embedding
 the Solr Server into my application.

 When does one use one over the other? Speed of Search and Result Retrieval
 is of course of paramount importance.

 Thanks
 Vijay



Re: Spatial Solr (JTeam)

2009-12-28 Thread Mauricio Scheffer
Seems to work for me... (I mean, I don't get a NoClassDefFoundError but I
have other issues).
I just put spatial-solr-1.0-RC3.jar in the core's lib directory and it
worked.

On Wed, Dec 23, 2009 at 8:25 PM, Thomas Rabaix thomas.rab...@gmail.comwrote:

 Hello,

 I would like to set up the spatial solr plugin from
 http://www.jteam.nl/news/spatialsolr on solr 1.4. However I am getting a
 error message when solr start.

 SEVERE: java.lang.NoClassDefFoundError:
 org/apache/solr/search/QParserPlugin

 I guess nl.jteam.search.solrext.spatial.SpatialTierQueryParserPlugin
 extends QParserPlugin. I have checked into the solr.war file (the one
 provided by solr download webpage) and the class is present.

 Do you know if the current version SSP version 1.0-RC3 is compatible with
 solr 1.4 ?

 Thanks

 --
 Thomas Rabaix



field based boosting

2009-12-28 Thread Smith G
Hello All,
   I am having a trouble in following an approach for
field boosting. I have possibility of two cases in searching. One is
similar to DisMax, which uses field boosting, and the second one is
normal. To go for which of them is based on user query ( probably
inside query parser). So I can not use DisMax as default, but I need
to provide field based boosting.
  To be brief, looking at query string,
1) if there are no fields supplied as part of the query, I need to
search for the input-query terms in a set of default field list
including support for field boosting.

2) If the user has supplied some field name as part of the query then
I do some other modifications to the query like query expansion, etc.

  As , whether the field name is provided are not is to be
judged in query parser ( as far as I know ), which might be the right
way of providing both of above features.

Thanks.


Dynamic facets?

2009-12-28 Thread Darren Govoni
Hi,
  I was wondering if there is a way to retrieve the facets from a query
based on their mincount without specifying facet.field? 

I submit a query and want to retrieve all the faceted fields with
mincounts  2, but don't know what they might be since I also use
dynamic fields. Is this possible?

thanks,
Darren



Spatial / Local Solr radius

2009-12-28 Thread Mauricio Scheffer
Hi everyone,
I'm getting inconsistent behavior from Spatial Solr when searching with
different radii. For the same lat/long I get:

radius=1 - 1 result
radius=10 - 0 result
radius=25 - 2 results
radius=100 - 2 results
radius=250 - 0 results

I don't understand why radius=10 and 250 return no results. Is this a known
bug? I'm using the default configuration as specified in the PDF.
BTW I also tried LocalSolr with the same results.

Thanks
Mauricio


RE: Search both diacritics and non-diacritics

2009-12-28 Thread Steven A Rowe
Hi Olala,

You can get something similar to what you want by copying the original field to 
another one where, as Hoss suggests, you apply ASCIIFoldingFilterFactory, and 
the rewrite queries to match against both fields, with higher boost given to 
the original field.

@Hoss: Olala would benefit from a feature that AFAICT Solr doesn't currently 
have: the ability to add synonyms based on arbritrary transforms.

Steve

On 12/28/2009 at 5:33 AM, Olala wrote:
 
 I tried but it still not correct :(
 
 hossman wrote:
   I am developing a seach engine with Solr, and now I want to search
   both with and without diacritics, for example: if I query kho, it
   will response kho, khó, khò,... But if I query khó, it will
   response only khó.
   
   Who anyone have solution? I have used filter
   class=solr.ISOLatin1AccentFilterFactory/ but it is not correct
  (
  
  try ASCIIFoldingFilterFactory instead.
  
  -Hoss



RE: Reverse sort facet query [SOLR-1672]

2009-12-28 Thread Peter 4U

 in Solr 1.4 the boolean syntax was deprecated in place of keywords that 
 are more meaninful...
 http://wiki.apache.org/solr/SimpleFacetParameters#facet.sort
 
 ... count and index replaced true and false


Yes, I thought about adding some 'new syntax', but I opted for a separate 
'facet.sortorder' parameter,

mainly because I'm not familiar enough with the codebase to know what effect 
this might have on

backward compatibility. It would be easy enough to modify the patch I created 
to do it this way.

[see SOLR-1672]

 

Thanks,

Peter

 


 
 Date: Thu, 24 Dec 2009 22:24:25 -0800
 From: hossman_luc...@fucit.org
 To: solr-user@lucene.apache.org
 Subject: RE: Reverse sort facet query
 
 
 : I'll have a look at SimpleFacets.java to look at patching it. I should 
 : think the sorting bit will be relatively straightforward. The tricky bit 
 : is how to submit the request via the query interface - there's only a 
 : boolean
 
 in Solr 1.4 the boolean syntax was deprecated in place of keywords that 
 are more meaninful...
 http://wiki.apache.org/solr/SimpleFacetParameters#facet.sort
 
 ... count and index replaced true and false
 
 we could always start supporting count desc and count asc (with 
 count as an alias for count desct
 
 : The reverse facet query is for when you want to know which event (or 
 : group of event types) has happened the least
 
 got it, thanks.
 
 
 
 -Hoss
 
  
_
Add your Gmail and Yahoo! Mail email accounts into Hotmail - it's easy
http://clk.atdmt.com/UKM/go/186394592/direct/01/

Solr an Greek Chars

2009-12-28 Thread ZAROGKIKAS,GIORGOS
Hi there 

I’m using solr 1.4 under tomcat server in windows server 2008 

 and I want to index some data that contain Greek chars

When I try to index my data and query all of them with *:* all 
the greek chars

 returned like hieroglyphics   

can anybody help ???

 

 

thanks in advance

 

 

 

 

 

 

 

-

Γεώργιος Ζαρογκίκας

Τμήμα Μηχανογράφησης 

 6936801497

  g.zarogki...@multirama.gr 

 23o Xλμ Εθ. Οδού Αθήνων Λαμίας

ΤΚ. 14564Driveme 
http://www.forthnet.gr/templates/driveme.aspx?c=10008226initialCenterX=486756.445initialCenterY=4221978.13initialZoomLevel=2
 
 

P  Please consider the environment before printing this e-mail 

 



Re: Spatial / Local Solr radius

2009-12-28 Thread Grant Ingersoll
What do your queries look like?

On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote:

 Hi everyone,
 I'm getting inconsistent behavior from Spatial Solr when searching with
 different radii. For the same lat/long I get:
 
 radius=1 - 1 result
 radius=10 - 0 result
 radius=25 - 2 results
 radius=100 - 2 results
 radius=250 - 0 results
 
 I don't understand why radius=10 and 250 return no results. Is this a known
 bug? I'm using the default configuration as specified in the PDF.
 BTW I also tried LocalSolr with the same results.
 
 Thanks
 Mauricio



Re: Solr an Greek Chars

2009-12-28 Thread Markus Jelsma
Hi,


Did you post your documents in UTF-8? Also, for querying through GET using
non-ascii you must reconfigure Tomcat6 as per the manual [1].


Cheers,

[1] http://wiki.apache.org/solr/SolrTomcat#URI_Charset_Config

ZAROGKIKAS,GIORGOS zei:
 Hi there

 I’m using solr 1.4 under tomcat server in windows
 server 2008

  and I want to index some data that contain Greek chars

 When I try to index my data and query all of them with
 *:* all the greek chars

  returned like hieroglyphics

 can anybody help ???





 thanks in advance















 -

 Γεώργιος Ζαρογκίκας

 Τμήμα Μηχανογράφησης

  6936801497

   g.zarogki...@multirama.gr

  23o Xλμ Εθ. Οδού Αθήνων Λαμίας

 ΤΚ. 14564Driveme
 http://www.forthnet.gr/templates/driveme.aspx?c=10008226initialCenterX=486756.445initialCenterY=4221978.13initialZoomLevel=2



 P  Please consider the environment before printing this e-mail








Re: Spatial / Local Solr radius

2009-12-28 Thread Mauricio Scheffer
q={!spatial lat=43.705 long=116.3635 radius=100}*:*

with no other parameters.
When changing the radius to 250 I get no results.

In my config I have startTier = 9 and endTier = 17 (default values)


On Mon, Dec 28, 2009 at 1:24 PM, Grant Ingersoll gsi...@gmail.com wrote:

 What do your queries look like?

 On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote:

  Hi everyone,
  I'm getting inconsistent behavior from Spatial Solr when searching with
  different radii. For the same lat/long I get:
 
  radius=1 - 1 result
  radius=10 - 0 result
  radius=25 - 2 results
  radius=100 - 2 results
  radius=250 - 0 results
 
  I don't understand why radius=10 and 250 return no results. Is this a
 known
  bug? I'm using the default configuration as specified in the PDF.
  BTW I also tried LocalSolr with the same results.
 
  Thanks
  Mauricio




Re: NOT highlighting synonym

2009-12-28 Thread darniz

Thanks 
Unfortunately thats not the case.
We are using the same field to do search on and display that text.
So looks like in this case this is not possible
Am i correct


We have a custom field type with synonyms defined at query time.

Erik Hatcher-4 wrote:
 
 
 On Dec 23, 2009, at 2:26 PM, darniz wrote:
 i have a requirement where we dont want to hightlight synonym matches.
 for example i search for caddy and i dont want to highlight matched  
 synonym
 like cadillac.
 Looking at highlighting parameters i didn't find any support for this.
 anyone can offer any advice.
 
 You can control what gets highlighted by which analyzer is used.  You  
 may need a different field for highlighting than you use for searching  
 in this case - but you can just create another field type without the  
 synonym filter in it and use that for highlighting.
 
   Erik
 
 
 

-- 
View this message in context: 
http://old.nabble.com/NOT-highlighting-synonym-tp26906321p26945921.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: Implementing Autocomplete/Query Suggest using Solr

2009-12-28 Thread Prasanna R
On Wed, Dec 23, 2009 at 10:52 PM, Shalin Shekhar Mangar 
shalinman...@gmail.com wrote:

 On Thu, Dec 24, 2009 at 2:39 AM, Prasanna R plistma...@gmail.com wrote:

  On Tue, Dec 22, 2009 at 11:49 PM, Shalin Shekhar Mangar 
  shalinman...@gmail.com wrote:
 
  
 I am curious how an approach that simply uses the wildcard query
functionality on an indexed field would work.
  
  
   It works fine as long as the terms are not repeated across documents.
  
  
   I do not follow why terms repeating across documents would be an issue.
 As
  long as you can differentiate between multiple matches and rank them
  properly it should work right?
 
 
 A prefix search would return documents. If a field X being used for
 auto-complete has the same value in two documents then the user will see
 the
 same value being suggested twice.


 That is right. I will have to handle removing duplicate values from the
results returned by the result handler.


  We do auto-complete through prefix searches on shingles.
 

 Just to confirm, do you mean using EdgeNgram filter to produce letter
 ngrams
 of the tokens in the chosen field?



 No, I'm talking about prefix search on tokens produced by a ShingleFilter.


I did not know about the Prefix query parser in Solr. Thanks a lot for
pointing out the same.

I find relatively little online material about the Solr/Lucene prefix query
parser. Kindly point me to any useful resource that I might be missing.

Thanks again for all your help.

Regards,

Prasanna.


Remove the deleted docs from the Solr Index

2009-12-28 Thread Mohamed Parvez
I am using Solr 1.4 and DIH to build the index from a table.

I use full import once to create the index and then i keep using delta
import to update the index.

All woks fine as long a the table gets added with only new rows.

if there are some rows in the table that get deleted then the index does not
get updated and has stale data.

I have looked into the below options:

1] deletedPkQuery and deltaImportQuery :-
Both are of no use, as there is no way any DB SQL query can return the row
from the table, if the row is already deleted from the table.

2] preImportDeleteQuery and postImportDeleteQuery :-
Both are of no use, as they work only with full import. ( Also there is no
way any DB SQL query can return the row from the table, if the row
is already deleted from the table)

3] Creating a new field in the table, named delete, and setting it as true
and instead of actually deleting the row from the table:-
This is not possible as that table is a sort of getting updated from
external content management system, with news updates and has 1000 of new
rows added and 1000 deleted every hour. Cant keep the rows in the table when
when the content has expired.

Am I missing something?  How to keep the Index updated when the rows are
deleted from the table.


--


Re: Remove the deleted docs from the Solr Index

2009-12-28 Thread Mauricio Scheffer
Here's a couple more options:

http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents/

http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents/
Cheers,
Mauricio

On Mon, Dec 28, 2009 at 5:51 PM, Mohamed Parvez par...@gmail.com wrote:

 I am using Solr 1.4 and DIH to build the index from a table.

 I use full import once to create the index and then i keep using delta
 import to update the index.

 All woks fine as long a the table gets added with only new rows.

 if there are some rows in the table that get deleted then the index does
 not
 get updated and has stale data.

 I have looked into the below options:

 1] deletedPkQuery and deltaImportQuery :-
 Both are of no use, as there is no way any DB SQL query can return the row
 from the table, if the row is already deleted from the table.

 2] preImportDeleteQuery and postImportDeleteQuery :-
 Both are of no use, as they work only with full import. ( Also there is no
 way any DB SQL query can return the row from the table, if the row
 is already deleted from the table)

 3] Creating a new field in the table, named delete, and setting it as true
 and instead of actually deleting the row from the table:-
 This is not possible as that table is a sort of getting updated from
 external content management system, with news updates and has 1000 of new
 rows added and 1000 deleted every hour. Cant keep the rows in the table
 when
 when the content has expired.

 Am I missing something?  How to keep the Index updated when the rows are
 deleted from the table.


 --



Unable to delete from index

2009-12-28 Thread Giovanni Fernandez-Kincade
I'm having trouble performing deletes on a Solr 1.4 index. Whether I perform 
the deletes by query or by id, the document in question doesn't seem to get 
removed from the index. Even after a commit.

I thought the problem might be the fact that I wasn't committing with 
expungeDeletes=true, but I've since changed that and I'm still having no luck.

Any ideas?

Thanks in advance and happy holidays,
-Gio.


Re: Remove the deleted docs from the Solr Index

2009-12-28 Thread Mohamed Parvez
I have looked in the that thread earlier. But there is no option there for a
solution from Solr side.

I mean the two more options there are
1] Use database triggers instead of DIH to manage updating the index :-
This out of question as we cant run 1000 odd triggers every hour to delete.

2] Some sort of ORM use its interception:-
This is also out of question as the deletes happens form external system or
directly on the database, not through our application.


To Say in Short, Solr Should have something thing to keep the index synced
with the database. As of now its one way street, updates rows, on DB will go
to the index. Deleted rows in the DB, will not be deleted from the Index


---
Thanks



On Mon, Dec 28, 2009 at 3:23 PM, Mauricio Scheffer 
mauricioschef...@gmail.com wrote:

 Here's a couple more options:


 http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents/

 
 http://stackoverflow.com/questions/1555610/solr-dih-how-to-handle-deleted-documents/
 
 Cheers,
 Mauricio

 On Mon, Dec 28, 2009 at 5:51 PM, Mohamed Parvez par...@gmail.com wrote:

  I am using Solr 1.4 and DIH to build the index from a table.
 
  I use full import once to create the index and then i keep using delta
  import to update the index.
 
  All woks fine as long a the table gets added with only new rows.
 
  if there are some rows in the table that get deleted then the index does
  not
  get updated and has stale data.
 
  I have looked into the below options:
 
  1] deletedPkQuery and deltaImportQuery :-
  Both are of no use, as there is no way any DB SQL query can return the
 row
  from the table, if the row is already deleted from the table.
 
  2] preImportDeleteQuery and postImportDeleteQuery :-
  Both are of no use, as they work only with full import. ( Also there is
 no
  way any DB SQL query can return the row from the table, if the row
  is already deleted from the table)
 
  3] Creating a new field in the table, named delete, and setting it as
 true
  and instead of actually deleting the row from the table:-
  This is not possible as that table is a sort of getting updated from
  external content management system, with news updates and has 1000 of new
  rows added and 1000 deleted every hour. Cant keep the rows in the table
  when
  when the content has expired.
 
  Am I missing something?  How to keep the Index updated when the rows are
  deleted from the table.
 
 
  --
 



RE: Unable to delete from index

2009-12-28 Thread Ankit Bhatnagar

Are you deleting from correct index.[Meaning verify - Solr home]
Also inspect thru luke to check the contents


Ankit

-Original Message-
From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] 
Sent: Monday, December 28, 2009 4:28 PM
To: solr-user@lucene.apache.org
Subject: Unable to delete from index

I'm having trouble performing deletes on a Solr 1.4 index. Whether I perform 
the deletes by query or by id, the document in question doesn't seem to get 
removed from the index. Even after a commit.

I thought the problem might be the fact that I wasn't committing with 
expungeDeletes=true, but I've since changed that and I'm still having no luck.

Any ideas?

Thanks in advance and happy holidays,
-Gio.


RE: Unable to delete from index

2009-12-28 Thread Giovanni Fernandez-Kincade
I opened up my index using Luke, found a document by searching for a specific 
ID (versionId:2002366155), and then I deleted it using Luke. After committing, 
performing the search again in Luke yielded no results. 

However, when I perform that same search using Solr, I get a result. 

That got me thinking that I was opening up the wrong directory in Luke but I've 
double-checked it a few times. 

Is it a problem that I have my data directory defined in solr.xml and not in 
solrconfig.xml?

-Gio.

-Original Message-
From: Ankit Bhatnagar [mailto:abhatna...@vantage.com] 
Sent: Monday, December 28, 2009 4:54 PM
To: 'solr-user@lucene.apache.org'
Subject: RE: Unable to delete from index


Are you deleting from correct index.[Meaning verify - Solr home]
Also inspect thru luke to check the contents


Ankit

-Original Message-
From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] 
Sent: Monday, December 28, 2009 4:28 PM
To: solr-user@lucene.apache.org
Subject: Unable to delete from index

I'm having trouble performing deletes on a Solr 1.4 index. Whether I perform 
the deletes by query or by id, the document in question doesn't seem to get 
removed from the index. Even after a commit.

I thought the problem might be the fact that I wasn't committing with 
expungeDeletes=true, but I've since changed that and I'm still having no luck.

Any ideas?

Thanks in advance and happy holidays,
-Gio.


RE: Unable to delete from index

2009-12-28 Thread AHMET ARSLAN
 I opened up my index using Luke,
 found a document by searching for a specific ID
 (versionId:2002366155), and then I deleted it using Luke.
 After committing, performing the search again in Luke
 yielded no results. 
 
 However, when I perform that same search using Solr, I get
 a result. 
 
 That got me thinking that I was opening up the wrong
 directory in Luke but I've double-checked it a few times. 
 
 Is it a problem that I have my data directory defined in
 solr.xml and not in solrconfig.xml?


If you are querying solr from a browser can you disable http caching in 
solrconfig.xml   httpCaching never304=true and then try again?
  


  


RE: Unable to delete from index

2009-12-28 Thread Giovanni Fernandez-Kincade
My HTTP caching is currently configured for Open Time

httpCaching lastModifiedFrom=openTime
 etagSeed=Solr


So that shouldn't be the problem, right?

-Original Message-
From: AHMET ARSLAN [mailto:iori...@yahoo.com] 
Sent: Monday, December 28, 2009 5:31 PM
To: solr-user@lucene.apache.org
Subject: RE: Unable to delete from index

 I opened up my index using Luke,
 found a document by searching for a specific ID
 (versionId:2002366155), and then I deleted it using Luke.
 After committing, performing the search again in Luke
 yielded no results. 
 
 However, when I perform that same search using Solr, I get
 a result. 
 
 That got me thinking that I was opening up the wrong
 directory in Luke but I've double-checked it a few times. 
 
 Is it a problem that I have my data directory defined in
 solr.xml and not in solrconfig.xml?


If you are querying solr from a browser can you disable http caching in 
solrconfig.xml   httpCaching never304=true and then try again?
  


  


fl parameter and dynamic fields

2009-12-28 Thread Harsch, Timothy J. (ARC-TI)[PEROT SYSTEMS]
I use dynamic fields heavily in my SOLR config.  I would like to be able to 
specify which fields should be returned from a query based on a pattern for the 
field name.  For instance, given:

dynamicField name=Bool_* type=boolean
  indexed=true stored=true /

I might be able to construct a query like:
http://localhost:8080/solr/select?q=Bool_*:truerows=10

Is there something like this in SOLR?

Thanks,
Tim Harsch



RE: Unable to delete from index

2009-12-28 Thread Giovanni Fernandez-Kincade
Sorry - hit reply too early. I edited my config as you suggested, rebooted 
Tomcat, and I can still find the doc through the Solr Admin interface even 
though I can't find it in Luke. 

-Original Message-
From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] 
Sent: Monday, December 28, 2009 5:44 PM
To: solr-user@lucene.apache.org
Subject: RE: Unable to delete from index

My HTTP caching is currently configured for Open Time

httpCaching lastModifiedFrom=openTime
 etagSeed=Solr


So that shouldn't be the problem, right?

-Original Message-
From: AHMET ARSLAN [mailto:iori...@yahoo.com] 
Sent: Monday, December 28, 2009 5:31 PM
To: solr-user@lucene.apache.org
Subject: RE: Unable to delete from index

 I opened up my index using Luke,
 found a document by searching for a specific ID
 (versionId:2002366155), and then I deleted it using Luke.
 After committing, performing the search again in Luke
 yielded no results. 
 
 However, when I perform that same search using Solr, I get
 a result. 
 
 That got me thinking that I was opening up the wrong
 directory in Luke but I've double-checked it a few times. 
 
 Is it a problem that I have my data directory defined in
 solr.xml and not in solrconfig.xml?


If you are querying solr from a browser can you disable http caching in 
solrconfig.xml   httpCaching never304=true and then try again?
  


  


Re: Spatial / Local Solr radius

2009-12-28 Thread Grant Ingersoll

On Dec 28, 2009, at 11:47 AM, Mauricio Scheffer wrote:

 q={!spatial lat=43.705 long=116.3635 radius=100}*:*

What's QParser is the spatial plugin? I don't know of any such QParser in 
Solr.  Is this a third party tool?  If so, I'd suggest asking on that list.

 
 with no other parameters.
 When changing the radius to 250 I get no results.
 
 In my config I have startTier = 9 and endTier = 17 (default values)
 
 
 On Mon, Dec 28, 2009 at 1:24 PM, Grant Ingersoll gsi...@gmail.com wrote:
 
 What do your queries look like?
 
 On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote:
 
 Hi everyone,
 I'm getting inconsistent behavior from Spatial Solr when searching with
 different radii. For the same lat/long I get:
 
 radius=1 - 1 result
 radius=10 - 0 result
 radius=25 - 2 results
 radius=100 - 2 results
 radius=250 - 0 results
 
 I don't understand why radius=10 and 250 return no results. Is this a
 known
 bug? I'm using the default configuration as specified in the PDF.
 BTW I also tried LocalSolr with the same results.
 
 Thanks
 Mauricio
 
 

--
Grant Ingersoll
http://www.lucidimagination.com/

Search the Lucene ecosystem using Solr/Lucene: 
http://www.lucidimagination.com/search



Re: Spatial / Local Solr radius

2009-12-28 Thread Mauricio Scheffer
It's jteam's plugin ( http://www.jteam.nl/news/spatialsolr ) which AFAIK is
just the latest patch for SOLR-773 packaged as a stand-alone plugin.

I'll try to contact jteam directly.

Thanks
Mauricio

On Mon, Dec 28, 2009 at 8:02 PM, Grant Ingersoll gsing...@apache.orgwrote:


 On Dec 28, 2009, at 11:47 AM, Mauricio Scheffer wrote:

  q={!spatial lat=43.705 long=116.3635 radius=100}*:*

 What's QParser is the spatial plugin? I don't know of any such QParser in
 Solr.  Is this a third party tool?  If so, I'd suggest asking on that list.

 
  with no other parameters.
  When changing the radius to 250 I get no results.
 
  In my config I have startTier = 9 and endTier = 17 (default values)
 
 
  On Mon, Dec 28, 2009 at 1:24 PM, Grant Ingersoll gsi...@gmail.com
 wrote:
 
  What do your queries look like?
 
  On Dec 28, 2009, at 9:30 AM, Mauricio Scheffer wrote:
 
  Hi everyone,
  I'm getting inconsistent behavior from Spatial Solr when searching with
  different radii. For the same lat/long I get:
 
  radius=1 - 1 result
  radius=10 - 0 result
  radius=25 - 2 results
  radius=100 - 2 results
  radius=250 - 0 results
 
  I don't understand why radius=10 and 250 return no results. Is this a
  known
  bug? I'm using the default configuration as specified in the PDF.
  BTW I also tried LocalSolr with the same results.
 
  Thanks
  Mauricio
 
 

 --
 Grant Ingersoll
 http://www.lucidimagination.com/

 Search the Lucene ecosystem using Solr/Lucene:
 http://www.lucidimagination.com/search




RE: Unable to delete from index

2009-12-28 Thread Ankit Bhatnagar
Could you share both your solr.xml and solrconfig.xml

Ankit


-Original Message-
From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] 
Sent: Monday, December 28, 2009 5:46 PM
To: solr-user@lucene.apache.org
Subject: RE: Unable to delete from index

Sorry - hit reply too early. I edited my config as you suggested, rebooted 
Tomcat, and I can still find the doc through the Solr Admin interface even 
though I can't find it in Luke. 

-Original Message-
From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] 
Sent: Monday, December 28, 2009 5:44 PM
To: solr-user@lucene.apache.org
Subject: RE: Unable to delete from index

My HTTP caching is currently configured for Open Time

httpCaching lastModifiedFrom=openTime
 etagSeed=Solr


So that shouldn't be the problem, right?

-Original Message-
From: AHMET ARSLAN [mailto:iori...@yahoo.com] 
Sent: Monday, December 28, 2009 5:31 PM
To: solr-user@lucene.apache.org
Subject: RE: Unable to delete from index

 I opened up my index using Luke,
 found a document by searching for a specific ID
 (versionId:2002366155), and then I deleted it using Luke.
 After committing, performing the search again in Luke
 yielded no results. 
 
 However, when I perform that same search using Solr, I get
 a result. 
 
 That got me thinking that I was opening up the wrong
 directory in Luke but I've double-checked it a few times. 
 
 Is it a problem that I have my data directory defined in
 solr.xml and not in solrconfig.xml?


If you are querying solr from a browser can you disable http caching in 
solrconfig.xml   httpCaching never304=true and then try again?
  


  


RE: Unable to delete from index

2009-12-28 Thread Giovanni Fernandez-Kincade
Here you go. 

Thanks for your help!
Gio.

-Original Message-
From: Ankit Bhatnagar [mailto:abhatna...@vantage.com] 
Sent: Monday, December 28, 2009 10:09 PM
To: 'solr-user@lucene.apache.org'
Subject: RE: Unable to delete from index

Could you share both your solr.xml and solrconfig.xml

Ankit


-Original Message-
From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] 
Sent: Monday, December 28, 2009 5:46 PM
To: solr-user@lucene.apache.org
Subject: RE: Unable to delete from index

Sorry - hit reply too early. I edited my config as you suggested, rebooted 
Tomcat, and I can still find the doc through the Solr Admin interface even 
though I can't find it in Luke. 

-Original Message-
From: Giovanni Fernandez-Kincade [mailto:gfernandez-kinc...@capitaliq.com] 
Sent: Monday, December 28, 2009 5:44 PM
To: solr-user@lucene.apache.org
Subject: RE: Unable to delete from index

My HTTP caching is currently configured for Open Time

httpCaching lastModifiedFrom=openTime
 etagSeed=Solr


So that shouldn't be the problem, right?

-Original Message-
From: AHMET ARSLAN [mailto:iori...@yahoo.com] 
Sent: Monday, December 28, 2009 5:31 PM
To: solr-user@lucene.apache.org
Subject: RE: Unable to delete from index

 I opened up my index using Luke,
 found a document by searching for a specific ID
 (versionId:2002366155), and then I deleted it using Luke.
 After committing, performing the search again in Luke
 yielded no results. 
 
 However, when I perform that same search using Solr, I get
 a result. 
 
 That got me thinking that I was opening up the wrong
 directory in Luke but I've double-checked it a few times. 
 
 Is it a problem that I have my data directory defined in
 solr.xml and not in solrconfig.xml?


If you are querying solr from a browser can you disable http caching in 
solrconfig.xml   httpCaching never304=true and then try again?
  


  
?xml version=1.0 encoding=UTF-8 ?
!--
 Licensed to the Apache Software Foundation (ASF) under one or more
 contributor license agreements.  See the NOTICE file distributed with
 this work for additional information regarding copyright ownership.
 The ASF licenses this file to You under the Apache License, Version 2.0
 (the License); you may not use this file except in compliance with
 the License.  You may obtain a copy of the License at

 http://www.apache.org/licenses/LICENSE-2.0

 Unless required by applicable law or agreed to in writing, software
 distributed under the License is distributed on an AS IS BASIS,
 WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 See the License for the specific language governing permissions and
 limitations under the License.
--

!--
 All (relative) paths are relative to the installation path
  
  persistent: Save changes made via the API to this file
  sharedLib: path to a lib directory that will be shared across all cores
--
solr persistent=true

  !--
  adminPath: RequestHandler path to manage cores.  
If 'null' (or absent), cores will not be manageable via request handler
  --
  cores adminPath=/admin/cores
core name=FilingsCore1 instanceDir=FilingsCore dataDir=D:\solrData\FilingsCore1/	
	core name=FilingsCore2 instanceDir=FilingsCore dataDir=D:\solrData\FilingsCore2/	
	core name=FilingsCoreTestOnly instanceDir=FilingsCore dataDir=D:\solrData\FilingsCoreTestOnly/	
  /cores
/solr
?xml version=1.0 encoding=UTF-8 ?
!--
 Licensed to the Apache Software Foundation (ASF) under one or more
 contributor license agreements.  See the NOTICE file distributed with
 this work for additional information regarding copyright ownership.
 The ASF licenses this file to You under the Apache License, Version 2.0
 (the License); you may not use this file except in compliance with
 the License.  You may obtain a copy of the License at

 http://www.apache.org/licenses/LICENSE-2.0

 Unless required by applicable law or agreed to in writing, software
 distributed under the License is distributed on an AS IS BASIS,
 WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 See the License for the specific language governing permissions and
 limitations under the License.
--

config
  !-- Set this to 'false' if you want solr to continue working after it has 
   encountered an severe configuration error.  In a production environment, 
   you may want solr to keep working even if one handler is mis-configured.

   You may also set this to false using by setting the system property:
 -Dsolr.abortOnConfigurationError=false
 --
  abortOnConfigurationError${solr.abortOnConfigurationError:true}/abortOnConfigurationError

  !-- Used to specify an alternate directory to hold all index data
   other than the default ./data under the Solr home.
   If replication is in use, this should match the replication configuration. --
  !--dataDir${solr.data.dir:./solr/data}/Core0/dataDir--


  indexDefaults
   !-- 

How use implement Lucene for perl.

2009-12-28 Thread Maheshwar

I am new for Lucene.
I haven't any idea about Lucene.
I want to implement Lucene in my search script.
Please guide me what I needs to be do for Lucene implementation.

Actually, I want to integrate lucene search with message board system where
people come to post new topic, edit that topic and delete that on needs. I
want, to update search index at every action.
So I need some valuable help.



-- 
View this message in context: 
http://old.nabble.com/How-use-implement-Lucene-for-perl.-tp26951130p26951130.html
Sent from the Solr - User mailing list archive at Nabble.com.



Re: How use implement Lucene for perl.

2009-12-28 Thread Israel Ekpo
I think you need to send a message to the lucene mailing list instead if you
want to use Lucene directly.

java-u...@lucene.apache.org

The API core Javadoc page has a very simple example which you can use to get
started with a few modifications.

http://lucene.apache.org/java/3_0_0/api/core/index.html

Use the documentation to select the appropriate constructor and method
signatures.

On the other hand, I think Solr can do everything that you need without the
need to interact directly with the lucene API

On Mon, Dec 28, 2009 at 11:42 PM, Maheshwar maheshwar2...@gmail.com wrote:


 I am new for Lucene.
 I haven't any idea about Lucene.
 I want to implement Lucene in my search script.
 Please guide me what I needs to be do for Lucene implementation.

 Actually, I want to integrate lucene search with message board system where
 people come to post new topic, edit that topic and delete that on needs. I
 want, to update search index at every action.
 So I need some valuable help.



 --
 View this message in context:
 http://old.nabble.com/How-use-implement-Lucene-for-perl.-tp26951130p26951130.html
 Sent from the Solr - User mailing list archive at Nabble.com.




-- 
Good Enough is not good enough.
To give anything less than your best is to sacrifice the gift.
Quality First. Measure Twice. Cut Once.
http://www.israelekpo.com/


Re: NOT highlighting synonym

2009-12-28 Thread Israel Ekpo
I think what Erik was referring to was for you to create a separate copy
field with different analyzers and just copy the original value to that copy
field and index it differently.

That way you can use one field for search and another one to display the
highlighting results.



On Mon, Dec 28, 2009 at 1:00 PM, darniz rnizamud...@edmunds.com wrote:


 Thanks
 Unfortunately thats not the case.
 We are using the same field to do search on and display that text.
 So looks like in this case this is not possible
 Am i correct


 We have a custom field type with synonyms defined at query time.

 Erik Hatcher-4 wrote:
 
 
  On Dec 23, 2009, at 2:26 PM, darniz wrote:
  i have a requirement where we dont want to hightlight synonym matches.
  for example i search for caddy and i dont want to highlight matched
  synonym
  like cadillac.
  Looking at highlighting parameters i didn't find any support for this.
  anyone can offer any advice.
 
  You can control what gets highlighted by which analyzer is used.  You
  may need a different field for highlighting than you use for searching
  in this case - but you can just create another field type without the
  synonym filter in it and use that for highlighting.
 
Erik
 
 
 

 --
 View this message in context:
 http://old.nabble.com/NOT-highlighting-synonym-tp26906321p26945921.html
 Sent from the Solr - User mailing list archive at Nabble.com.




-- 
Good Enough is not good enough.
To give anything less than your best is to sacrifice the gift.
Quality First. Measure Twice. Cut Once.
http://www.israelekpo.com/


Re: How use implement Lucene for perl.

2009-12-28 Thread Neil Lunn
On Tue, Dec 29, 2009 at 3:42 PM, Maheshwar maheshwar2...@gmail.com wrote:


 I am new for Lucene.
 I haven't any idea about Lucene.
 I want to implement Lucene in my search script.
 Please guide me what I needs to be do for Lucene implementation.


Yes probably the wrong list or not, but for both Lucene or Solr the best
place for you to possibly look for Perl is on CPAN:

http://search.cpan.org/~bricas/WebService-Lucene-0.10/lib/WebService/Lucene.pm

and

http://search.cpan.org/~bricas/WebService-Solr-0.09/lib/WebService/Solr.pm

provide appropriate interfaces and documentation. Among others.




 Actually, I want to integrate lucene search with message board system where
 people come to post new topic, edit that topic and delete that on needs. I
 want, to update search index at every action.
 So I need some valuable help.



 --
 View this message in context:
 http://old.nabble.com/How-use-implement-Lucene-for-perl.-tp26951130p26951130.html
 Sent from the Solr - User mailing list archive at Nabble.com.




Re: Remove the deleted docs from the Solr Index

2009-12-28 Thread Shalin Shekhar Mangar
On Tue, Dec 29, 2009 at 3:03 AM, Mohamed Parvez par...@gmail.com wrote:

 I have looked in the that thread earlier. But there is no option there for
 a
 solution from Solr side.

 I mean the two more options there are
 1] Use database triggers instead of DIH to manage updating the index :-
 This out of question as we cant run 1000 odd triggers every hour to delete.

 2] Some sort of ORM use its interception:-
 This is also out of question as the deletes happens form external system or
 directly on the database, not through our application.


 To Say in Short, Solr Should have something thing to keep the index synced
 with the database. As of now its one way street, updates rows, on DB will
 go
 to the index. Deleted rows in the DB, will not be deleted from the Index


How can Solr figure out what has been deleted? Should it go through each row
and comparing against each doc? Even then some things are not possible
(think indexed fields). It would be far efficient to just do a full-import
each time instead.

-- 
Regards,
Shalin Shekhar Mangar.


Re: fl parameter and dynamic fields

2009-12-28 Thread Shalin Shekhar Mangar
On Tue, Dec 29, 2009 at 4:14 AM, Harsch, Timothy J. (ARC-TI)[PEROT SYSTEMS]
timothy.j.har...@nasa.gov wrote:

 I use dynamic fields heavily in my SOLR config.  I would like to be able to
 specify which fields should be returned from a query based on a pattern for
 the field name.  For instance, given:

dynamicField name=Bool_* type=boolean
  indexed=true stored=true /

 I might be able to construct a query like:
 http://localhost:8080/solr/select?q=Bool_*:truerows=10

 Is there something like this in SOLR?


Nope. There has been discussed a couple of times though. See
http://wiki.apache.org/solr/FieldAliasesAndGlobsInParams

-- 
Regards,
Shalin Shekhar Mangar.


Re: Dynamic facets?

2009-12-28 Thread Shalin Shekhar Mangar
On Mon, Dec 28, 2009 at 7:55 PM, Darren Govoni dar...@ontrenet.com wrote:

 Hi,
  I was wondering if there is a way to retrieve the facets from a query
 based on their mincount without specifying facet.field?

 I submit a query and want to retrieve all the faceted fields with
 mincounts  2, but don't know what they might be since I also use
 dynamic fields. Is this possible?


No, one must specify the field name on which one wants to facet. It seems
that you don't care about the field names, just the individual term and
count. If so, you can create a copy field for all the dynamic fields you
have.

-- 
Regards,
Shalin Shekhar Mangar.