RE: Query regarding Solr ClassCastException on client side for Java

2011-08-01 Thread Tejas Bavishi
Hi This happened because the there are 2 jars - apache-solr-solrj-3.3.0.jar and apache-solr-solrj-1.3.0.jar in the Apache Solr distribution. After I removed the apache-solr-solrj-1.3.0.jar file, the code is working fine. Thank you for your pointers!! Best Regards, Tejas Bavishi -Original

When replication finished ,is a repeater server has same version with master?

2011-08-01 Thread ZiLi
Hi, I'm using an repeater .As you know ,sometimes the repeater will get a version from master, I wonder when this synchronize finished ,is this two indexes have same version number ? Any suggestions will be appreciate. Thanks so much.

Update some fields for all documents: LUCENE-1879 vs. ParallelReader .FilterIndex

2011-08-01 Thread karsten-solr
Hi lucene/solr-folk, Issue: Our documents are stable except for two fields which are used for linking between the docs. So we like to update this two fields in a batch once a month (possible once a week). We can not reindex all docs once a month, because we are using XeLDA in some fields for

Re: Store complete XML record (DIH XPathEntityProcessor)

2011-08-01 Thread Chantal Ackermann
Hi g, ok, I understand your problem, now. (Sorry for answering that late.) I don't think PlainTextEntityProcessor can help you. It does not take a regex. LineEntityProcessor does but your record elements probably do not come on their own line each and you wouldn't want to depend on that, anyway.

Re: Store complete XML record (DIH XPathEntityProcessor)

2011-08-01 Thread Michael Sokolov
On 8/1/2011 6:17 AM, Chantal Ackermann wrote: If you are looking for a config-only solution - i'm not sure that there is one. Someone else might be able to comment on that? You might want to take a look at SOLR-2597; it has a patch for XmlStripCharFilter, which will strip tags from XML for

Re: Solr request filter and indexing process

2011-08-01 Thread 于浩
thanks for the reply. This is tomcat log files on my Solr Server: I found that : if the server returns status=0 and QTime=0, the SolrPhpClient will throughs an Exception. But the same query String will not always return status=0 and QTime=0. The Query String is valid, I have tested them in Solr

Re: slow highlighting because of stemming

2011-08-01 Thread Orosz György
Thanks for the answers! This was the solution! :) (my fault was that I tried to use the on value instead of true - don't know why..) Gyuri 2011/7/30 Michael Sokolov soko...@ifactory.com On 7/30/2011 3:46 AM, Orosz György wrote: Hi, Thanks for the answer! I am doing some logging about

sort by function

2011-08-01 Thread Gastone Penzo
Hi, i need to order by function like: sort=sum(field1,field2,field3)+desc but solr gives me this error: Missing sort order. why is this possible? i read that is possible to order by function, from version 1.3 (http://wiki.apache.org/solr/FunctionQuery#Sort_By_Function) i use version 1.4

Re: When replication finished ,is a repeater server has same version with master?

2011-08-01 Thread Jak Akdemir
Hi Zili, Master, Slave and Repeater all of these nodes will be at same index version after replication. You can check it with replication?command=indexversion command. On Mon, Aug 1, 2011 at 11:08 AM, ZiLi dangld...@163.com wrote: Hi, I'm using an repeater .As you know ,sometimes the repeater

ideas for versioning query?

2011-08-01 Thread Mike Sokolov
A customer has an interesting problem: some documents will have multiple versions. In search results, only the most recent version of a given document should be shown. The trick is that each user has access to a different set of document versions, and each user should see only the most recent

Re: sort by function

2011-08-01 Thread Jamie Johnson
I've never tried but could it be sort=sum(field1,field2,field3)%20desc On Mon, Aug 1, 2011 at 9:43 AM, Gastone Penzo gastone.pe...@gmail.com wrote: Hi, i need to order by function like: sort=sum(field1,field2,field3)+desc but solr gives me this error: Missing sort order. why is this

Re: ideas for versioning query?

2011-08-01 Thread Tomás Fernández Löbbe
Hi Michael, I guess this could be solved using grouping as you said. Documents inside a group can be sorted on a field (in your case, the version field, see parameter group.sort), and you can show only the first one. It will be more complex to show facets (post grouping faceting is work in

Re: ideas for versioning query?

2011-08-01 Thread Mike Sokolov
Thanks, Tomas. Yes we are planning to keep a current flag in the most current document. But there are cases where, for a given user, the most current document is not that one, because they only have access to some older documents. I took a look at http://wiki.apache.org/solr/FieldCollapsing

Re: ideas for versioning query?

2011-08-01 Thread Martijn v Groningen
Hi Mike, how many docs and groups do you have in your index? I think the group.sort option fits your requirements. If I remember correctly group.ngroup=true adds something like 30% extra time on top of the search request with grouping, but that was on my local test dataset (~30M docs, ~8000

Re: ideas for versioning query?

2011-08-01 Thread Mike Sokolov
I think a 30% increase is acceptable. Yes, I think we'll try it. Although our case is more like # groups ~ # documents / N, where N is a smallish number (~1-5?). We are planning for a variety of different index sizes, but aiming for a sweet spot around a few M docs. -Mike On 08/01/2011

External File Field

2011-08-01 Thread Mark
We have around 10million documents that are in our index and about 10% of them have some extra statistics that are calculated on a daily basis which are then index and used in our function queries. This reindexing comes at the expense of doing multiple joins in DIH so I am thinking it may be

Re: External File Field

2011-08-01 Thread Yonik Seeley
On Mon, Aug 1, 2011 at 11:16 AM, Mark static.void@gmail.com wrote: We have around 10million documents that are in our index and about 10% of them have some extra statistics that are calculated on a daily basis which are then index and used in our function queries. This reindexing comes at

German language specific problem (automatic Spelling correction, automatic Synonyms ?)

2011-08-01 Thread thomas
Hi, we have several entries in our database our customer would like to find when using a not exactly matching search string. The Problem is kind of related to spelling correction and synonyms. But instead of single entries in synonyms.txt we would like a automatic solution for this group of

Re: German language specific problem (automatic Spelling correction, automatic Synonyms ?)

2011-08-01 Thread Alexei Martchenko
I'd try solr.PhoneticFilterFactory, it usually converts these slight differences... schmidt, smith and schmid will be something like XMDT 2011/8/1 thomas tom.erfu...@googlemail.com Hi, we have several entries in our database our customer would like to find when using a not exactly matching

Re: German language specific problem (automatic Spelling correction, automatic Synonyms ?)

2011-08-01 Thread Paul Libbrecht
Thomas, an alternative would be to use the Kölner phonetic factory. A recent discussion happened about it. But all this needs some programming. paul Le 1 août 2011 à 17:41, Alexei Martchenko a écrit : I'd try solr.PhoneticFilterFactory, it usually converts these slight differences...

Re: German language specific problem (automatic Spelling correction, automatic Synonyms ?)

2011-08-01 Thread thomas
Thanks Alexei, Thanks Paul, I played with the solr.PhoneticFilterFactory. Analysing my query in solr admin backend showed me how and that it is working. My major problem is, that this filter needs to be applied to the index chain as well as to the query chain to generate matches for our search.

Re: German language specific problem (automatic Spelling correction, automatic Synonyms ?)

2011-08-01 Thread Jonathan Rochkind
Any changes you make related to stemming or normalization are likely going to require a re-index, just how it goes, just how solr/lucene works. What you can do just by normalizing at query time is limited, almost any good solution to this type of problem is going to require normalization at

Re: German language specific problem (automatic Spelling correction, automatic Synonyms ?)

2011-08-01 Thread Paul Libbrecht
Le 1 août 2011 à 18:35, thomas a écrit : Thanks Alexei, Thanks Paul, I played with the solr.PhoneticFilterFactory. Analysing my query in solr admin backend showed me how and that it is working. My major problem is, that this filter needs to be applied to the index chain as well as to the

Re: German language specific problem (automatic Spelling correction, automatic Synonyms ?)

2011-08-01 Thread Jonathan Rochkind
On 8/1/2011 12:42 PM, Paul Libbrecht wrote: Otherwise i need to backup the whole index and try to reindex overnight when cms users are sleeping. With some work you can do this using an extra solr that just pulls everything, then swaps the indexes (that needs a bit of downtime), then

Joining on multi valued fields

2011-08-01 Thread matthew . fowler
Hi List I have been using the JOIN patch https://issues.apache.org/jira/browse/SOLR-2272 with great success. However I have hit a case where it doesn't seem to be working. It doesn't seem to work when joining to a multi-valued field. Has anyone any experience using the patch to join on

Re: An idea for an intersection type of filter query

2011-08-01 Thread Shawn Heisey
On 7/31/2011 8:18 PM, Chris Hostetter wrote: the syntax isn't really the hard part. where things get tricky is in the internals of th SolrIndexSearcher and SearchHandler so that you cache those fqu params independently and then union the results, particularly when those fq/fqu params need to be

Re: Joining on multi valued fields

2011-08-01 Thread Yonik Seeley
On Mon, Aug 1, 2011 at 12:58 PM, matthew.fow...@thomsonreuters.com wrote: I have been using the JOIN patch https://issues.apache.org/jira/browse/SOLR-2272 with great success. However I have hit a case where it doesn't seem to be working. It doesn't seem to work when joining to a multi-valued

Re: German language specific problem (automatic Spelling correction, automatic Synonyms ?)

2011-08-01 Thread Mike Sokolov
If you want to avoid re-indexing, you could consider building a synonym file that is generated using your rule set, and then using that to expand your queries. You'd need to get a list of all terms in your index and then process them to generate synyonyms. Actually, I don't know how to get a

Re: Solr request filter and indexing process

2011-08-01 Thread Chris Hostetter
: thanks for the reply. This is tomcat log files on my Solr Server: : I found that : if the server returns status=0 and QTime=0, the SolrPhpClient : will throughs an Exception. But the same query String will not always return : status=0 and QTime=0. The Query String is valid, I have tested them

Re: German language specific problem (automatic Spelling correction, automatic Synonyms ?)

2011-08-01 Thread Jonathan Rochkind
On 8/1/2011 1:40 PM, Mike Sokolov wrote: If you want to avoid re-indexing, you could consider building a synonym file that is generated using your rule set, and then using that to expand your queries. You'd need to get a list of all terms in your index and then process them to generate

Re: Solr 3.2.0 is not writing log

2011-08-01 Thread Ruixiang Zhang
It works perfectly! Thank you so much!!! Ruixiang On Sun, Jul 31, 2011 at 7:56 PM, tmahesh mah...@tmahesh.com wrote: In etc/jetty.xml, at line 204, you should remove the comment (delete line 204 and line 218) 204 -- View this message in context:

Spatial Search and Highlighting

2011-08-01 Thread Ralf Musick
Hi, I combined a spatial distance search with a fulltext search as described in http://wiki.apache.org/solr/SpatialSearch#geodist_-_The_distance_function . I'm using solr 3.3 and that works fine. BUT, I want to use highlighting of fulltext query words but that does not work. Before solr

Re: Spatial Search and Highlighting

2011-08-01 Thread Smiley, David W.
Can you demonstrate the bug against the example data? If so, provide the URL please. ~ David On Aug 1, 2011, at 4:00 PM, Ralf Musick wrote: Hi, I combined a spatial distance search with a fulltext search as described in

Re: Spatial Search and Highlighting

2011-08-01 Thread Ralf Musick
Hi David, an example is: http://localhost:8983/solr/browse?indent=onhl=onhl.fl=name,manusort=score+ascsfield=storejson.nl=mapwt=jsonrows=10start=0q={!func}geodist%28%29pt=45.17614%2C-93.87341fq=%28name%20:+%28canon%29%29^8 I have to say I need the calculated distance as a return field (score)

Re: Spatial Search and Highlighting

2011-08-01 Thread Smiley, David W.
Ralf, Highlighting (and search relevancy -- the score) is performed on the user query which must be in the q parameter. In your case, I see you placed your geospatial query there and you put your user query into a filter query fq. You have them reversed. You stated that the returning the

Re: Spatial Search and Highlighting

2011-08-01 Thread Ralf Musick
Hi David, So that As a temporary workaround for older Solr versions, it's possible to obtain distances by using geodist or geofilt as the only scoring part of the main query and Highlighting do not fit together, right? Ok, than I have to calculate the distance by my own. Thank you very much

Matching queries on a per-element basis against a multivalued field

2011-08-01 Thread Suk-Hyun Cho
I'm sure someone asked this before, but I couldn't find a previous post regarding this. The problem: Let's say that I have a multivalued field called myFriends that tokenizes on whitespaces. Basically, I'm treating it like a List of Lists (attributes of friends): Document A: myFriends = [

ANTLR SOLR query/filter parser

2011-08-01 Thread Scott Smith
I'm looking for an ANTLR parser that consumes solr queries and filters. Before I write my own, thought I'd ask if anyone has one they are willing to share or can point me to one? Thanks Scott

Re: Spatial Search and Highlighting

2011-08-01 Thread Bill Bell
I think 4.0 supports fl=geodist() On 8/1/11 3:47 PM, Ralf Musick ra...@gmx.de wrote: Hi David, So that As a temporary workaround for older Solr versions, it's possible to obtain distances by using geodist or geofilt as the only scoring part of the main query and Highlighting do not fit

Re: sort by function

2011-08-01 Thread Bill Bell
This seems like a bug. On 8/1/11 7:47 AM, Jamie Johnson jej2...@gmail.com wrote: I've never tried but could it be sort=sum(field1,field2,field3)%20desc On Mon, Aug 1, 2011 at 9:43 AM, Gastone Penzo gastone.pe...@gmail.com wrote: Hi, i need to order by function like:

return meta information with every search

2011-08-01 Thread solr nps
we have a fairly complex taxonomy in our search system. I want to store the taxonomy revision that was used to built the Solr index. This revision number is not specific to a document but it is specific to the entire index. I want this revision number to be returned as part of every search. What

Re: combining xml and nutch index in solr

2011-08-01 Thread Gora Mohanty
On Fri, Jul 29, 2011 at 8:56 PM, abhayd ajdabhol...@hotmail.com wrote: hi I have a xml file which has url, category,subcategory, title kind of details. and we crawl the urls in xml using Nutch. Anyway for use to merge both? [...] Not sure that I follow your requirements, and it has been