RE: range query failed if highlight is used

2008-02-26 Thread Xuesong Luo
Thanks Hoss, I created https://issues.apache.org/jira/browse/SOLR-491 to check this bug The reason I need to highlight the numeric or data field is I have to loop through the search result to apply role permission check on those fields. If the searcher doesn't have permission to see the numeric/da

Re: solr to work for my web application

2008-02-26 Thread newBea
Hey Thorsten, I need to know one more thing...currently solr is getting up and running on port 8080. What my understanding is whichever port my tomcat is running, solr is running on the same. I mean if tomcat is down, solr is down and vice versa. My requirement is I need solr to run on port 80 a

Re: Boost the results for filter value in a single query

2008-02-26 Thread Vijay Khurana
Thanks for the response Yonik. The content source field is a single valued field. Sorting the results won't work for me as the content source values are arbitrary strings and there is no set pattern i.e it can be axd or xbc or abc def. All I know at time of the query that results for content source

RE: solr to handle special charater

2008-02-26 Thread Chris Hostetter
: By the way, I used DisMaxRequestHandler in solrconfig.xml. I googled a : little about DisMaxRequestHandler, it says that '+' and '-' characters : prefixing nonwhitespace characters are treated as "mandatory" and : "prohibited" modifiers for the subsequent terms, but it doesn't say : anything

Re: range query failed if highlight is used

2008-02-26 Thread Chris Hostetter
: I'm using solr1.3 nightly build. I defined a sint field bookCount. When : I query on this field, it works fine without highlight. However if I : turn on highlight(hl=true&hl.fl=bookCount), it failed due to the error I'm not sure if i really understand what it would mean to highlight a numeric

Re: similarity search with solr

2008-02-26 Thread Erik Hatcher
On Feb 26, 2008, at 6:11 PM, Michael Hess wrote: Is it possible to to pass a document id to solr and get back the documents that are close to it? Indeed: Erik

Re: Why does highlight use the index analyzer (instead of query)?

2008-02-26 Thread Chris Hostetter
I'm not much of a highligher expert, but this *seems* like it was probably intentional ... you are tlaking abouthte use case where you have a stored field, and no term positions correct? ... so in order to highlight, the highlighter needs to analyzed the stored text to find the word positions?

Re: Search terms in the result

2008-02-26 Thread Chris Hostetter
: : Thank you for answering my question, but maybe I wasn't clear in : explaining it. In fact, what I meant was that using the Query : compilation in Lucene you can obtain an array of strings containing : the terms used from the system to search the indices. are you refering to Query.extractTerms

Re: Offsets?

2008-02-26 Thread Chris Hostetter
(moved to solr-user) analysis.jsp doesn't deal with the index, it just applies the appropriate analizer to input text to tell you what would be indexed. from what I gather, you want the "meat" of highlighting, but you dont' want any actually highlighting to take place -- you want something tha

Re: Shared index base

2008-02-26 Thread Alok K. Dhir
thanks for your response - i've been waiting for this very clarification. so 'commit()' makes readers re-read the indexes? On Feb 26, 2008, at 7:03 PM, Mike Klaas wrote: There hasn't really been a concrete answer given in this thread, so: It works to point multiple Solr's at a single data d

boost ignored with wildcard queries

2008-02-26 Thread Head
Using the StandardRequestHandler, it appears that the index boost values are ignored when the query has a wildcard in it. For example, if I have 2 's and one has a boost of 1.0 and another has a boost of 10.0, then I do a search for "bob*", both records will be returned with the same score of 1.

Re: Shared index base

2008-02-26 Thread Mike Klaas
There hasn't really been a concrete answer given in this thread, so: It works to point multiple Solr's at a single data dir, but you can't have more than one writer. If you try, the index could become corrupted or inconsistent (especially if you are using 'simple' lock type). Also, the S

similarity search with solr

2008-02-26 Thread Michael Hess
Is it possible to to pass a document id to solr and get back the documents that are close to it? Thanks, Michael ** Electronic Mail is not secure, may not be read every day, and should not be used for urgent or sensitive issues

Re: Start of solr 1.3 with patch collapse

2008-02-26 Thread David Pratt
Hi kordi. What was the issue and how did you solve it for the benefit of the list. Many thanks. Regards, David kordi wrote: I solved it now on myselft sorry for the post. kordi wrote: I cant start solr trunk with the path collapse i got the following error SEVERE: Could not start SOLR. Chec

-XX:+UseLargePages ?

2008-02-26 Thread Matthew Runo
Hello! I was wondering if there is any impact on using the LargePages JVM setting with Solr. Has anyone used this? Does it help performance? Hurt it? We have several 64 bit servers with 16G of ram each, and were wondering if we should be using the -XX:+UseLargePages setting on the JVM f

Re: Start of solr 1.3 with patch collapse

2008-02-26 Thread kordi
I solved it now on myselft sorry for the post. kordi wrote: > > I cant start solr trunk with the path collapse i got the following error > > SEVERE: Could not start SOLR. Check solr/home property > java.lang.NoSuchMethodError: > org.apache.lucene.analysis.Token.(IILjava/lang/String;)V >

Start of solr 1.3 with patch collapse

2008-02-26 Thread kordi
I cant start solr trunk with the path collapse i got the following error SEVERE: Could not start SOLR. Check solr/home property java.lang.NoSuchMethodError: org.apache.lucene.analysis.Token.(IILjava/lang/String;)V at org.apache.solr.analysis.SynonymMap.makeTokens(SynonymMap.java:103)

Re: Shared index base

2008-02-26 Thread Matthew Runo
That's true about the commit issue. With that in mind, it might be better to use replication - just keep an eye on it to ensure it's working, as my 1.2 install (3 servers) tends to stop every once in a blue moon. Thanks! Matthew Runo Software Developer Zappos.com 702.943.7833 On Feb 26, 2

Re: Shared index base

2008-02-26 Thread Walter Underwood
SAN is not NFS. I would expect SAN to be fast. wunder On 2/26/08 10:47 AM, "Jae Joo" <[EMAIL PROTECTED]> wrote: > > In my environment, there is NO big difference between local disk and SAN based > file system. > A little slow down, but not a problem (1 or 2 %) > I do have 4 sets of solr indices

RE: Shared index base

2008-02-26 Thread Jae Joo
In my environment, there is NO big difference between local disk and SAN based file system. A little slow down, but not a problem (1 or 2 %) I do have 4 sets of solr indices each has more than 10G in 3 servers. I think that it is not good way to share SINGLE Index. - disk is pretty cheap and we

Re: Shared index base

2008-02-26 Thread Walter Underwood
I saw a 100X slowdown running with indexes on NFS. I don't understand going through a lot of effort with unsupported configurations just to share an index. Local disk is cheap, the snapshot stuff works well, and local discs avoid a single point of failure. The testing time to make a shared index

RE: Shared index base

2008-02-26 Thread Charlie Jackson
How do you handle commits to the index? By that, I mean that Solr recreates its searcher when you issue a commit, but only for the system that does the commit. Wouldn't you be left with searchers on the other machines that are stale? - Charlie -Original Message- From: Matthew Runo [mail

Re: Shared index base

2008-02-26 Thread Matthew Runo
I hope so. I've found that every once in a while Solr 1.2 replication will die, from a temp-index file that seems to ham it up. Removing that file on all the servers fixes the issue though. We'd like to be able to point all the servers at an NFS location for their index files, and use a

RE: solr to handle special charater

2008-02-26 Thread Kevin Xiao
By the way, I used DisMaxRequestHandler in solrconfig.xml. I googled a little about DisMaxRequestHandler, it says that '+' and '-' characters prefixing nonwhitespace characters are treated as "mandatory" and "prohibited" modifiers for the subsequent terms, but it doesn't say anything about just

Re: Shared index base

2008-02-26 Thread Alok Dhir
Are you saying all the servers will use the same 'data' dir? Is that a supported config? On Feb 26, 2008, at 12:29 PM, Matthew Runo wrote: We're about to do the same thing here, but have not tried yet. We currently run Solr with replication across several servers. So long as only one serv

Re: Shared index base

2008-02-26 Thread Rachel McConnell
We tried this architecture for our initial rollout of Solr/Lucene to our production application. We ran into a problem with it, which may or may not apply to you. Our production software servers all are monitored for uptime by a daemon which pings them periodically and restarts them if a response

Re: Shared index base

2008-02-26 Thread Matthew Runo
We're about to do the same thing here, but have not tried yet. We currently run Solr with replication across several servers. So long as only one server is doing updates to the index, I think it should work fine. Thanks! Matthew Runo Software Developer Zappos.com 702.943.7833 On Feb 26,

AW: Threads in Solr

2008-02-26 Thread Hausherr, Jens
It has been some time since I last worked with the Lucene index directly, but AFAIK the lucene index by default is not thread-safe which means it is propably wrapped in som synchronization layer. Concerning the bad performance I can only guess on some items to examine: 1) Every thread performs

Re: Threads in Solr

2008-02-26 Thread Evgeniy Strokin
I'm running my tests on server with 4 double-kernel CPU. I was expecting good improvements from multithreaded solution but I have speed 10th times worse. Here is how I run those threads, I think I'm doing something wrong, please advise: -- .

Shared index base

2008-02-26 Thread Evgeniy Strokin
I know there was such discussions about the subject, but I want to ask again if somebody could share more information. We are planning to have several separate servers for our search engine. One of them will be index/search server, and all others are search only. We want to use SAN (BTW: should w

Re: protwords | synonyms | elevator conf files

2008-02-26 Thread Erik Hatcher
I've definitely thought about abstracting how various external data gets loaded by Solr - so you're not alone there. But I haven't fleshed anything out myself. I definitely strong support such separation though! Erik On Feb 25, 2008, at 11:18 AM, Matthew Runo wrote: Hello! Al

Re: Boost the results for filter value in a single query

2008-02-26 Thread Yonik Seeley
If content_source is single valued (maximum of one value per document), then sort. sort=content_source asc -Yonik On Tue, Feb 26, 2008 at 4:15 AM, Vijay Khurana <[EMAIL PROTECTED]> wrote: > Hi, > Here is the problem I am facing. > One of the field in my index is content_source which I use to fi

Boost the results for filter value in a single query

2008-02-26 Thread Vijay Khurana
Hi, Here is the problem I am facing. One of the field in my index is content_source which I use to filter my results. I want all the documents that have content_source value as ABC OR DEF and all the documents having DEF should appear before the documents that have content_source value as ABC. I am

solr to handle special charater

2008-02-26 Thread Kevin Xiao
Hi there, I am new to Solr. I used the following analyzer - I tried both WhitespaceTokenizerFactory and StandardTokenizerFactory, but when I search "xyz - abc", it didn't returns anything, ("xyz abc" returns "xyz - abc" though). I used the tokenizer/filter on both index and query time. Is that