form handling and query syntax

2007-01-24 Thread Will Sexton
I'm looking to use SOLR to replace the search components of a Lucene-based application I built a few years ago. One bit of functionality that I'm not seeing is how to handle form input and translate it to Lucene QueryParser syntax to pass into the SOLR servlet. An example of the kind of searc

Re: Threaded updating?

2007-01-24 Thread Mike Klaas
On 1/24/07, Scott Leonard <[EMAIL PROTECTED]> wrote: Can I speedup a solr add-post by threading an add process and asynchronously updating records? Or does solr do some locking that would make this irrelevant. Some update tasks can be parallelized and some cannot. You will see a speedup by add

Re: Threaded updating?

2007-01-24 Thread Yonik Seeley
On 1/24/07, Scott Leonard <[EMAIL PROTECTED]> wrote: Can I speedup a solr add-post by threading an add process and asynchronously updating records? Or does solr do some locking that would make this irrelevant. Yes. Parsing of the XML and text analysis of the documents would all proceed in para

Re: real-time updates

2007-01-24 Thread Yonik Seeley
On 1/24/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: > > > > Essentially I'm asking if it ok to call often. Up to many > > times / second from multiple sources. > > Really depends on your collection size, the query rate, and what your > tolerance is for queries that might take longer sometime

Threaded updating?

2007-01-24 Thread Scott Leonard
Can I speedup a solr add-post by threading an add process and asynchronously updating records? Or does solr do some locking that would make this irrelevant. .scott

Re: real-time updates

2007-01-24 Thread Ryan McKinley
> > Essentially I'm asking if it ok to call often. Up to many > times / second from multiple sources. Really depends on your collection size, the query rate, and what your tolerance is for queries that might take longer sometimes. I'd cut way down or remove any autowarming. If you norma

Re: relevance ranking and scoring

2007-01-24 Thread Yonik Seeley
On 1/24/07, Andrew Nagy <[EMAIL PROTECTED]> wrote: Yonik Seeley wrote: > Ok, here is your query: > title:(gone with the wind) OR title2:(gone > with the wind) > And here it is parsed: > (title:gone title:wind) (title2:gone > title2:wind) > > First, notice how stopwords were removed, so "with" and

Re: relevance ranking and scoring

2007-01-24 Thread Andrew Nagy
Yonik Seeley wrote: Ok, here is your query: title:(gone with the wind) OR title2:(gone with the wind) And here it is parsed: (title:gone title:wind) (title2:gone title2:wind) First, notice how stopwords were removed, so "with" and "the" will not count in the results. You are querying across t

Re: Using HTTP-Post for Queries

2007-01-24 Thread Erik Hatcher
On Jan 24, 2007, at 9:38 AM, Maximilian Hütter wrote: Erik Hatcher schrieb: On Jan 22, 2007, at 4:09 AM, Maximilian Hütter wrote: Is there a XMLQueryParser yet? I didn't find it in the source. Yes - it's part Lucene's contrib area:

Re: real-time updates

2007-01-24 Thread Yonik Seeley
On 1/24/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: Is it an ok idea to design an app with solr where you assume data will be indexed immediately? For example, after a user uploads an image - immediately use solr to search a collection that will include this new image? > Essentially I'm askin

Re: relevance ranking and scoring

2007-01-24 Thread Yonik Seeley
On 1/24/07, Andrew Nagy <[EMAIL PROTECTED]> wrote: > Let's start with the first... add a debugQuery=on > parameter to your request and post the full result here. > You can get the same effect through the > query form on the solr admin pages by checking the "Debug: explain" > checkbox. I attached

Re: real-time updates

2007-01-24 Thread Walter Underwood
On 1/24/07 1:15 AM, "Ryan McKinley" <[EMAIL PROTECTED]> wrote: > Is it an ok idea to design an app with solr where you assume data will > be indexed immediately? For example, after a user uploads an image - > immediately use solr to search a collection that will include this new > image? > > Ess

Re: relevance ranking and scoring

2007-01-24 Thread Andrew Nagy
Yonik Seeley wrote: On 1/23/07, Andrew Nagy <[EMAIL PROTECTED]> wrote: Yonik Seeley wrote: > Things you can try: > - post the debugging output (including score explain) for the query I have attached the output. > - try disabling length normalization for the title field, then remove > the entire

Re: Using HTTP-Post for Queries

2007-01-24 Thread Maximilian Hütter
Erik Hatcher schrieb: > > On Jan 22, 2007, at 4:09 AM, Maximilian Hütter wrote: >> Is there >> a XMLQueryParser yet? I didn't find it in the source. > > Yes - it's part Lucene's contrib area: > > > > > > You'll

real-time updates

2007-01-24 Thread Ryan McKinley
Is it an ok idea to design an app with solr where you assume data will be indexed immediately? For example, after a user uploads an image - immediately use solr to search a collection that will include this new image? Essentially I'm asking if it ok to call often. Up to many times / second fr