Re: Facet performance with heterogeneous 'facets'?

2006-09-21 Thread Michael Imbeault
I upgraded to the most recent Solr build (9-22) and sadly it's still really slow. 800 seconds query with a single facet on first_author, 15 millions documents total, the query return 180. Maybe i'm doing something wrong? Also, this is on my personal desktop; not on a server. Still, I'm getting

Re: Fixed first hits -> custom RequestHandler?

2006-09-21 Thread Chris Hostetter
: On 9/21/06, Otis Gospodnetic <[EMAIL PROTECTED]> wrote: : > I have a situation where I want certain documents to appear at the top : of the hit list for certain searches, regardless of their score. One : can think of it as the ads right on top of Google's search results (but : I'm not dealing w

Re: wana use CJKAnalyzer

2006-09-21 Thread James liu
2006/9/22, Chris Hostetter <[EMAIL PROTECTED]>: : i just wanna say: no your help,maybe i will give up.thk u again. : : http://www.flickr.com/photos/[EMAIL PROTECTED]/248815068/ : > thk Hoss,Nick Snels,Koji,Mike and everybody who helped me and wanna help : > me.. : > : > i can use solr wit

RE: dismax and facets with constraints

2006-09-21 Thread Chris Hostetter
: Just to clarify on this point, I am using highlighting in standardquery. : When I add a constraint and sort by a field, the highlighting function no : longer works. Possible bug or user error? : I can do it with standardrequest, but then it doesn't appear like I can sort : the results. this s

Re: dismax and facets with constraints

2006-09-21 Thread Chris Hostetter
: I'm experimenting with dismax to do faceted browsing, and when I add a : constraint with dismax on that facet, I no longer get the entire : facet-count. that sounds expected ... when you add a constraint using "fq" (or adding new clauses to the main query) the overall result set is going to get

RE: dismax and facets with constraints

2006-09-21 Thread Brian Lucas
Just to clarify on this point, I am using highlighting in standardquery. When I add a constraint and sort by a field, the highlighting function no longer works. Possible bug or user error? _ I can do it with standardrequest, but then it doesn't appear like I can sort the results.

dismax and facets with constraints

2006-09-21 Thread Brian Lucas
I'm experimenting with dismax to do faceted browsing, and when I add a constraint with dismax on that facet, I no longer get the entire facet-count. i.e. q=blah&qt=dismax&fq=type_id:1&hl=true&hl.fl=title+summary&hl.snippets=3&face t=true&facet.limit=-1&facet.zeros=false&facet.field=type_id

Re: Fixed first hits -> custom RequestHandler?

2006-09-21 Thread Yonik Seeley
On 9/21/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: You could make anything with an isSpecial boolean field appear first: search_field:java; score desc, special desc Oops, that should be search_field:java; special desc, score desc "score desc" should be the secondary sort, or whatever you norm

Re: Fixed first hits -> custom RequestHandler?

2006-09-21 Thread Yonik Seeley
On 9/21/06, Otis Gospodnetic <[EMAIL PROTECTED]> wrote: I have a situation where I want certain documents to appear at the top of the hit list for certain searches, regardless of their score. One can think of it as the ads right on top of Google's search results (but I'm not dealing with ads)

Re: Fixed first hits -> custom RequestHandler?

2006-09-21 Thread Tim Archambault
Otis, I'm curious as to what you find out here. I'm looking at setting up a second Solr instance to handle keyword advertising and the first instance to handle the site search for our newspaper website. Never thought of your question. Thanks, Tim On 9/21/06, Otis Gospodnetic <[EMAIL PROTECTED]

Re: Facet performance with heterogeneous 'facets'?

2006-09-21 Thread Yonik Seeley
On 9/21/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: Hang in there Michael, a fix is on the way for your scenario (and subscribe to solr-dev if you want to stay on the bleeding edge): OK, the optimization has been checked in. You can checkout from svn and build Solr, or wait for the 9-22 nightl

Re: Re: Default XML Output Schema

2006-09-21 Thread Tim Archambault
This structure was inhibiting to me at first too using Coldfusion. However, I was able to create a function that dynamically creates a query recordset for both facets and search results and will accomodate new/additional fields at any time. If I can do it, any reasonable programmer can handle it.

Fixed first hits -> custom RequestHandler?

2006-09-21 Thread Otis Gospodnetic
Hello, I have a situation where I want certain documents to appear at the top of the hit list for certain searches, regardless of their score. One can think of it as the ads right on top of Google's search results (but I'm not dealing with ads). Example: If I'm searching books in a bookstore,

Re: Reloading solrconfig.xml

2006-09-21 Thread Yonik Seeley
On 9/21/06, Otis Gospodnetic <[EMAIL PROTECTED]> wrote: Thanks, that's actually simpler and it will work for me. Since I'm thinking of only changing mergeFactor and friends on the fly, I suppose I'd only need to modify Master's solrconfig.xml. Is this for testing or something? I could think o

Re: Facet performance with heterogeneous 'facets'?

2006-09-21 Thread Yonik Seeley
On 9/21/06, Michael Imbeault <[EMAIL PROTECTED]> wrote: Btw, Any plans for a facets cache? Maybe a partial one (like caching top terms to implement some other optimizations). My general philosophy on caching in Solr has been to cache things the client can't: elemental things, or *parts* of req

Re: Reloading solrconfig.xml

2006-09-21 Thread Otis Gospodnetic
Thanks, that's actually simpler and it will work for me. Since I'm thinking of only changing mergeFactor and friends on the fly, I suppose I'd only need to modify Master's solrconfig.xml. Otis - Original Message From: Yonik Seeley <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org; Oti

Re: Facet performance with heterogeneous 'facets'?

2006-09-21 Thread Michael Imbeault
Dude, stop being so awesome (and the whole Solr team). Seriously! Every problem / request (MoreLikeThis class, change AND/OR preference programatically, etc) I've submitted to this mailing list has received a quick, more-than-I-ever-expected answer. I'll subscribe to the dev list (been reading

Re: Default XML Output Schema

2006-09-21 Thread sangraal aiken
Thanks for the great explanation Yonik, I passed it on to my collegues for reference... I knew there was a good reason. -Sangraal On 9/21/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 9/21/06, sangraal aiken <[EMAIL PROTECTED]> wrote: > Perhaps a silly questions, but I'm wondering if anyone c

Re: Facet performance with heterogeneous 'facets'?

2006-09-21 Thread Yonik Seeley
On 9/21/06, Michael Imbeault <[EMAIL PROTECTED]> wrote: It turns out that journal_name has 17038 different tokens, which is manageable, but first_author has > 400 000. I don't think this will ever yield good performance, so i might only do journal_name facets. Hang in there Michael, a fix is on

Re: Facet performance with heterogeneous 'facets'?

2006-09-21 Thread Michael Imbeault
Thanks for all the great answers. Quick Question: did you say you are faceting on the first name field seperately from the last name field? ... why? You misunderstood. I'm doing faceting on first author, and last author of the list. Life science papers have authors list, and the first one is u

Re: Reloading solrconfig.xml

2006-09-21 Thread Yonik Seeley
On 9/21/06, Otis Gospodnetic <[EMAIL PROTECTED]> wrote: What's the best way to dynamically change solrconfig.xml and have the changes take effect? Everything would need to be designed for that, and it's currently not. You might be able to reload the config, but all the classes that looked at

Reloading solrconfig.xml

2006-09-21 Thread Otis Gospodnetic
Hi, What's the best way to dynamically change solrconfig.xml and have the changes take effect? It looks like one could just regenerate the file and call SolrConfig.initConfig(String file). Is that the proper/best way to do it? Thanks, Otis

Re: http error

2006-09-21 Thread Jeff McCormick
This error was caused by my machine's hostname being changed by DHCP and it not resolving to localhost! Apparently for JSPs, Jetty requires some kind of hostname resolution, so if it won't resolve, you get a nice HTTP 500 error with this rather vague error message. cheers On Thursday 21 Septemb

Re: wana use CJKAnalyzer

2006-09-21 Thread Yonik Seeley
On 9/21/06, Chris Hostetter <[EMAIL PROTECTED]> wrote: : i just wanna say: no your help,maybe i will give up.thk u again. : : http://www.flickr.com/photos/[EMAIL PROTECTED]/248815068/ : > thk Hoss,Nick Snels,Koji,Mike and everybody who helped me and wanna help : > me.. : > : > i can use so

Re: http error

2006-09-21 Thread Yonik Seeley
On 9/21/06, Jeff McCormick <[EMAIL PROTECTED]> wrote: I'm getting the following error when I try and hit the admin console: HTTP ERROR: 500 dr01142: dr01142 RequestURI=/solr/admin/stats.jsp Powered by Jetty:// has anyone seen this error before? The queries to this server seem to work just f

http error

2006-09-21 Thread Jeff McCormick
I'm getting the following error when I try and hit the admin console: HTTP ERROR: 500 dr01142: dr01142 RequestURI=/solr/admin/stats.jsp Powered by Jetty:// has anyone seen this error before? The queries to this server seem to work just fine, only the admin console is not working. -- Jeff McC

Re: wana use CJKAnalyzer

2006-09-21 Thread Chris Hostetter
: i just wanna say: no your help,maybe i will give up.thk u again. : : http://www.flickr.com/photos/[EMAIL PROTECTED]/248815068/ : > thk Hoss,Nick Snels,Koji,Mike and everybody who helped me and wanna help : > me.. : > : > i can use solr with Chinese Word. I'm sorry, i'm really confused now

Re: relational design in solr?

2006-09-21 Thread Chris Hostetter
While it's certianly possible to "join" the results of multiple indexes, i would do so only when absolutely neccessary -- in my experience the only time i've found that it makes sense, is when one aspect of the data changes extremely rapidly compared to everything else, making complex reindexing a

Extending Solr's Admin functionality

2006-09-21 Thread Otis Gospodnetic
Hello, I may need to add functionality to Solr's admin pages. The functionality that I'm looking to add is the ability to trigger certain indexing functions and monitor their progress. I'm wondering if people have thoughts about the best way to do this. Here are my initial ideas: 1. Add add

Re: Default XML Output Schema

2006-09-21 Thread Yonik Seeley
On 9/21/06, sangraal aiken <[EMAIL PROTECTED]> wrote: Perhaps a silly questions, but I'm wondering if anyone can tell me why solr outputs XML like this: During the initial development of Solr (2004), I remember throwing up both options, and most developers preferred to have a limited number of

Default XML Output Schema

2006-09-21 Thread sangraal aiken
Perhaps a silly questions, but I'm wondering if anyone can tell me why solr outputs XML like this: 201038 31 2006-09-15T21:36:39.000Z rather than like this: 201038 31 2006-09-15T21:36:39.000Z A front-end PHP developer I know is having trouble parsing the default Solr output because of that