Re: Faceted Search Slows Down as index gets larger

2010-06-06 Thread Yonik Seeley
On Sun, Jun 6, 2010 at 7:38 AM, Furkan Kuru wrote: > facet.limit = default value 100 > facet.minCount is 1 > > The document count that matches the query is 8-10K in average. I did not > calculate the terms (maybe using using facet.limit=-1 and facet.minCount=1) > > My index entirely fits into memo

Re: Faceted Search Slows Down as index gets larger

2010-06-06 Thread Furkan Kuru
eturning the facet > counts of all 1M of facet terms, or did you limit the number of facet terms > returned to a small number? > > Also did your entire index fit within RAM? > > > --- On Sat, 6/5/10, Furkan Kuru wrote: > > > From: Furkan Kuru > > Subject: Re: F

Re: Faceted Search Slows Down as index gets larger

2010-06-05 Thread Andy
all 1M of facet terms, or did you limit the number of facet terms returned to a small number? Also did your entire index fit within RAM? --- On Sat, 6/5/10, Furkan Kuru wrote: > From: Furkan Kuru > Subject: Re: Faceted Search Slows Down as index gets larger > To: solr-user@lucene.a

Re: Faceted Search Slows Down as index gets larger

2010-06-05 Thread Furkan Kuru
The documents full-text fields are 140 chars length (tweets). Actually I had looked at those parameters and thought no change was neccessary because the terms per document would be few and the unique term count was nearly 1 M. I don't know exactly but average term count per document text can be 10

Re: Faceted Search Slows Down as index gets larger

2010-06-04 Thread Yonik Seeley
On Fri, Jun 4, 2010 at 7:33 PM, Andy wrote: > Yonik, > > Just curious why does using enum improve the facet performance. > > Furkan was faceting on a text field with each word being a facet value. I'd > imagine that'd mean there's a large number of facet values. According to the > documentation

Re: Faceted Search Slows Down as index gets larger

2010-06-04 Thread Andy
FacetParameters#facet.method) facet.method=fc is faster when a field has many unique terms. So how come enum, not fc, is faster in this case? Also why use filterCache less? Thanks Andy --- On Fri, 6/4/10, Furkan Kuru wrote: > From: Furkan Kuru > Subject: Re: Faceted Search Slows Down as i

Re: Faceted Search Slows Down as index gets larger

2010-06-04 Thread Furkan Kuru
t; > > As the number of total indexed documents gets larger (now 5 M) > > > > a faceted search on a text field limited by the creation time, which we > use > > to find the most used word in all these text fields, gets slow down. > > > > > > query string: cr

Re: Faceted Search Slows Down as index gets larger

2010-06-04 Thread Yonik Seeley
t; Hello, > > I have been dealing with real-time data. > > As the number of total indexed documents gets larger (now 5 M) > > a faceted search on a text field limited by the creation time, which we use > to find the most used word in all these text fields, gets slow down. > >

Faceted Search Slows Down as index gets larger

2010-06-04 Thread Furkan Kuru
Hello, I have been dealing with real-time data. As the number of total indexed documents gets larger (now 5 M) a faceted search on a text field limited by the creation time, which we use to find the most used word in all these text fields, gets slow down. query string: created_time:[NOW-1HOUR

Re: Faceted search not working? (RESOLVED)

2010-05-25 Thread Ilya Sterin
Ah, the issue was explicitly specifying components... query I don't remember changing this during default install, commenting this out enabled faceted search component. Thanks all for the help. Ilya On Tue, May 25, 2010 at 10:38 AM, Sascha Szott wrote: > Hi, > > please

Re: Faceted search not working?

2010-05-25 Thread Ilya Sterin
ya Sterin wrote: >> >> I'm trying to perform a faceted search without any luck.  Result set >> doesn't return any facet information... >> >> http://localhost:8080/solr/select/?q=title:*&facet=on&facet.field=title >> >> I'm getting th

Re: Faceted search not working?

2010-05-25 Thread Sascha Szott
t wrote: Hi Birger, Birger Lie wrote: I don't think the bolean fields is mapped to "on" and "off" :) You can use true and on interchangeably. -Sascha -birger -Original Message- From: Ilya Sterin [mailto:ster...@gmail.com] Sent: 24. mai 2010 23:11 To: solr-u

Re: Faceted search not working?

2010-05-25 Thread Jean-Sebastien Vachon
e true and on interchangeably. > > -Sascha > >> >> >> -birger >> >> -Original Message- >> From: Ilya Sterin [mailto:ster...@gmail.com] >> Sent: 24. mai 2010 23:11 >> To: solr-user@lucene.apache.org >> Subject: Faceted search not working

Re: Faceted search not working?

2010-05-25 Thread Sascha Szott
lucene.apache.org Subject: Faceted search not working? I'm trying to perform a faceted search without any luck. Result set doesn't return any facet information... http://localhost:8080/solr/select/?q=title:*&facet=on&facet.field=title I'm getting the result set, but no fac

RE: Faceted search not working?

2010-05-24 Thread Birger Lie
1 To: solr-user@lucene.apache.org Subject: Faceted search not working? I'm trying to perform a faceted search without any luck. Result set doesn't return any facet information... http://localhost:8080/solr/select/?q=title:*&facet=on&facet.field=title I'm getting the result se

Re: Faceted search not working?

2010-05-24 Thread Erik Hatcher
it's probably because your query isn't matching anything. try q=title: [* TO *], or maybe even simply *:* if you are trying to match all documents. Erik On May 24, 2010, at 5:11 PM, Ilya Sterin wrote: I'm trying to perform a faceted search without any luck. Res

Re: Faceted search not working?

2010-05-24 Thread Sascha Szott
Hi Ilya, Ilya Sterin wrote: I'm trying to perform a faceted search without any luck. Result set doesn't return any facet information... http://localhost:8080/solr/select/?q=title:*&facet=on&facet.field=title I'm getting the result set, but no face information prese

Faceted search not working?

2010-05-24 Thread Ilya Sterin
I'm trying to perform a faceted search without any luck. Result set doesn't return any facet information... http://localhost:8080/solr/select/?q=title:*&facet=on&facet.field=title I'm getting the result set, but no face information present? Is there something else that

getting documents sorted after a faceted search

2010-05-24 Thread Furkan Kuru
I apply a faceted search and get document ids from the facet_field I have used. Then I search for these documents given ids. id:(id1 id2 ...) But the order is not predictable. (It applies OR) I do not want to sort documents again. Is there any way to get documents in the given id order

Re: 2 indexes - 1 Faceted search

2010-03-10 Thread Erick Erickson
Not really SOLR doesn't have a way to implement this kind of thing. You'd have to do some sort of post-processing of the results I think. HTH Erick 2010/3/10 André Maldonado > Hi all. > > I have 2 indexes with different structures, but a few equal fields. There > is so

2 indexes - 1 Faceted search

2010-03-10 Thread André Maldonado
Hi all. I have 2 indexes with different structures, but a few equal fields. There is some way to do a faceted search (faceting the equal fields) in the 2 indexes at same time, with only one response (like a UNION in sql server)? Thank's "Então aproximaram-se os que estavam no barco,

Re: Faceted search in 2 indexes

2010-03-05 Thread Kranti™ K K Parisa
and some distinct fields. I need > to make a faceted search that returns the union of the same search in these > 2 indexes. > > How can I make it? > > Thank's > > "Então aproximaram-se os que estavam no barco, e adoraram-no, dizendo: És > verdadeiramente o Filho de Deus." (Mateus 14:33) >

Re: Faceted search in 2 indexes

2010-03-04 Thread Chris Hostetter
: I have 2 indexes with some similar fields and some distinct fields. I need : to make a faceted search that returns the union of the same search in these : 2 indexes. : : How can I make it? Assuming you don't need facets or sorting on the fields that are distinct between the two in

Faceted search in 2 indexes

2010-02-23 Thread André Maldonado
Hi all. I have 2 indexes with some similar fields and some distinct fields. I need to make a faceted search that returns the union of the same search in these 2 indexes. How can I make it? Thank's "Então aproximaram-se os que estavam no barco, e adoraram-no, dizendo: És verdadeiramen

Re: Beyond Basic Faceted Search (SOLR-236|SOLR-64|SOLR-792)

2010-01-25 Thread David MARTIN
27;m > wondering if I should focus more on a tree view of my catalog data instead, > as described in "Beyond Basic Faceted Search" > > Is it possible that either or both of the patches for SOLR-792 or SOLR-64 > provide something like this? Below is a link to the paper, fol

Beyond Basic Faceted Search (SOLR-236|SOLR-64|SOLR-792)

2010-01-21 Thread Kelly Taylor
I'm currently using the latest SOLR-236 patch (12/24/2009) and field-collapsing seems to be giving me the desired results, but I'm wondering if I should focus more on a tree view of my catalog data instead, as described in "Beyond Basic Faceted Search" Is it possible that e

Re: solr severe error when doing a faceted search

2009-10-09 Thread Paul Rosen
Thank you Yonik, that worked (I added :method => :enum to the :facets hash). And it seems to work really fast, too. Yonik Seeley wrote: Hi Paul, The new faceting method is faster in the general case, but doesn't work well for faceting full text fields (which tends not to work well regardless

Re: solr severe error when doing a faceted search

2009-10-09 Thread Yonik Seeley
Hi Paul, The new faceting method is faster in the general case, but doesn't work well for faceting full text fields (which tends not to work well regardless of the method). You can get the old behavior bt adding either of the parameters "facet.method=enum" or "f.content.facet.method=enum" We'll

solr severe error when doing a faceted search

2009-10-09 Thread Paul Rosen
(using solr 1.4 nightly; solr-ruby 0.0.7) I am attempting to do an auto-complete with the following statement: req = Solr::Request::Standard.new( :start => 0, :rows => 0, :shards => [ 'resources', 'exhibits'], :query => "*:*", :filter_queries => [ ], :facets => {:fields => [ "content" ], :min

Re: Faceted Search on Dynamic Fields?

2009-09-25 Thread Yonik Seeley
On Fri, Sep 25, 2009 at 12:19 PM, Avlesh Singh wrote: > Faceting, as of now, can only be done of definitive field names. To further clarify, the fields you can facet on can include those defined by dynamic fields. You just must specify the exact field name when you facet. Did you reall

Re: Faceted Search on Dynamic Fields?

2009-09-25 Thread Avlesh Singh
/document/787cc8cc9ea095e6/item_facet Cheers Avlesh On Fri, Sep 25, 2009 at 7:47 PM, danben wrote: > > Also, here is the field definition in the schema > > indexed="true" stored="true" multiValued="true"/> > > > -- > View this mess

Re: Faceted Search on Dynamic Fields?

2009-09-25 Thread danben
Also, here is the field definition in the schema -- View this message in context: http://www.nabble.com/Faceted-Search-on-Dynamic-Fields--tp25612887p25612936.html Sent from the Solr - User mailing list archive at Nabble.com.

Faceted Search on Dynamic Fields?

2009-09-25 Thread danben
eted queries are not permitted on dynamic facet fields, and if so, is there any workaround? -- View this message in context: http://www.nabble.com/Faceted-Search-on-Dynamic-Fields--tp25612887p25612887.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: faceted search cache and optimisations

2009-08-03 Thread Yonik Seeley
On Mon, Aug 3, 2009 at 4:45 AM, Nicolae Mihalache wrote: > Hello, > > I'm using faceted search (perhaps in a dumb way) to collect some statistics > for my index. I have documents in various languages, one of the field is > "language" and I simply want to see how

faceted search cache and optimisations

2009-08-03 Thread Nicolae Mihalache
Hello, I'm using faceted search (perhaps in a dumb way) to collect some statistics for my index. I have documents in various languages, one of the field is "language" and I simply want to see how many documents I have for each language. I have noticed that the search builds a in

Re: Metada document for faceted search

2009-07-09 Thread Osman İZBAT
Thank you Chris. I've find out how to implement my faceted search. I don't index any metadata document but i create my in-memory faceting data structure from database at my request handlers init method. Compute facet count on any request and wrrite to response as NamedList of

Re: Metada document for faceted search

2009-07-09 Thread Chris Hostetter
: : I'm trying to implement custom faceted search like CNET's : approach.<http://www.mail-archive.com/java-u...@lucene.apache.org/msg02646.html> : . : But i couldn't figure out how to structure and index category metadata : document. The short answer: "however you w

Metada document for faceted search

2009-07-02 Thread Osman İZBAT
Hi. I'm trying to implement custom faceted search like CNET's approach.<http://www.mail-archive.com/java-u...@lucene.apache.org/msg02646.html> . But i couldn't figure out how to structure and index category metadata document. Thanks. -- Osman İZBAT

Sol Lederman's Review of "Faceted Search"

2009-05-15 Thread Andre Hagenbruch
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi all, Sol Lederman has written a Review <http://federatedsearchblog.com/2009/05/14/review-faceted-search/> of the almost finished manuscript of Daniel Tunkelang's "Faceted Search" which is set to be published in June. As the te

Re: Faceted Search

2009-04-17 Thread Alejandro Gonzalez
koon wrote: > Hi all, > > Can someone of you tell me how to implement a faceted search? > > > > Thanks, > > Regards, > > Sajith Vimukthi Weerakoon. > > > >

Faceted Search

2009-04-16 Thread Sajith Weerakoon
Hi all, Can someone of you tell me how to implement a faceted search? Thanks, Regards, Sajith Vimukthi Weerakoon.

Re: faceted search returning multiple values for same field

2009-01-13 Thread Otis Gospodnetic
ge > From: "Deo, Shantanu" > To: solr-user@lucene.apache.org > Sent: Tuesday, January 13, 2009 10:15:09 PM > Subject: faceted search returning multiple values for same field > > Hi, > I am using solr for indexing some product data, and wanted to use the

Re: faceted search returning multiple values for same field

2009-01-13 Thread Shalin Shekhar Mangar
On Wed, Jan 14, 2009 at 8:45 AM, Deo, Shantanu wrote: > > I have tried playing around with defining the fieldtype using the > following analyzers: > positionIncrementGap="100" > > > > > > words="manufacturer.txt"/> > > > > > Any ideas if its possible to get the same facets a

faceted search returning multiple values for same field

2009-01-13 Thread Deo, Shantanu
Hi, I am using solr for indexing some product data, and wanted to use the faceted search. My indexed field (mfg) sometimes contains two words "sony erricson" for example. When I get the facets on the mfg, SOLR return "sony" and "erricson" as separate hits. There are

RE: Faceted Search!

2007-06-21 Thread Chris Hostetter
: generating XML feed file and feeding to the Solr server. However, I was : also looking into implementing having sub-categories within the : categories if that make sense. For example, in the shopper.com we have : the categories of by price, manufactures and so on and with in them,they : are su

RE: Faceted Search!

2007-06-20 Thread niraj tulachan
e -Original Message- From: Chris Hostetter [mailto:[EMAIL PROTECTED] Sent: Wednesday, June 20, 2007 4:24 PM To: solr-user@lucene.apache.org Subject: Re: Faceted Search! : define the sub-categories. let's say from the above example, the : category "price" has different sub-cate

RE: Faceted Search!

2007-06-20 Thread Mike Austin
Niraj: What environment are you using? SQL Server/.NET/Windows? or something else? -Mike -Original Message- From: Chris Hostetter [mailto:[EMAIL PROTECTED] Sent: Wednesday, June 20, 2007 4:24 PM To: solr-user@lucene.apache.org Subject: Re: Faceted Search! : define the sub-categories

Re: Faceted Search!

2007-06-20 Thread Chris Hostetter
: define the sub-categories. let's say from the above example, the : category "price" has different sub-categories like "less than 100" : ,"100-200"? I'm guessing, we explicit define this in XML feed file, but : I could be very wrong. In any case, can you please give me the short : example achi

Re: Faceted Search!

2007-06-20 Thread niraj tulachan
Hi Chris, thank you for the reply. I was reading other posting regarding faceted search and seems like they are using the filtering capability of Lucene for that. If that the case, can we have control over the "label" of categories? For example: in shopper.com when we search

Re: Faceted Search!

2007-06-20 Thread Chris Hostetter
: Thanks Chris for replying my question. So I'm thinking about using a : CMS and when somebody publishes a page in CMS, I would generated this : well structure XML file and feed that xml to Solr to generate the index : on those data. Then, I can simply do faceted search using the co

Re: Faceted Search!

2007-06-19 Thread niraj tulachan
Thanks Chris for replying my question. So I'm thinking about using a CMS and when somebody publishes a page in CMS, I would generated this well structure XML file and feed that xml to Solr to generate the index on those data. Then, I can simply do faceted search using the correct Lucene

Re: Faceted Search!

2007-06-19 Thread Chris Hostetter
one of you have : implemented, can you please give me suggestion or code snippets so that : I can implemented them to achieve the "faceted search". Any help would : be appericated. I'm not very familiar with the Nutch/Solr hybrid stuff some people have done, but faceting requires that y

Faceted Search!

2007-06-18 Thread niraj tulachan
Hi all, I'm couple of days old with Solr so I'm very new to this. However, I'm trying to implemented Faceted search somewhat close to CNET shopper.com. Instead of using some items (like "camera"), I want to search for documents. I'm planning to use Nutch to c

Re: Faceted search glitch???

2007-02-10 Thread Chris Hostetter
: It sure could, but I was just trying to stretch my imagination as far : as possible. filter.term also seems to me like only a marginal : improvement over lucene syntax. the only reason i suggested filter.term at all was because it eliminates hte need to worry baout quoting/escaping when dealin

Re: Faceted search glitch???

2007-02-10 Thread Mike Klaas
On 2/10/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: : As for future expansion, some possibilities are: filter.op/filter.q.op : (set operator of filter query parser, which is currently OR regardless I'm not sure why/how thta would ever make sense... you'd be much better off using seperate fil

Re: Faceted search glitch???

2007-02-10 Thread Chris Hostetter
: > > filter.query : > > filter.term : > > filter. : I like self-documenting parameter names, but if there is concern about : verbosity, how 'bout: : : fq : fq.term no it's cool ... filter.query and filter.term are definitely better. : As for future expansion, some possibilities are: filter.op/f

Re: Faceted search glitch???

2007-02-10 Thread Mike Klaas
On 2/9/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: On Feb 9, 2007, at 9:16 PM, Mike Klaas wrote: > Might I suggest: > > filter.query > filter.term > filter. I like it. While Hoss has a point, though descriptive names do make a lot of sense too. It has been a bit confusing to explain facet.que

Re: Faceted search glitch???

2007-02-09 Thread Erik Hatcher
On Feb 9, 2007, at 9:16 PM, Mike Klaas wrote: Might I suggest: filter.query filter.term filter. I like it. While Hoss has a point, though descriptive names do make a lot of sense too. It has been a bit confusing to explain facet.query and fq as two different things. However, is there a

Re: Faceted search glitch???

2007-02-09 Thread Chris Hostetter
: filter.query : filter.term : filter. there's a whole lot of Unicode letters availble thta could fill in the f_ blank, how much more expansion do we really need? :) I suppose filter.term is a wise choice, and adding filter.query as an alias makes sense too ... i'm just a big fan of short param

Re: Faceted search glitch???

2007-02-09 Thread Mike Klaas
Might I suggest: filter.query filter.term filter. -Mike On 2/9/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: ft and fq work for me! Erik On Feb 9, 2007, at 5:35 PM, Yonik Seeley wrote: > On 2/9/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: >> : The simplest form would be a term quer

Re: Faceted search glitch???

2007-02-09 Thread Erik Hatcher
ft and fq work for me! Erik On Feb 9, 2007, at 5:35 PM, Yonik Seeley wrote: On 2/9/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: : The simplest form would be a term query with no escaping whatsoever: : : Something like: : fq=High School I know yonik isn't a big fan of query param

Re: Faceted search glitch???

2007-02-09 Thread Yonik Seeley
On 2/9/07, Chris Hostetter <[EMAIL PROTECTED]> wrote: : The simplest form would be a term query with no escaping whatsoever: : : Something like: : fq=High School I know yonik isn't a big fan of query param proliferation, and there's definitely going to be a need for some kind of markup in the fu

Re: Faceted search glitch???

2007-02-09 Thread Chris Hostetter
: The simplest form would be a term query with no escaping whatsoever: : : Something like: : fq=High School I know yonik isn't a big fan of query param proliferation, and there's definitely going to be a need for some kind of markup in the future to denote which query syntax to use for different

Re: Faceted search glitch???

2007-02-09 Thread Erik Hatcher
On Feb 9, 2007, at 4:45 PM, Yonik Seeley wrote: On 2/9/07, Gunther, Andrew <[EMAIL PROTECTED]> wrote: Try surrounding you mutli-word query in quotes: education_facet:"High School". Also do you want to use the filter query param instead fq=education_facet:"High School" Hopefully having the cl

Re: Faceted search glitch???

2007-02-09 Thread Yonik Seeley
On 2/9/07, Gunther, Andrew <[EMAIL PROTECTED]> wrote: Try surrounding you mutli-word query in quotes: education_facet:"High School". Also do you want to use the filter query param instead fq=education_facet:"High School" Hopefully having the client escape simple term filters won't be necessary

Re: Faceted search glitch???

2007-02-09 Thread Peter McPeterson
Awesome, thanks that works. From: "Yonik Seeley" <[EMAIL PROTECTED]> Reply-To: solr-user@lucene.apache.org To: solr-user@lucene.apache.org Subject: Re: Faceted search glitch??? Date: Fri, 9 Feb 2007 16:28:05 -0500 On 2/9/07, Peter McPeterson <[EMAIL PROTECTED]> wrote: O

RE: Faceted search glitch???

2007-02-09 Thread Gunther, Andrew
09, 2007 4:22 PM To: solr-user@lucene.apache.org Subject: Faceted search glitch??? On Solr, I'm indexing a facet field which contains different values on each record (of course) but it doesn't seem to be working the way I had expected. For instance: When looking for: http://localhost:8

Re: Faceted search glitch???

2007-02-09 Thread Yonik Seeley
On 2/9/07, Peter McPeterson <[EMAIL PROTECTED]> wrote: On Solr, I'm indexing a facet field which contains different values on each record (of course) but it doesn't seem to be working the way I had expected. For instance: When looking for: http://localhost:8983/solr/select/?q=sales&facet=true&fa

Faceted search glitch???

2007-02-09 Thread Peter McPeterson
On Solr, I'm indexing a facet field which contains different values on each record (of course) but it doesn't seem to be working the way I had expected. For instance: When looking for: http://localhost:8983/solr/select/?q=sales&facet=true&facet.field=education_facet it returns the facet: 'educ

Re: Faceted search problem

2007-01-16 Thread Erik Hatcher
On Jan 16, 2007, at 10:05 PM, Peter McPeterson wrote: Hi all, I'm trying this solr ruby DSL called Flare/solrb and I don't really know how the faceted search works because I cant add whatever fields I want to to the index. This is currently not working: conn = Solr::Connection

Faceted search problem

2007-01-16 Thread Peter McPeterson
Hi all, I'm trying this solr ruby DSL called Flare/solrb and I don't really know how the faceted search works because I cant add whatever fields I want to to the index. This is currently not working: conn = Solr::Connection.new('http://localhost:8983/solr') doc = {:id =>

Re: Faceted search/browse

2006-12-29 Thread Erik Hatcher
On Dec 28, 2006, at 10:18 PM, Giri wrote: Do you have any simple tutorial that explains how to enable the faceted search in solr? I wouold appreciate if you point me to some resource. The wiki is the best source of information on Solr. For facets, look here: <h

Re: Faceted search/browse

2006-12-28 Thread Giri
Hi Yonik, Thanks for the information and suggestion. Do you have any simple tutorial that explains how to enable the faceted search in solr? I wouold appreciate if you point me to some resource. Thanks much On 12/28/06, Yonik Seeley <[EMAIL PROTECTED]> wrote: On 12/27/06, Giri &

Re: Faceted search/browse

2006-12-28 Thread Yonik Seeley
r this contains more than one value per record (e.g., java, programming, object oriented), is it possible to include this field on the faceted search? or this metaKeyword needs to have only unique value per record to use a faceted? Yes, multivalued fields are supported with faceted search, but the sp

Faceted search/browse

2006-12-27 Thread Giri
., java, programming, object oriented), is it possible to include this field on the faceted search? or this metaKeyword needs to have only unique value per record to use a faceted? Any help in this regard is appreciated Thanks! Giri

<    1   2