Re: Solr cloud: Faceting issue on text field

2014-02-28 Thread David Miller
Hi Chris, Thanks for the info. I have looked into the docValues option earlier. But docValues doesn't support textField and we require textField to enable various tokenizer and analyzers (like shingle, pattern filter etc.) We require the faceting to be on terms with in the text field, not as a

Re: Solr cloud: Faceting issue on text field

2014-02-28 Thread David Miller
Hi Chris, The enum option is working for us, with suitable minDf settings. We are able to do faceting with decent speed using this. Thanks a lot, Dave On Fri, Feb 28, 2014 at 9:09 AM, David Miller davthehac...@gmail.comwrote: Hi Chris, Thanks for the info. I have looked into the docValues

Re: Solr cloud: Faceting issue on text field

2014-02-27 Thread David Miller
Hi, The target here is to use the facets to generate tag clouds, whose set can have go upto trigrams. This works fine in dev, but our production is having issues with faceting.. Regards, On Wed, Feb 26, 2014 at 10:00 PM, David Miller davthehac...@gmail.comwrote: Hi Jack, Ya

Solr cloud: Faceting issue on text field

2014-02-26 Thread David Miller
Hi, I am encountering an issue where Solr nodes goes down when trying to obtain facets on a text field. The cluster consists of a few servers and have around 200 million documents (small to medium). I am trying the faceting first time on this field and it gives a 502 Bad Gateway error along with

Re: Solr cloud: Faceting issue on text field

2014-02-26 Thread David Miller
uses copious amounts of memory; have you checked for GC activity while the query is running? Thanks, Greg On Feb 26, 2014, at 1:06 PM, David Miller davthehac...@gmail.com wrote: Hi, I am encountering an issue where Solr nodes goes down when trying to obtain facets on a text field

Re: Solr cloud: Faceting issue on text field

2014-02-26 Thread David Miller
can pipe up to address your questions there. In the mean time have you read http://sbdevel.wordpress.com/2013/04/16/you-are-faceting-itwrong/? On Feb 26, 2014, at 3:26 PM, David Miller davthehac...@gmail.com wrote: Hi Greg, Yes, the memory and cpu spiked for that machine. Another issue I

Re: Solr cloud: Faceting issue on text field

2014-02-26 Thread David Miller
returning? How many unique terms occur in the facet field? -- Jack Krupansky -Original Message- From: David Miller Sent: Wednesday, February 26, 2014 2:06 PM To: solr-user@lucene.apache.org Subject: Solr cloud: Faceting issue on text field Hi, I am encountering an issue where Solr

Re: Tf-Idf for a specific query

2014-02-11 Thread David Miller
Erickson erickerick...@gmail.comwrote: David: If you're, say, faceting on fields with lots of unique values, this will be quite expensive. No idea whether you can tolerate slower queries or not, just sayin' Erick On Fri, Feb 7, 2014 at 5:35 PM, David Miller davthehac...@gmail.com wrote

Re: Tf-Idf for a specific query

2014-02-07 Thread David Miller
://wiki.apache.org/solr/TermsComponent (invert it yourself) then, for certain term you can get number of occurrences per document by http://wiki.apache.org/solr/FunctionQuery#tf On Fri, Feb 7, 2014 at 3:58 AM, David Miller davthehac...@gmail.com wrote: Hi Guys.. I require to obtain Tf-idf score from

Re: Tf-Idf for a specific query

2014-02-07 Thread David Miller
: David, I can imagine that DF for resultset is facets! On Fri, Feb 7, 2014 at 11:26 PM, David Miller davthehac...@gmail.com wrote: Hi Mikhail, The DF seems to be based on the entire document set. What I require is based on a the results of a single query. Suppose my Solr query

Tf-Idf for a specific query

2014-02-06 Thread David Miller
Hi Guys.. I require to obtain Tf-idf score from Solr for a certain set of documents. But the catch is that, I needs the IDF (or DF) to be calculated on the documents returned by the specific query and not the entire corpus. Please provide me some hint on whether Solr has this feature or if I can