Re: shards and facet_count

[Erik Hatcher]

On Sep 17, 2009, at 6:14 PM, Lance Norskog wrote:
Yes. &facet=false means "don't do any faceting". This is why you don't
get any facet data back. This is probably a bug in the solr-ruby code.
Version number 0.0.x is probably a hint about its production-ready
status :)

Actually solr-ruby is plenty suitable for production use - it's pretty  
straightforward mapping from Rubyish stuff to Solr requests.  Not  
really much magic in there.  It's 0.0.x version number is really my  
own laziness (or swampedness) in getting it polished in a form I'd  
like (I'm a perfectionist with no time on his hands, a frustrating  
existence).  The RSolr API has some features I'd like to pull over  
into solr-ruby and do some refactoring one of these days in my copious  
free time, but in general solr-ruby works fine.

It is strange that you get facet=false calls in there, but maybe this  
is just normal distributed search protocol in one of the phases?

        Erik


On Mon, Sep 14, 2009 at 6:46 AM, Paul Rosen <p...@performantsoftware.com 
> wrote:
Shalin Shekhar Mangar wrote:

On Fri, Sep 11, 2009 at 2:35 AM, Paul Rosen
<p...@performantsoftware.com>wrote:

Hi again,

I've mostly gotten the multicore working except for one detail.

(I'm using solr 1.3 and solr-ruby 0.0.6 in a rails project.)

I've done a few queries and I appear to be able to get hits from  
either
core. (yeah!)

I'm forming my request like this:

req = Solr::Request::Standard.new(
 :start => start,
 :rows => max,
 :sort => sort_param,
 :query => query,
 :filter_queries => filter_queries,
 :field_list => @field_list,
 :facets => {:fields => @facet_fields, :mincount => 1, :missing  
=> true,
:limit => -1},
 :highlighting => {:field_list => ['text'], :fragment_size => 600},
 :shards => @cores)

If I leave ":shards => @cores" out, then the response includes:

'facet_counts' => {
 'facet_dates' => {},
 'facet_queries' => {},
 'facet_fields' => { 'myfacet' => [ etc...], etc... }

which is what I expect.

If I add the ":shards => @cores" back in (so that I'm doing the  
exact
request above), I get:

'facet_counts' => {
 'facet_dates' => {},
 'facet_queries' => {},
 'facet_fields' => {}

so I've lost my facet information.

Why would it correctly find my documents, but not report the  
facet info?


I'm not a ruby guy but the response format in both the cases is  
exactly
the
same so I don't think there is any problem with the ruby client  
parsing.
Can
you check the Solr logs to see if there were any exceptions when  
you sent
the shards parameter?


I don't see any exceptions. The solr activity is pretty different  
for the
two cases. Without the shards, it makes one call that looks  
something like
this (I ellipsed the id and field parameters for clarity):

Sep 14, 2009 9:32:09 AM org.apache.solr.core.SolrCore execute
INFO: [resources] webapp=/solr path=/select
params 
= 
{facet 
.limit 
= 
-1 
&wt 
= 
ruby 
&rows 
= 
30 
&start 
= 
0 
&facet 
= 
true 
&facet 
.mincount 
= 
1 
&q 
= 
(rossetti 
)&fl 
= 
archive 
,...,license 
&qt 
= 
standard 
&facet 
.missing 
= 
true 
&hl 
.fl 
= 
text 
&facet 
.field 
= 
genre 
&facet.field=archive&facet.field=freeculture&hl.fragsize=600&hl=true}
hits=27 status=0 QTime=6

Note that "facet=true".

With the shards, it has five lines for the single call that I make:

Sep 14, 2009 9:37:18 AM org.apache.solr.core.SolrCore execute
INFO: [exhibits] webapp=/solr path=/select
params 
= 
{wt 
= 
javabin 
&rows 
= 
30 
&start 
= 
0 
&facet 
= 
true 
&fl 
= 
uri 
,score 
&q 
= 
(rossetti 
)&version 
= 
2.2 
&isShard 
= 
true 
&facet 
.missing 
= 
true 
&hl 
.fl 
= 
text 
&fsv 
= 
true 
&hl 
.fragsize 
= 
600 
&facet 
.field=genre&facet.field=archive&facet.field=freeculture&hl=false}
hits=6 status=0 QTime=0

Sep 14, 2009 9:37:18 AM org.apache.solr.core.SolrCore execute
INFO: [resources] webapp=/solr path=/select
params 
= 
{wt 
= 
javabin 
&rows 
= 
30 
&start 
= 
0 
&facet 
= 
true 
&fl 
= 
uri 
,score 
&q 
= 
(rossetti 
)&version 
= 
2.2 
&isShard 
= 
true 
&facet 
.missing 
= 
true 
&hl 
.fl 
= 
text 
&fsv 
= 
true 
&hl 
.fragsize 
= 
600 
&facet 
.field=genre&facet.field=archive&facet.field=freeculture&hl=false}
hits=27 status=0 QTime=3

Sep 14, 2009 9:37:18 AM org.apache.solr.core.SolrCore execute
INFO: [resources] webapp=/solr path=/select
params={facet.limit=-1&wt=javabin&rows=30&start=0&ids=...,...&facet=false&facet.mincount=1&q=(rossetti)&fl=archive,...,uri&version=2.2&facet.missing=true&isShard=true&hl.fl=text&facet.field=genre&facet.field=archive&facet.field=freeculture&hl.fragsize=600&hl=true}
status=0 QTime=35

Sep 14, 2009 9:37:18 AM org.apache.solr.core.SolrCore execute
INFO: [exhibits] webapp=/solr path=/select
params={facet.limit=-1&wt=javabin&rows=30&start=0&ids=...,...&facet=false&facet.mincount=1&q=(rossetti)&fl=archive,...,uri&version=2.2&facet.missing=true&isShard=true&hl.fl=text&facet.field=genre&facet.field=archive&facet.field=freeculture&hl.fragsize=600&hl=true}
status=0 QTime=41

Sep 14, 2009 9:37:18 AM org.apache.solr.core.SolrCore execute
INFO: [resources] webapp=/solr path=/select
params={facet.limit=-1&wt=ruby&rows=30&start=0&facet=true&facet.mincount=1&q=(rossetti)&fl=archive,...,license&qt=standard&facet.missing=true&hl.fl=text&facet.field=genre&facet.field=archive&facet.field=freeculture&hl.fragsize=600&hl=true&shards=localhost:8983/solr/resources,localhost:8983/solr/exhibits}
status=0 QTime=57

Note that on the third and fourth lines, "facet=false". Is that  
significant?

Thanks,
Paul





--
Lance Norskog
goks...@gmail.com