[ 
https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12679656#action_12679656
 ] 

Stephen Weiss commented on SOLR-236:
------------------------------------

Thanks.  In the wiki next to each one of these parameters it explicitly says 
that reducing this parameter will decrease memory usage, this is why we reduced 
these parameters (it did not mention the filterCache at all).  

I really do hope the RAM will help.  It certainly can't help.

My filterCache stats are great- you  know it's set to 64K but right now, with 
almost all the RAM used up (we're at 71.9% now), but it's only using 36290 
entries at the moment and it's holding pretty steady there (even as RAM usage 
increased by 10%).  None of the other caches have gone up much either.  We have 
no cache evictions, at all, but a 99% hit ratio.

I'm going to try lowering the filterCache to be just above the number it's at 
now, since that amount seems to be all it needs.  It's possible at crash time 
all the sudden is uses a lot more of it for some reason - I have a feeling it 
might be related to a new permissions group that was added 3 days ago.  That 
might trigger a lot more filters.  It is barely used at all yet except by one 
client - I'm going to go check and see if there's any correspondence between 
when that client logs in and when the problem occurs - I bet there is.

Thanks for all your help guys.

> Field collapsing
> ----------------
>
>                 Key: SOLR-236
>                 URL: https://issues.apache.org/jira/browse/SOLR-236
>             Project: Solr
>          Issue Type: New Feature
>          Components: search
>    Affects Versions: 1.3
>            Reporter: Emmanuel Keller
>             Fix For: 1.5
>
>         Attachments: collapsing-patch-to-1.3.0-dieter.patch, 
> collapsing-patch-to-1.3.0-ivan.patch, collapsing-patch-to-1.3.0-ivan_2.patch, 
> collapsing-patch-to-1.3.0-ivan_3.patch, 
> field-collapsing-extended-592129.patch, field_collapsing_1.1.0.patch, 
> field_collapsing_1.3.patch, field_collapsing_dsteigerwald.diff, 
> field_collapsing_dsteigerwald.diff, field_collapsing_dsteigerwald.diff, 
> SOLR-236-FieldCollapsing.patch, SOLR-236-FieldCollapsing.patch, 
> SOLR-236-FieldCollapsing.patch, solr-236.patch
>
>
> This patch include a new feature called "Field collapsing".
> "Used in order to collapse a group of results with similar value for a given 
> field to a single entry in the result set. Site collapsing is a special case 
> of this, where all results for a given web site is collapsed into one or two 
> entries in the result set, typically with an associated "more documents from 
> this site" link. See also Duplicate detection."
> http://www.fastsearch.com/glossary.aspx?m=48&amid=299
> The implementation add 3 new query parameters (SolrParams):
> "collapse.field" to choose the field used to group results
> "collapse.type" normal (default value) or adjacent
> "collapse.max" to select how many continuous results are allowed before 
> collapsing
> TODO (in progress):
> - More documentation (on source code)
> - Test cases
> Two patches:
> - "field_collapsing.patch" for current development version
> - "field_collapsing_1.1.0.patch" for Solr-1.1.0
> P.S.: Feedback and misspelling correction are welcome ;-)

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to