[ 
https://issues.apache.org/jira/browse/LUCENE-8862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16865469#comment-16865469
 ] 

Adrien Grand commented on LUCENE-8862:
--------------------------------------

Memory accounting has a cost API-wise. Like queries, I don't think we should 
change the Collector API to enable memory accounting. The only collectors I 
have in mind that might allocate lots of memory are the ones that are used to 
collect matches in a bitset (there is one for facets and another one in Solr if 
I'm not mistaken, different impl but similar idea). If this proves to be a 
source of memory issues, we can work on solutions that are specific to those, 
similarly to how we only added the Accountable interface to TermInSetQuery?

> Collector Level Dynamic Memory Accounting
> -----------------------------------------
>
>                 Key: LUCENE-8862
>                 URL: https://issues.apache.org/jira/browse/LUCENE-8862
>             Project: Lucene - Core
>          Issue Type: Improvement
>            Reporter: Atri Sharma
>            Priority: Major
>
> Inspired from LUCENE-8855, I am thinking of adding a new interface which 
> tracks dynamic memory used by Collectors. This shall allow users to get an 
> accountability as to the memory usage of their Collectors and better plan 
> their resource capacity. This shall also allow us to add Collector level 
> limits for memory usage, thus allowing users a finer control over their 
> resources.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to