[ 
https://issues.apache.org/jira/browse/ACCUMULO-3033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980724#comment-14980724
 ] 

Christopher Tubbs commented on ACCUMULO-3033:
---------------------------------------------

This seemed familiar, so I looked up and found ACCUMULO-2838. I don't know if 
it's similar enough to model a fix here after that.

> SiteConfiguration gets invoked frequently and scans all configuration items
> ---------------------------------------------------------------------------
>
>                 Key: ACCUMULO-3033
>                 URL: https://issues.apache.org/jira/browse/ACCUMULO-3033
>             Project: Accumulo
>          Issue Type: Improvement
>    Affects Versions: 1.5.0, 1.5.1, 1.6.0
>            Reporter: Josh Elser
>            Assignee: Josh Elser
>             Fix For: 1.8.0
>
>
> I noticed yesterday that {{SiteConfiguration#getProperties(Map, 
> PropertyFilter)}} is invoked very frequently (at least 30 times a second on 
> my single machine) to extract the Iterator configurations before a table scan 
> happens. Printing a stack trace shows that this is the dominating caller of 
> {{getProperties}} is {{IteratorUtil#parseIterConf()}}.
> What this translates to is repeatedly reading, filtering and adding the same 
> elements to a map to satisfy the 
> {{AccumuloConfiguration#getPropertiesWithPrefix}} from an immutable source 
> (accumulo-site.xml). While this is probably not a huge time waste in terms of 
> actual time spent, it's repeatedly happening and will slow things down 
> (especially when the underlying Hadoop Configuration is creating a new 
> HashMap with the contents of the accumulo-site.xml for every call).
> Need to think about some options for making the "extract keys with this 
> prefix" case faster from SiteConfiguration.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to