Casey Stella created METRON-579:
-----------------------------------

             Summary: Add a LRU cache to the Profiler client
                 Key: METRON-579
                 URL: https://issues.apache.org/jira/browse/METRON-579
             Project: Metron
          Issue Type: Improvement
            Reporter: Casey Stella


The traditional approach that we have taken to cache based on input into the 
stellar functions (i.e. we inspect the variables and if we have the result of 
the stellar expressions in the cache based on the inputs, we return the cached 
output rather than recomputing).

This does not work in situations like the profiler where the input is implicit 
(i.e. the current time).  For instance, when we do a PROFILE_GET which is 
intended to look back for a fixed window, we will make that HBase call every 
single time, despite if the message directly before made the exact same calls.

We could save a network hop by adding a LRU cache based on hbase key in the 
profiler client which would trim down or remove the HBase multiget.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to