Casey Stella created METRON-579:
-----------------------------------
Summary: Add a LRU cache to the Profiler client
Key: METRON-579
URL: https://issues.apache.org/jira/browse/METRON-579
Project: Metron
Issue Type: Improvement
Reporter: Casey Stella
The traditional approach that we have taken to cache based on input into the
stellar functions (i.e. we inspect the variables and if we have the result of
the stellar expressions in the cache based on the inputs, we return the cached
output rather than recomputing).
This does not work in situations like the profiler where the input is implicit
(i.e. the current time). For instance, when we do a PROFILE_GET which is
intended to look back for a fixed window, we will make that HBase call every
single time, despite if the message directly before made the exact same calls.
We could save a network hop by adding a LRU cache based on hbase key in the
profiler client which would trim down or remove the HBase multiget.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)