[
https://issues.apache.org/jira/browse/METRON-562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15658037#comment-15658037
]
ASF GitHub Bot commented on METRON-562:
---------------------------------------
Github user nickwallen commented on a diff in the pull request:
https://github.com/apache/incubator-metron/pull/352#discussion_r87650462
--- Diff:
metron-analytics/metron-profiler/src/main/java/org/apache/metron/profiler/bolt/ProfileBuilderBolt.java
---
@@ -246,6 +247,8 @@ private void flush(Tuple tickTuple) {
// clear the execution state to prepare for the next window
executor.clearState();
+ profileConfig.getTickUpdate().forEach((var, expr) ->
executor.assign(var, expr, new HashMap<>()));
--- End diff --
At this point in execution, during a flush operation, we don't have a
telemetry message. It is the tick tuple that drives the flush. We won't have
a telemetry message to offer to the 'tick' expressions.
With how you have it now, the 'tick' expressions will be able to reference
all of the state being maintained by the 'init' and 'update' expressions.
The one missing piece that I can think of is that the 'tick' expressions
cannot access the result of the 'result' expression. It might be useful to
offer that up to the 'tick' expressions.
> Add rudimentary statistical outlier detection
> ---------------------------------------------
>
> Key: METRON-562
> URL: https://issues.apache.org/jira/browse/METRON-562
> Project: Metron
> Issue Type: New Feature
> Reporter: Casey Stella
> Assignee: Casey Stella
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> With the advent of the profiler, we can now capture state. Furthermore, with
> Stellar, we can capture statistical summaries. We should provide rudimentary
> outlier detection functionality in the form of Stellar functions that can
> operate on captured state from the profiler.
> To begin, we should enable simple outlier tests using distance from a central
> measure such as Median Absolute Deviation (see
> http://www.itl.nist.gov/div898/handbook/eda/section3/eda35h.htm).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
