[
https://issues.apache.org/jira/browse/METRON-701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854566#comment-15854566
]
Nick Allen commented on METRON-701:
-----------------------------------
Thanks. Originally, I was thinking of option 1 differently. I was thinking
that the idea was to execute the "write" Stellar statement in the context of
the existing "builder" bolt. Creating a separate "writer" bolt might improve
option 1.
If my understanding is now correct, the difference between the improved option
1 and option 2 is whether you have (option 1) a generic writer bolt that just
executes a stellar statement or (option 2) you have a dedicated bolt to handle
HBase and another for Kafka.
How would we do something like batching if we have a generic bolt that just
executes Stellar expressions? The Stellar function itself would have to
implement the batching mechanism right?
> Triage Metrics Produced by the Profiler
> ---------------------------------------
>
> Key: METRON-701
> URL: https://issues.apache.org/jira/browse/METRON-701
> Project: Metron
> Issue Type: Improvement
> Reporter: Nick Allen
> Assignee: Nick Allen
>
> h3. Problem
> The motivating example is that I would like to create an alert if the number
> of inbound flows to any host over a 15 minute interval is abnormal.
> The value being interrogated here, the number of inbound flows, is not a
> static value contained within any single telemetry message. This value is
> calculated across multiple messages by the Profiler. The current Threat
> Triage process cannot be used to interrogate values calculated by the
> Profiler.
> h3. Proposed Solution
> I am proposing that we treat the Profiler as a source of telemetry. The
> measurements captured by the Profiler would be enqueued into a Kafka topic.
> We would then treat those Profiler messages like any other telemetry. We
> would parse, enrich, triage, and index those messages.
> This would have the following advantages.
> 1. We would be able to reuse the same threat triage mechanism for values
> calculated by the Profiler.
> 2. We would be able to generate profiles from the profiled data - aka
> meta-profiles anyone?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
