[
https://issues.apache.org/jira/browse/METRON-701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15854619#comment-15854619
]
Nick Allen commented on METRON-701:
-----------------------------------
After reflecting on this a bit more, I think the decision points are a little
more granular and independent of one another.
(1) Do we use a single, generic, Stellar-based writer bolt? Or do we use
separate, dedicated bolts for Kafka and HBase (thus no additional Stellar)?
(2) Is writing to Kafka a global on/off switch? Or do we need a per-profile
on/off switch?
(3) Is the destination Kafka topic a global switch or per-profile?
(4) Do we treat the Profile data as just another source of telemetry that goes
through the complete flow; parse, enrich, triage, index? Or do we short
circuit the profile data so that it goes through triage and indexing only?
> Triage Metrics Produced by the Profiler
> ---------------------------------------
>
> Key: METRON-701
> URL: https://issues.apache.org/jira/browse/METRON-701
> Project: Metron
> Issue Type: Improvement
> Reporter: Nick Allen
> Assignee: Nick Allen
>
> h3. Problem
> The motivating example is that I would like to create an alert if the number
> of inbound flows to any host over a 15 minute interval is abnormal.
> The value being interrogated here, the number of inbound flows, is not a
> static value contained within any single telemetry message. This value is
> calculated across multiple messages by the Profiler. The current Threat
> Triage process cannot be used to interrogate values calculated by the
> Profiler.
> h3. Proposed Solution
> I am proposing that we treat the Profiler as a source of telemetry. The
> measurements captured by the Profiler would be enqueued into a Kafka topic.
> We would then treat those Profiler messages like any other telemetry. We
> would parse, enrich, triage, and index those messages.
> This would have the following advantages.
> 1. We would be able to reuse the same threat triage mechanism for values
> calculated by the Profiler.
> 2. We would be able to generate profiles from the profiled data - aka
> meta-profiles anyone?
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
