Github user cestella commented on the issue:
https://github.com/apache/incubator-metron/pull/449
Well, let me try to make the case that this is user-focused while being
aware of the limitations of implementation. ;)
The main aim for adaptability is to allow multiple representations to be
stored in multiple datastores. The representation has a 1 to n relationship
with the data store, (maybe "writer" can be a list of writers or a single
writer?). This puts the top-level citizen as the representation associated
with a naming about what it is intended to be used for. Put simply, it's not
that kafka can only handle JSON blobs, but rather it's that we need the
kurtosis for the `kurtosis_triage` rule (by the way, `kurtosis_triage` should
be part of the message constructed along with the `source.type` of
`profiler`...maybe `profile.type`).
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
