[
https://issues.apache.org/jira/browse/NIFI-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16550811#comment-16550811
]
ASF GitHub Bot commented on NIFI-5327:
--------------------------------------
Github user bbende commented on the issue:
https://github.com/apache/nifi/pull/2820
I haven't looked at any of the code so keep that in mind :)
If we are talking about NiFi templates, then they are just examples of how
to use a processor or set of processors, which you can then give to someone to
help them get started. We have a wiki page where people have posted some for
the community:
https://cwiki.apache.org/confluence/display/NIFI/Example+Dataflow+Templates
I think the recent work @ottobackwards did with the syslog record readers
is a good example of what we can do for this case. Meaning later on we can
implement a NetflowV5RecordReader, which then lets you use stuff like
ConvertRecord to go from netflow to any format like JSON, CSV, Avro.
For now, if this processor always produces JSON, then documenting the
expected output format in additionalDetails.html seems sufficient to me.
I don't really know enough about what people do with netflow data to know
if keeping the raw message with the parsed one makes sense. I would say
typically we wouldn't keep the raw message with the parsed one, but you could
always have an option to control that if you thought it was necessary. The
processor can also have an original relationship as Otto suggested, although at
that point the original and parsed data are completely separate.
> NetFlow Processors
> ------------------
>
> Key: NIFI-5327
> URL: https://issues.apache.org/jira/browse/NIFI-5327
> Project: Apache NiFi
> Issue Type: New Feature
> Components: Core Framework
> Affects Versions: 1.6.0
> Reporter: Prashanth Venkatesan
> Assignee: Prashanth Venkatesan
> Priority: Major
>
> As network traffic data scopes for the big data use case, would like NiFi to
> have processors to support parsing of those protocols.
> Netflow is a protocol introduced by Cisco that provides the ability to
> collect IP network traffic as it enters or exits an interface and is
> described in detail in here:
> [https://www.cisco.com/c/en/us/td/docs/net_mgmt/netflow_collection_engine/3-6/user/guide/format.html]
>
> Currently, I have created the following processor:
> *ParseNetflowv5*: Parses the ingress netflowv5 bytes and ingest as either
> NiFi flowfile attributes or as a JSON content. This also sends
> one-time-template.
>
> Further ahead, we can add many processor specific to network protocols in
> this nar bundle.
> I will create a pull request.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
