I'd like to put up a DISCUSS thread in the next day or so regarding getting
the pcap feature branch merged. In preparation, I am going to share an
accounting of completed and outstanding tasks. Can folks that have
contributed update their Jira status in the subtasks? It looks like the
current
Why do we start over. We are going back and forth on implementation, and I
don’t think we have the same goals or concerns.
What would be the requirements or goals of metron integration with Nifi?
How many levels or options for integration do we have?
What are the approaches to choose from?
Who
So how does the MetronRecordReader roll into everything? It seems like it'd
be more useful on the reader per format approach, but otherwise it doesn't
really seem like we gain much, and it requires getting everything linked up
properly to be used. Assuming we looked at doing it that way, is the
A Metron Processor itself isn’t really necessary. A MetronRecordReader (
either the megalithic or a reader per format ) would be a good approach.
Then have StellarTransformRecord processor that can do Stellar on _any_
record, regardless of source.
On August 7, 2018 at 11:06:22, Justin Leet
Thanks for the comments, Otto, this is definitely great feedback. I'd love
to respond inline, but the email's already starting to lose it's
formatting, so I'll go with the classic "wall of text". Let me know if I
didn't address everything.
Loading modules (or jars or whatever) outside of our
I think this is a good idea. As I mentioned in the other thread I’ve been
doing a lot of work on Nifi recently.
I think the important thing is that what is done should be done the NiFi
way, not bolting the Metron composition
onto Nifi. Think of it like the Tao of Unix, the parsers and components
Hi all,
There's interest in being able to run Metron parsers in NiFi, rather than
inside Storm. I dug into this a bit, and have some thoughts on how we could
go about this. I'd love feedback on this, along with anything we'd
consider must haves as well as future enhancements.
1. Separate
