Re: [DISCUSS] Pcap panel architecture

Sweet! That's great news. The pom changes are a lot simpler than I expected. Very nice. On Tue, May 8, 2018 at 4:35 PM, Ryan Merriman wrote: > Finally figured it out. Commit is here: > https://github.com/merrimanr/incubator-metron/commit/ >

Re: [DISCUSS] Pcap panel architecture

Finally figured it out. Commit is here: https://github.com/merrimanr/incubator-metron/commit/22fe5e9ff3c167b42ebeb7a9f1000753a409aff1 It came down to figuring out the right combination of maven dependencies and passing in the HDP version to REST as a Java system property. I also included some

Re: [DISCUSS] Pcap panel architecture

@Ryan - pulled your branch and experimented with a few things. In doing so, it dawned on me that by adding the yarn and hadoop classpath, you probably didn't introduce a new classpath issue, rather you probably just moved onto the next classpath issue, ie hbase per your exception about hbase jaxb.

Re: [DISCUSS] Pcap panel architecture

That would be a step closer to something more like a micro-service architecture. However, I would want to make sure we think about the operational complexity, and mpack implications of having another server installed and running somewhere on the cluster (also, ssl, kerberos, etc etc requirements

Re: [DISCUSS] Pcap panel architecture

+1 to having metron-api as it's own service and using a gateway type pattern. On Tue, May 8, 2018 at 8:13 AM, Otto Fowler wrote: > Why not have metron-api as it’s own service and use a ‘gateway’ type > pattern in rest? > > > On May 8, 2018 at 08:45:33, Ryan Merriman

Re: [DISCUSS] Pcap panel architecture

Why not have metron-api as it’s own service and use a ‘gateway’ type pattern in rest? On May 8, 2018 at 08:45:33, Ryan Merriman (merrim...@gmail.com) wrote: Moving the yarn classpath command earlier in the classpath now gives this error: Caused by: java.lang.NoSuchMethodError:

Re: Streaming Machine Learning use case

Do you mean Apache SAMOA? I'm not sure of the status of that project, and it doesn't look particularly lively (last real activity on the lists was 2 months ago, last commits, 7 months ago). That said, there seem to be some interesting algorithms implemented in there. The VHT algorithm and the

Re: [DISCUSS] Pcap panel architecture

Moving the yarn classpath command earlier in the classpath now gives this error: Caused by: java.lang.NoSuchMethodError: javax.servlet.ServletContext.getVirtualServerName()Ljava/lang/String; I will experiment with other combinations, I suspect we will need finer-grain control over the order.

Streaming Machine Learning use case

Hi all, I was wondering if someone has used Metron with any streaming ML framework such as SAMOA? I know that Metron provides Machine Learning separately via MAAS. However, it is hard to manage it from operational perspective especially if we want to have a pretty dynamic and evolving model.