Re: Metron MaaS deployment issues

2019-12-10 Thread Hema malini
Hi, I am facing the same issue even after increasing the memory.Can you please help because in the log i could session timeout . Thanks and Regards, Hema On Tue, 10 Dec, 2019, 12:34 AM Hema malini, wrote: > Hi, > > I followed the instructions in the below link - > >

How can i send batch of data to MaaS

2019-12-10 Thread Hema malini
Hi, Is there any way to pass a batch of data to Metron MaaS. We have some models like LSTM, which requires data to be aggregated and passed to model .Can you please suggest whether is it possible. Thanks and Regards, Hema

Issue: reindexing of some events on parsers restart

2019-12-10 Thread Vladimir Mikhailov
Hi We found the unpleasant consequences of each restart of the parsers: each time part of the events are reindexed again. Unfortunately, this was confirmed by several special tests. Perhaps the reason for this is the method used to immediately stop the storm topology using

Seeking comments - Solr and Elasticsearch

2019-12-10 Thread Yerex, Tom
Good afternoon, I’m fishing for some insight and experience, hopefully someone has a strong opinion and is willing to share. We are currently exploring the indexing options available in Metron. From what I can gather Elasticsearch has a great marketing budget and Solr has some large

Re: Issue: reindexing of some events on parsers restart

2019-12-10 Thread Vladimir Mikhailov
Hi Michael I think the problem is not on the REST side, but in the "StormCLIWrapper", which it uses: https://github.com/apache/metron/blob/88f4d2cefe4bbb389732da3b4f5cbcf02b7b949a/metron-interface/metron-rest/src/main/java/org/apache/metron/rest/service/impl/StormCLIWrapper.java#L145 Each of

Re: Issue: reindexing of some events on parsers restart

2019-12-10 Thread Michael Miklavcic
It only does that if the arg stopNow is true. It's always false per the previous snippets I shared. On Tue, Dec 10, 2019, 10:54 PM Vladimir Mikhailov < v.mikhai...@content-media.ru> wrote: > Hi Michael > > I think the problem is not on the REST side, but in the "StormCLIWrapper", > which it

Re: How can i send batch of data to MaaS

2019-12-10 Thread Simon Elliston Ball
If you’re looking to send sequences to an LSTM model, you are probably looking for the profiler, which can assemble sequential features such as those that would go into an LSTM. You would then use the triage output method from the profiler to pass a stream of batches to MaaS. Simon On Tue, 10

Re: How can i send batch of data to MaaS

2019-12-10 Thread Hema malini
Thanks Simon..will explore Metron profiler On Tue, 10 Dec, 2019, 9:00 PM Simon Elliston Ball, < si...@simonellistonball.com> wrote: > If you’re looking to send sequences to an LSTM model, you are probably > looking for the profiler, which can assemble sequential features such as > those that

Re: Issue: reindexing of some events on parsers restart

2019-12-10 Thread Michael Miklavcic
Where are you seeing this? As far as I can tell, the UI and REST endpoints default to a graceful shutdown. https://github.com/apache/metron/blob/master/metron-interface/metron-config/src/app/service/storm.service.ts#L154