Metron Enrichment Error

Hi, I've built Metron and installed alongside the current Ambari version with HDP-3.1 support provided by the GitHub project (https://github.com/apache/metron/tree/feature/METRON-2088-support-hdp-3.1). I've followed the documentation and installed everything with success. Altough when i'm

Re: Metron Enrichment Error

Resolved. Deleted Metron service and added the service again but this time I configured REST by configuring the JDBC with mysql. On 2019/11/06 10:49:50, Gonçalo Pedras mailto:g...@ctd.pt>> wrote: > Hi,> > I've built Metron and installed alongside the current Ambari version

RE: Score not being issued by ThreatIntel Enrichment

Hi, It works. Thanks for the help. Really appreciated. Thanks

Score not being issued by ThreatIntel Enrichment

Hi, I've deployed Metron alongside the current Ambari version using the Metron HDP3.1 support provided by a branch in the GitHub project. Fast forward, I'm testing Metron: 1. I've deployed a custom CSV parser with 3 fields ( 2 dummy fields and a IP field). The parser works fine. 2.

Profiler debug

Hi, I'm experiencing some GC overhead limits in my profiler. The profiler works fine while testing in Stellar enviorment, although it fails most of the time as a running topology. My profiler has 1 profile only. My profile has the following configuration: · 5 integer counters, when It

RE: Profiler debug

Thanks for replying. One more question: how do I set the debug for “org.apache.metron.profiler” ? Thanks

Re: Metron MaaS issue

Hi, I have the same issues when it comes to redeploy new versions, I usually just shut down the process by it's ID. It's not really an issue for me because it's doing something so simple. When it comes to the fact that the process can't read from existing folder, it had happened to me when I

RE: Profiler doubt

Hi again, I found something in the profiler storm logs that proves the delay: “2020-01-28 09:46:37.061 o.a.m.p.s.FixedFrequencyFlushSignal watermark-event-generator-0 [WARN] Timestamp out-of-order by -54968000 ms. This may indicate a problem in the data. timestamp=1580202172000,

RE: Profiler doubt

Hi Allen, Thanks for the reply by the way. I’ve been checking my profiler, tweaking some options and whatnot. I’ve set the “timestampField” and solved half the issue. I ran the spark batch profiler and it rectified the counts. Then I started the Storm profiler once again. Now the profiler is

Profiler consumer stuck

Hi, again I found a problem in my profiler consumer. For some reason my profiler won't consume new records from "indexing" topic. I checked the Kafka Consumer Groups and the current offset were 4 records behind, stucked. And whenever it consumes from "indexing" it says the data is old because

RE: Profiler doubt

Hi, This profiler is really inconsistent, i’m going crazy right now. I’ve made a further investigation and this is really bugging my mind: 1. I’m not expecting to receive15 hours old messages. In fact I’m the one who’s picking the messages from the current time and sending them to Kafka,

RE: Profiler doubt

I only restarted before running th first test, since all the configurations are the same in the three tests.

3rd party stellar functions

Hi, I was following this tutorial on custom Stellar functions https://metron.apache.org/current-book/metron-stellar/stellar-common/3rdPartyStellar.html , and it just doesn't work. I changed the Global configs, uploaded the "jar" file to HDFS, and then ran the stellar environment to test it. No

RE: 3rd party stellar functions

Yes I did, I pushed the configs using zk_load_configs.sh; restarted zookeeper; started stellar with “-z” flag. No errors.

RE: 3rd party stellar functions

It’s now working, I don’t if it had to do with it but I made a “clean package” in maven and it started working for some reason.

Profiler doubt

Hi, I've deployed Apache Metron with HDP 3.1 support provided by the GitHub repository (https://github.com/apache/metron/blob/feature/METRON-2088-support-hdp-3.1). I've some questions about the Profiler and somehow confused. I'm testing the ASA parser and i've deployed two profiles: 1.

RE: Metron MaaS issue

Have you tried increasing your service memory? If you have and it doesn’t work either, there’s a work around until you find a fix for you MaaS service. Forget about MaaS, launch your application as a seperate service. There’s a function in stellar “REST_GET” to make requests to REST services.

RE: Workers restarts randomly

: Re: Workers restarts randomly Turn logging up to DEBUG. Does that provide any more information? On Fri, Mar 13, 2020 at 11:36 AM Gonçalo Pedras mailto:goncalo.ped...@ctd.pt>> wrote: Hi, I’ve deployed a profiler with 2 profiles. When I start the profiler, everything works fine

Workers restarts randomly

Hi, I've deployed a profiler with 2 profiles. When I start the profiler, everything works fine until the first flush. After that, my profiler keeps restarting for no reason. The topology logs before the restart: "2020-03-13 15:17:56.878 o.a.s.k.s.KafkaSpout Thread-24-kafkaSpout-executor[10

Profiler topology zookeeper client timed out

Hi, I've set up a profiler of 15 minutes period, although it isn't really 15 minutes long. I've been monitoring the topology in Storm UI and I reached the conclusion that when my profiler flushes, after a few minutes the worker restarts. I checked the logs and I found that the worker restarts