: Re: Workers restarts randomly
Turn logging up to DEBUG. Does that provide any more information?
On Fri, Mar 13, 2020 at 11:36 AM Gonçalo Pedras
mailto:goncalo.ped...@ctd.pt>> wrote:
Hi,
I’ve deployed a profiler with 2 profiles. When I start the profiler, everything
works fine
Hi,
I've deployed a profiler with 2 profiles. When I start the profiler, everything
works fine until the first flush. After that, my profiler keeps restarting for
no reason. The topology logs before the restart:
"2020-03-13 15:17:56.878 o.a.s.k.s.KafkaSpout Thread-24-kafkaSpout-executor[10
Hi,
I've set up a profiler of 15 minutes period, although it isn't really 15
minutes long. I've been monitoring the topology in Storm UI and I reached the
conclusion that when my profiler flushes, after a few minutes the worker
restarts. I checked the logs and I found that the worker restarts
Have you tried increasing your service memory? If you have and it doesn’t work
either, there’s a work around until you find a fix for you MaaS service.
Forget about MaaS, launch your application as a seperate service. There’s a
function in stellar “REST_GET” to make requests to REST services.
Thanks for replying. One more question: how do I set the debug for
“org.apache.metron.profiler” ?
Thanks
Hi,
I have the same issues when it comes to redeploy new versions, I usually just
shut down the process by it's ID. It's not really an issue for me because it's
doing something so simple.
When it comes to the fact that the process can't read from existing folder, it
had happened to me when I
Hi,
I'm experiencing some GC overhead limits in my profiler. The profiler works
fine while testing in Stellar enviorment, although it fails most of the time as
a running topology. My profiler has 1 profile only.
My profile has the following configuration:
· 5 integer counters, when It
It’s now working, I don’t if it had to do with it but I made a “clean package”
in maven and it started working for some reason.
Yes I did, I pushed the configs using zk_load_configs.sh; restarted zookeeper;
started stellar with “-z” flag. No errors.
Hi,
I was following this tutorial on custom Stellar functions
https://metron.apache.org/current-book/metron-stellar/stellar-common/3rdPartyStellar.html
, and it just doesn't work. I changed the Global configs, uploaded the "jar"
file to HDFS, and then ran the stellar environment to test it. No
Hi, again
I found a problem in my profiler consumer. For some reason my profiler won't
consume new records from "indexing" topic. I checked the Kafka Consumer Groups
and the current offset were 4 records behind, stucked. And whenever it consumes
from "indexing" it says the data is old because
I only restarted before running th first test, since all the configurations are
the same in the three tests.
Hi,
This profiler is really inconsistent, i’m going crazy right now.
I’ve made a further investigation and this is really bugging my mind:
1. I’m not expecting to receive15 hours old messages. In fact I’m the one
who’s picking the messages from the current time and sending them to Kafka,
Hi again,
I found something in the profiler storm logs that proves the delay:
“2020-01-28 09:46:37.061 o.a.m.p.s.FixedFrequencyFlushSignal
watermark-event-generator-0 [WARN] Timestamp out-of-order by -54968000 ms. This
may indicate a problem in the data. timestamp=1580202172000,
Hi Allen,
Thanks for the reply by the way.
I’ve been checking my profiler, tweaking some options and whatnot. I’ve set the
“timestampField” and solved half the issue.
I ran the spark batch profiler and it rectified the counts. Then I started the
Storm profiler once again. Now the profiler is
Hi,
I've deployed Apache Metron with HDP 3.1 support provided by the GitHub
repository
(https://github.com/apache/metron/blob/feature/METRON-2088-support-hdp-3.1).
I've some questions about the Profiler and somehow confused. I'm testing the
ASA parser and i've deployed two profiles:
1.
Hi,
It works. Thanks for the help. Really appreciated.
Thanks
Hi,
I've deployed Metron alongside the current Ambari version using the Metron
HDP3.1 support provided by a branch in the GitHub project.
Fast forward, I'm testing Metron:
1. I've deployed a custom CSV parser with 3 fields ( 2 dummy fields and a
IP field). The parser works fine.
2.
Resolved.
Deleted Metron service and added the service again but this time I configured
REST by configuring the JDBC with mysql.
On 2019/11/06 10:49:50, Gonçalo Pedras mailto:g...@ctd.pt>> wrote:
> Hi,>
> I've built Metron and installed alongside the current Ambari version
Hi,
I've built Metron and installed alongside the current Ambari version with
HDP-3.1 support provided by the GitHub project
(https://github.com/apache/metron/tree/feature/METRON-2088-support-hdp-3.1).
I've followed the documentation and installed everything with success. Altough
when i'm
20 matches
Mail list logo