Profiler statistics NaN

2017-08-09 Thread Dima Kovalyov
Hello Metron Team, I have created following profiler: > { > "profile": "host-talks-to", > "onlyif": "exists(source_ip)", > "foreach": "source_ip", > "init": { > "outcoming": "HLLP_INIT(5, 6)" > }, > "update": { "outcoming": "HLLP_ADD(outcoming, destination_ip)" }, >

Metron STIG hardening

2017-07-06 Thread Dima Kovalyov
Hello, Has anyone worked on the Metron security side? Maybe it is time to come up with sets of recommendation for hardening Metron installation. We as team are working on applying STIG framework by OpenSCAP, wonder if anyone done anything similar. Thank you. - Dima

Re: auto-install on bare metal

2017-04-26 Thread Dima Kovalyov
> pre-provision your machines and hand-build your inventory file. The AWS >>> playbooks only provision the machines. All deployment of Metron is >> handled >>> (for all installation types) by the metron_full_install playbook [1]. >>> >>> -D... >>> >&

Re: auto-install on bare metal

2017-04-26 Thread Dima Kovalyov
wrote: But that still requires to pre-install Ambari first, right? No. Just like what happens when deploying "Full Dev", Ansible will install Ambari. On Wed, Apr 26, 2017 at 10:25 AM, Dima Kovalyov <dima.koval...@sstech.us><mailto:dima.koval...@sstech.us> wrote: But that s

Re: Reliable place to get latest release info for script

2017-04-26 Thread Dima Kovalyov
? I have done some work, and have more planned and lined up to try to eliminate the requirement to develop in the metron tree to extend the product, and would be interested in your cases. On April 26, 2017 at 10:46:03, Dima Kovalyov (dima.koval...@sstech.us<mailto:dima.koval...@sstech

Re: Reliable place to get latest release info for script

2017-04-26 Thread Dima Kovalyov
. On April 26, 2017 at 12:38:28, Dima Kovalyov (dima.koval...@sstech.us<mailto:dima.koval...@sstech.us>) wrote: Regarding parsers and enrichment, new java based topologies for bluecoat, msexchange, msserver, asa, etc. Batching, we use NiFi + Kylo for both stream and batch, but batch dat

Re: Reliable place to get latest release info for script

2017-04-26 Thread Dima Kovalyov
at 11:22:21, Dima Kovalyov (dima.koval...@sstech.us<mailto:dima.koval...@sstech.us>) wrote: Otto, Yes, we developed custom parsers and enrichments (in future we seek to open source them, but have no time to up them to the decent level currently). We also merged our custom tools that e

Re: Reliable place to get latest release info for script

2017-04-26 Thread Dima Kovalyov
> Apache release repo. > > Hope this helps, > --Matt > > > On 4/26/17, 11:09 AM, "Dima Kovalyov" <dima.koval...@sstech.us> wrote: > > Otto, had a look at 777 PR. Yes, it looks like something we would use. > When do you think it will be rele

Re: mvn building errors with 0.3.1

2017-05-17 Thread Dima Kovalyov
ericEnrichmentBolt calls updateAdapter whenever the global > config changes. This essentially lets adapters subscribe to global > configuration updates and act if necessary (Geo for example can have it's > DB file updated, and that file location is stored in the global config). > > On Mon, M

Re: Zeppelin required for Metron 0.4.0 install

2017-06-05 Thread Dima Kovalyov
. Please note that you will > also need to select Hive and Spark, since they are dependencies. > > Regards, > Anand > > > > > On 6/5/17, 3:29 PM, "Dima Kovalyov" <dima.koval...@sstech.us> wrote: > >> Hello, >> >> I've missed the

Re: Zeppelin required for Metron 0.4.0 install

2017-06-07 Thread Dima Kovalyov
Foley wrote: > Dima, the Apache list server strips attachments for security and anti-spam > reasons. > You can post screenshots in Gist or Jira. > > On 6/5/17, 4:24 AM, "Dima Kovalyov" <dima.koval...@sstech.us> wrote: > > Thank you for prompt respons

Re: Zeppelin required for Metron 0.4.0 install

2017-06-07 Thread Dima Kovalyov
I've installed cluster with Zeppelin and it works now, does not ask for the Zeppelin creds. - Dima On 06/07/2017 01:27 PM, Dima Kovalyov wrote: > Thank you Matt, > > Image: http://i.imgur.com/EIO7YBr.png > So far, I workaround it by specifying host and port of the remote > Ze

Re: [CALL FOR TEST DATA] Request help identifying public domain or opensource test data sets for Metron testing

2017-05-04 Thread Dima Kovalyov
follow the process shown in: https://cwiki.apache.org/confluence/display/METRON/Metron+Development+Environment+Setup+Instructions I’ll go into more detail in a direct email. Thanks a lot for being interested in submitting these! Cheers, —Matt From: Dima Kovalyov <dim

Re: Need suggestion on how to configure HCP Big Data for Development and Testing

2017-10-06 Thread Dima Kovalyov
Hello Ashikin, HCP is Hortonworks product and they have installation document here: https://docs.hortonworks.com/HDPDocuments/HCP1/HCP-1.2.0/bk_installation/content/getting_started.html Chapter that you are looking for is below:

Re: Development Activity has dropped to effectively 0, what should we do?

2020-04-16 Thread Dima Kovalyov
- Dropping Ambari. I like the progress that Apache did with Ambari in 2.7. And I don't know a better installer/manager for all the services (we use other Hadoop eco services besides Metron). Sometimes its buggy, agents get stuck or server needs reboot from time to time, mpacks brake some