Re: Apache Metron production deployment

2019-10-29 Thread Michael Miklavcic
No specific plans set in motion yet - we'd need a solid alternative developed first, which does not yet exist. Ideally, some of these peripheral concerns (like install) could be pluggable. That way, vendors can easily snap in their own solutions. That being said, I'd expect that Ambari will still

Re: Apache Metron production deployment

2019-10-29 Thread Marcus Persso
Thanks Michael! So what is your recommendation if we should set it up in a production environment? We will run it on our own servers and not in the cloud. Do you have a plan that you can when in near future your will move away from ambari direct dependancy? 1 month 6 months or something? Br

Re: Apache Metron production deployment

2019-10-29 Thread Michael Miklavcic
Also agreed on Nick's deployment comments. Deploying on AWS manually is fairly trivial. The Ansible scripts have not been touched in months (years, even). You could also install Hadoop services manually (Big Top, for instance), but YMMV. Most of our testing to this point has been on Ambari,

Re: Apache Metron production deployment

2019-10-29 Thread Nick Allen
To echo Simon's comments, you should NOT use the automated deployment mechanism described at *metron-deployment/amazon-ec2/README.md*. This has not been maintained, deploys an unsecure cluster by default, and is not the preferred installation method. This installation path pre-dates the Ambari

Re: Apache Metron production deployment

2019-10-29 Thread Prashant Bhalesain
1. Use hortonworks-ansible script available on github to build the base HDP cluster 2. Install ambari metron pack and/or elastic pack. 3. Install metron services You should have a working cluster. I would not recommend the same beyond POC/demo though On Tue, 29 Oct 2019 at 13:43, Eric Jacksch

Re: Apache Metron production deployment

2019-10-29 Thread Simon Elliston Ball
I would recommend against using the AWS deploy method on the github. It’s not really that well maintained, and the Ambari method is definitely the preferred at present, but then I tend to use a distro to install, or full dev if it’s just for local testing. Simon > On 29 Oct 2019, at 13:35,

Re: Apache Metron production deployment

2019-10-29 Thread Eric Jacksch
I did earlier on this list, but wasn't able to make any progress. Someone who knows the product well really should try as I suggested -- start from a clean slate in AWS, create an EC2 instance, and try to deploy using the provided scripts. It's so badly broken that a security guy with 25+ years

Re: Threat Intel hailataxii

2019-10-29 Thread Simon Elliston Ball
Looks to me like your discovery server is not working properly, hence the failure message. This could be a temporary connectivity issue, but if it’s repeatable I would look into your opentaxii config. Simon > On 29 Oct 2019, at 13:23, Thiago Rahal Disposti > wrote: > >  > Anyone knows

Re: Apache Metron production deployment

2019-10-29 Thread Nick Allen
Have you opened a JIRA or sent an email describing what problems that you've run into? On Tue, Oct 29, 2019 at 9:35 AM Eric Jacksch wrote: > I thought I may have just missed something, but one of my customer's > DevOps team worked on it for three days and couldn't get it going > either. > > On

Re: Apache Metron production deployment

2019-10-29 Thread Marcus Persson
then its just not me that have had problems... BUt my problem was best way of running it on CentOS.. On 2019/10/29 13:22:08, Eric Jacksch wrote: > We unfortunately gave up after trying several approaches to getting > Metron running in AWS. I'm disappointed -- I think Metron has huge >

Re: Apache Metron production deployment

2019-10-29 Thread Marcus Persson
I got a bit unsure after reading on the Metron-github under metron-deployment "https://github.com/apache/metron/tree/master/metron-deployment; because it states following "If you want to run a proof-of-concept to see how Apache Metron can benefit your organization, then this is the way to do

Re: Apache Metron production deployment

2019-10-29 Thread Eric Jacksch
We unfortunately gave up after trying several approaches to getting Metron running in AWS. I'm disappointed -- I think Metron has huge potential. I suspect those who are using it have established development systems and that there are some undocumented prerequisites. If anyone on the Metron team

Re: Apache Metron production deployment

2019-10-29 Thread Simon Elliston Ball
Everyone I know of running metron at scale in production uses the ambari based install method through a distribution, running on centos 6 on HDP 2.6.5 and for the new feature branch centos 7 on top of HDP 3.1.4. Simon On Tue, 29 Oct 2019 at 12:54, wrote: > Hello, > > How are you using Metron

Apache Metron production deployment

2019-10-29 Thread marcus
Hello, How are you using Metron in a production environment? I have checked around and my conclusion is that the Ambari-solution should not be used in production environment and just for poc/testing. I want to run Metron with Hadoop on CentOS 7 or 8, If you have other recomendation I can change

Re: Invite for Merton slack channel

2019-10-29 Thread Marcus Persson
Hi, Please add me aswell. mar...@marcuspe.se Thanks alot! On 2019/10/08 10:23:24, Sanket Sharma wrote: > Hi, > > Can you please add me to the slack channel? > > Best regards, > Sanket > > From: Otto Fowler > Sent: Wednesday, August 21, 2019 11:16 PM > To: