Hello Matt, please do not misunderstand me posts.
I said that most of the issues are due to my low knowledge of this tool. On the other hand, for a new user that does not have HDP installed, it's quite laborious the installation. For that reason, I'm asking for a work around such as a Centos VM - demo that I can simply run. I know that Metron is a quite new tool so developers do not want to waste their time on that. But it would expand the number of new usres. At the end of the day, I started to read about this tool because I would perform some tests with ML algorithms but I'm still at the installation point. Best Regards, Simone > Il 13 giugno 2017 alle 2.20 Matt Foley <[email protected]> ha scritto: > > > This is funny/sad, because our Vagrant scripts, that you assert you > cannot use, were intended to meet this need. You can’t get much simpler than > “vagrant up” to install a full-blown single-node Metron. > > > > From: Otto Fowler <[email protected]> > Date: Monday, June 12, 2017 at 1:24 PM > To: "[email protected]" <[email protected]>, Matt Foley <[email protected]>, > "[email protected]" <[email protected]> > Subject: Re: Metron current version and Docker > > > > I do not know of any outside of our vagrant scripts, that use ansible to > deploy Metron onto a centos virtual box vm. > > > > > > On June 12, 2017 at 08:12:44, [email protected] mailto:[email protected] > ([email protected] mailto:[email protected] ) wrote: > > > > > > Hello Otto, > > > > is there any VM Centos 6 with Metron installed that I can use for > > my tests with ML? > > > > Thanks. > > > > Simone > > > > > > > > > > Il 12 giugno 2017 alle 14.05 Otto Fowler > > > <[email protected] mailto:[email protected] > ha scritto: > > > > > > We use centos 6 for our images and most deployments. There > > > are guides in the works for centos 7 manual setup with ambari in the > > > works right now. Centos 7 is not supported by the full ansible setup at > > > this time. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On June 12, 2017 at 06:08:40, [email protected] > > > mailto:[email protected] ([email protected] mailto:[email protected] ) wrote: > > > > > > > > > > > > > > > > > > > > > > Hello, > > > > > > > > I tried to install Metron 0.3.1 following the > > > > guideline: > > > > > > > > > > > > https://community.hortonworks.com/content/kbentry/88843/manually-installing-apache-metron-on-ubuntu-1404.html > > > > > > > > but I got some errors. > > > > > > > > One question about where I could find HDP 2.5.0 > > > > installation guideline for Ubuntu. > > > > > > > > Finally, if you as community and developers of Metron > > > > use CentOS 7, maybe it would be better if I adapt myself to that > > > > distribution. > > > > > > > > So, is there any ContOS 7 VM ready that I could > > > > download to test Metron 0.3.1 and the MaaS option? > > > > > > > > Maybe it would be faster than debug the installation in > > > > Ubuntu. > > > > > > > > Thank you. > > > > > > > > Best Regards, > > > > Simone > > > > > > > > > > > > > > > > > > > > > > > > > > Il 9 giugno 2017 alle 2.09 Otto Fowler > > > > > <[email protected] mailto:[email protected] > ha scritto: > > > > > > > > > > Sorry, I do not know, we use centos. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On June 8, 2017 at 18:12:50, [email protected] > > > > > mailto:[email protected] ([email protected] mailto:[email protected] ) > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hello Otto, > > > > > > > > > > > > thanks for the link. > > > > > > > > > > > > Do you know if it does work also with > > > > > > Ubuntu 16.04? > > > > > > > > > > > > Just for curiosity, the post is quite > > > > > > recent but I do not understand the reason to use a distribution > > > > > > quite old. > > > > > > > > > > > > Finally, I read in that guide that they do > > > > > > not use NIFI as source to record network packet. > > > > > > > > > > > > Is there any guide to use NIFI with Metron? > > > > > > > > > > > > Best Regards, > > > > > > > > > > > > Simone > > > > > > > > > > > > > > > > > > > > > > > > > > Il 8 giugno 2017 alle 22.25 Otto > > > > > > > Fowler <[email protected] mailto:[email protected] > > > > > > > > ha scritto: > > > > > > > > > > > > > > > > > > > > > https://community.hortonworks.com/content/kbentry/88843/manually-installing-apache-metron-on-ubuntu-1404.html > > > > > > > > > > > > > > > > > > > > > > > > > > > > On June 8, 2017 at 15:46:09, > > > > > > > [email protected] mailto:[email protected] ([email protected] > > > > > > > mailto:[email protected] ) wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hello Matt, > > > > > > > > > > > > > > > > thanks for your email. > > > > > > > > > > > > > > > > Yes, I said that I would use an > > > > > > > > Ubuntu VM to install Metron. I'm old school and I'm not so > > > > > > > > familiar with Docker. > > > > > > > > > > > > > > > > Moreover, it seems that my CPU > > > > > > > > (MacBook) does not support virtualization. > > > > > > > > > > > > > > > > On the other hand, I don't know > > > > > > > > if a VM with CentOS 7 on my machine could run Docker. I mean > > > > > > > > due to the same problem of virtualization on the host CPU. > > > > > > > > > > > > > > > > Let assume that VM CentOS 7 > > > > > > > > support Docker, I'm not familiar with that distribution (I used > > > > > > > > several but never CentOS). Do you have rpm packages for the > > > > > > > > tools needed for Metron? > > > > > > > > > > > > > > > > I would use the 0.4.0 version, > > > > > > > > but after several day I'm a bit frustrated because I stil > > > > > > > > didn't completely understand the tools chain to run Metron. > > > > > > > > > > > > > > > > I asked also into the > > > > > > > > dev-mailing list. > > > > > > > > > > > > > > > > My idea was to install NIFI as > > > > > > > > probe to catch network packets and fill in those into Metron. > > > > > > > > > > > > > > > > Then, I still didn't understand > > > > > > > > where I should deploy ML model into Metron to run it as a > > > > > > > > service. > > > > > > > > > > > > > > > > And finally, how to moidfy the > > > > > > > > ML to include it into a RESTful app. > > > > > > > > > > > > > > > > I'm sorry for the long list of > > > > > > > > questions/issues. I knwo that it is not so elegant into a > > > > > > > > mailing list but I'm a step from give up Metron. Even if I know > > > > > > > > that it would be a mistake. > > > > > > > > > > > > > > > > Thanks again if you could give > > > > > > > > some indications. > > > > > > > > > > > > > > > > Simone > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Il 8 giugno 2017 alle > > > > > > > > > 20.40 Matt Foley <[email protected] mailto:[email protected] > > > > > > > > > > ha scritto: > > > > > > > > > > > > > > > > > > Hi Simone, > > > > > > > > > > > > > > > > > > If I recall your previous > > > > > > > > > email, you said you want to use an Ubuntu VM. Can you use > > > > > > > > > Centos 6 or 7 instead? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > The reason I ask is that > > > > > > > > > for Centos there is an “Ambari manual install” procedure, > > > > > > > > > which does not require Docker, Vagrant, or Ansible on the > > > > > > > > > server. In this scenario you just install Docker on your > > > > > > > > > development machine (I use a Mac), build the Metron RPMs and > > > > > > > > > Ambari MPack there, scp them to the server, and proceed with > > > > > > > > > Ambari install. This is in fact my main lab test method. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > But with Ubuntu, I’m not > > > > > > > > > aware of a documented procedure for Ambari manual install, > > > > > > > > > only install with Ansible playbooks combined with a > > > > > > > > > Docker-based build. You’d have to figure out for yourself > > > > > > > > > how to generate an ‘apt’ package, etc., instead. Perhaps > > > > > > > > > other community members with more Ubuntu experience could > > > > > > > > > assist here. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Regarding 0.4.0 vs 0.3.1: > > > > > > > > > At this point, 0.3.1 is several months old, from Feb 23. > > > > > > > > > There have been about 140 commits since then, including both > > > > > > > > > bug fixes and feature developments. However, I don’t think > > > > > > > > > there have been major changes in the MaaS feature. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Cheers, > > > > > > > > > > > > > > > > > > --Matt > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > From: "[email protected] > > > > > > > > > mailto:[email protected] " <[email protected] > > > > > > > > > mailto:[email protected] > > > > > > > > > > Reply-To: > > > > > > > > > "[email protected] mailto:[email protected] " > > > > > > > > > <[email protected] mailto:[email protected] > > > > > > > > > > Date: Thursday, June 8, > > > > > > > > > 2017 at 3:19 AM > > > > > > > > > To: > > > > > > > > > "[email protected] mailto:[email protected] " > > > > > > > > > <[email protected] mailto:[email protected] > > > > > > > > > > Subject: Metron current > > > > > > > > > version and Docker > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Dear All, > > > > > > > > > > > > > > > > > > I'm newbe with Metron and > > > > > > > > > actually I'm just figure out how to install it to perform > > > > > > > > > some tests. > > > > > > > > > > > > > > > > > > Currently, I would start > > > > > > > > > installing Metron in a single VM to do my tests. > > > > > > > > > > > > > > > > > > I don't know which are > > > > > > > > > the differences between 0.3.1 and 0.4.0. > > > > > > > > > > > > > > > > > > Unfortunately for me, my > > > > > > > > > CPU does not support virtualization. That means > > > > > > > > > that I cannot use Docker. > > > > > > > > > > > > > > > > > > The only workaround that > > > > > > > > > I found is to use AWS directly but for me that I > > > > > > > > > have never used Mentor it > > > > > > > > > could be a so big step... > > > > > > > > > > > > > > > > > > So the question is, do I > > > > > > > > > lose many things if I start with Mentor 0.3.1 > > > > > > > > > into a single VM without > > > > > > > > > Docker? > > > > > > > > > > > > > > > > > > Best regards, > > > > > > > > > > > > > > > > > > Simone > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
