Hello Jon, here you are the output on my MacBook
sysctl -a | grep machdep.cpu.features machdep.cpu.features: FPU VME DE PSE TSC MSR PAE MCE CX8 APIC SEP MTRR PGE MCA CMOV PAT PSE36 CLFSH DS ACPI MMX FXSR SSE SSE2 SS HTT TM PBE SSE3 DTES64 MON DSCPL VMX SMX EST TM2 SSSE3 CX16 TPR PDCM SSE4.1 XSAVE I add as I wrote in my previous posts that unfortunately my machine does not support virtualization. I don't know if Metron single node on a VM Centos 6 can run without virtualization, otherwise I see only AWS as solution to start using Metron. Any suggestion? Thanks. Best regards, Simone > Il 13 giugno 2017 alle 12.20 "[email protected]" <[email protected]> ha scritto: > > > Hi Simone, > > Can you provide the output of this command on your computer? > > sysctl -a | grep machdep.cpu.features > > There is also an IRC channel, #apache-metron on Freenode if you'd like to > discuss this more synchronously. I'm usually there between 9-5, UTC -4. > > Jon > > > On Tue, Jun 13, 2017, 12:59 AM <[email protected] mailto:[email protected] > > wrote: > > > > > > Hello Matt, > > > > please do not misunderstand me posts. > > > > I said that most of the issues are due to my low knowledge of this > > tool. > > > > On the other hand, for a new user that does not have HDP installed, > > it's quite laborious the installation. For that reason, I'm asking for a > > work around such as a Centos VM - demo that I can simply run. > > > > I know that Metron is a quite new tool so developers do not want to > > waste their time on that. But it would expand the number of new usres. > > > > At the end of the day, I started to read about this tool because I > > would perform some tests with ML algorithms but I'm still at the > > installation point. > > > > Best Regards, > > Simone > > > > > > > Il 13 giugno 2017 alle 2.20 Matt Foley > > <[email protected] mailto:[email protected] > ha scritto: > > > > > > > > > This is funny/sad, because our Vagrant scripts, that you > > > assert you cannot use, were intended to meet this need. You can’t get > > > much simpler than “vagrant up” to install a full-blown single-node Metron. > > > > > > > > > > > > From: Otto Fowler <[email protected] > > > mailto:[email protected] > > > > Date: Monday, June 12, 2017 at 1:24 PM > > > To: "[email protected] mailto:[email protected] " > > > <[email protected] mailto:[email protected] >, Matt Foley <[email protected] > > > mailto:[email protected] >, "[email protected] > > > mailto:[email protected] " <[email protected] > > > mailto:[email protected] > > > > Subject: Re: Metron current version and Docker > > > > > > > > > > > > I do not know of any outside of our vagrant scripts, that use > > > ansible to deploy Metron onto a centos virtual box vm. > > > > > > > > > > > > > > > > > > On June 12, 2017 at 08:12:44, [email protected] > > > mailto:[email protected] ([email protected] mailto:[email protected] ) wrote: > > > > > > > > > > > > > > Hello Otto, > > > > > > > > is there any VM Centos 6 with Metron installed that I > > > > can use for my tests with ML? > > > > > > > > Thanks. > > > > > > > > Simone > > > > > > > > > > > > > > > > > > Il 12 giugno 2017 alle 14.05 Otto Fowler > > > > > <[email protected] mailto:[email protected] > ha scritto: > > > > > > > > > > We use centos 6 for our images and most > > > > > deployments. There are guides in the works for centos 7 manual setup > > > > > with ambari in the works right now. Centos 7 is not supported by the > > > > > full ansible setup at this time. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On June 12, 2017 at 06:08:40, [email protected] > > > > > mailto:[email protected] ([email protected] mailto:[email protected] ) > > > > > wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hello, > > > > > > > > > > > > I tried to install Metron 0.3.1 following > > > > > > the guideline: > > > > > > > > > > > > > > > > > > https://community.hortonworks.com/content/kbentry/88843/manually-installing-apache-metron-on-ubuntu-1404.html > > > > > > > > > > > > but I got some errors. > > > > > > > > > > > > One question about where I could find HDP > > > > > > 2.5.0 installation guideline for Ubuntu. > > > > > > > > > > > > Finally, if you as community and developers > > > > > > of Metron use CentOS 7, maybe it would be better if I adapt myself > > > > > > to that distribution. > > > > > > > > > > > > So, is there any ContOS 7 VM ready that I > > > > > > could download to test Metron 0.3.1 and the MaaS option? > > > > > > > > > > > > Maybe it would be faster than debug the > > > > > > installation in Ubuntu. > > > > > > > > > > > > Thank you. > > > > > > > > > > > > Best Regards, > > > > > > Simone > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Il 9 giugno 2017 alle 2.09 Otto > > > > > > > Fowler <[email protected] mailto:[email protected] > > > > > > > > ha scritto: > > > > > > > > > > > > > > Sorry, I do not know, we use centos. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On June 8, 2017 at 18:12:50, > > > > > > > [email protected] mailto:[email protected] ([email protected] > > > > > > > mailto:[email protected] ) wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hello Otto, > > > > > > > > > > > > > > > > thanks for the link. > > > > > > > > > > > > > > > > Do you know if it does work > > > > > > > > also with Ubuntu 16.04? > > > > > > > > > > > > > > > > Just for curiosity, the post is > > > > > > > > quite recent but I do not understand the reason to use a > > > > > > > > distribution quite old. > > > > > > > > > > > > > > > > Finally, I read in that guide > > > > > > > > that they do not use NIFI as source to record network packet. > > > > > > > > > > > > > > > > Is there any guide to use NIFI > > > > > > > > with Metron? > > > > > > > > > > > > > > > > Best Regards, > > > > > > > > > > > > > > > > Simone > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Il 8 giugno 2017 alle > > > > > > > > > 22.25 Otto Fowler <[email protected] > > > > > > > > > mailto:[email protected] > ha scritto: > > > > > > > > > > > > > > > > > > > > > > > > > > > https://community.hortonworks.com/content/kbentry/88843/manually-installing-apache-metron-on-ubuntu-1404.html > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > On June 8, 2017 at > > > > > > > > > 15:46:09, [email protected] mailto:[email protected] > > > > > > > > > ([email protected] mailto:[email protected] ) wrote: > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Hello Matt, > > > > > > > > > > > > > > > > > > > > thanks for your > > > > > > > > > > email. > > > > > > > > > > > > > > > > > > > > Yes, I said that I > > > > > > > > > > would use an Ubuntu VM to install Metron. I'm old school > > > > > > > > > > and I'm not so familiar with Docker. > > > > > > > > > > > > > > > > > > > > Moreover, it seems > > > > > > > > > > that my CPU (MacBook) does not support virtualization. > > > > > > > > > > > > > > > > > > > > On the other hand, > > > > > > > > > > I don't know if a VM with CentOS 7 on my machine could run > > > > > > > > > > Docker. I mean due to the same problem of virtualization on > > > > > > > > > > the host CPU. > > > > > > > > > > > > > > > > > > > > Let assume that VM > > > > > > > > > > CentOS 7 support Docker, I'm not familiar with that > > > > > > > > > > distribution (I used several but never CentOS). Do you have > > > > > > > > > > rpm packages for the tools needed for Metron? > > > > > > > > > > > > > > > > > > > > I would use the > > > > > > > > > > 0.4.0 version, but after several day I'm a bit frustrated > > > > > > > > > > because I stil didn't completely understand the tools chain > > > > > > > > > > to run Metron. > > > > > > > > > > > > > > > > > > > > I asked also into > > > > > > > > > > the dev-mailing list. > > > > > > > > > > > > > > > > > > > > My idea was to > > > > > > > > > > install NIFI as probe to catch network packets and fill in > > > > > > > > > > those into Metron. > > > > > > > > > > > > > > > > > > > > Then, I still > > > > > > > > > > didn't understand where I should deploy ML model into > > > > > > > > > > Metron to run it as a service. > > > > > > > > > > > > > > > > > > > > And finally, how to > > > > > > > > > > moidfy the ML to include it into a RESTful app. > > > > > > > > > > > > > > > > > > > > I'm sorry for the > > > > > > > > > > long list of questions/issues. I knwo that it is not so > > > > > > > > > > elegant into a mailing list but I'm a step from give up > > > > > > > > > > Metron. Even if I know that it would be a mistake. > > > > > > > > > > > > > > > > > > > > Thanks again if you > > > > > > > > > > could give some indications. > > > > > > > > > > > > > > > > > > > > Simone > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Il 8 giugno > > > > > > > > > > > 2017 alle 20.40 Matt Foley <[email protected] > > > > > > > > > > > mailto:[email protected] > ha scritto: > > > > > > > > > > > > > > > > > > > > > > Hi Simone, > > > > > > > > > > > > > > > > > > > > > > If I recall > > > > > > > > > > > your previous email, you said you want to use an Ubuntu > > > > > > > > > > > VM. Can you use Centos 6 or 7 instead? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > The reason I > > > > > > > > > > > ask is that for Centos there is an “Ambari manual > > > > > > > > > > > install” procedure, which does not require Docker, > > > > > > > > > > > Vagrant, or Ansible on the server. In this scenario you > > > > > > > > > > > just install Docker on your development machine (I use a > > > > > > > > > > > Mac), build the Metron RPMs and Ambari MPack there, scp > > > > > > > > > > > them to the server, and proceed with Ambari install. > > > > > > > > > > > This is in fact my main lab test method. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > But with > > > > > > > > > > > Ubuntu, I’m not aware of a documented procedure for > > > > > > > > > > > Ambari manual install, only install with Ansible > > > > > > > > > > > playbooks combined with a Docker-based build. You’d have > > > > > > > > > > > to figure out for yourself how to generate an ‘apt’ > > > > > > > > > > > package, etc., instead. Perhaps other community members > > > > > > > > > > > with more Ubuntu experience could assist here. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Regarding > > > > > > > > > > > 0.4.0 vs 0.3.1: At this point, 0.3.1 is several months > > > > > > > > > > > old, from Feb 23. There have been about 140 commits > > > > > > > > > > > since then, including both bug fixes and feature > > > > > > > > > > > developments. However, I don’t think there have been > > > > > > > > > > > major changes in the MaaS feature. > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Cheers, > > > > > > > > > > > > > > > > > > > > > > --Matt > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > From: > > > > > > > > > > > "[email protected] mailto:[email protected] " > > > > > > > > > > > <[email protected] mailto:[email protected] > > > > > > > > > > > > Reply-To: > > > > > > > > > > > "[email protected] mailto:[email protected] " > > > > > > > > > > > <[email protected] mailto:[email protected] > > > > > > > > > > > > Date: > > > > > > > > > > > Thursday, June 8, 2017 at 3:19 AM > > > > > > > > > > > To: > > > > > > > > > > > "[email protected] mailto:[email protected] " > > > > > > > > > > > <[email protected] mailto:[email protected] > > > > > > > > > > > > Subject: > > > > > > > > > > > Metron current version and Docker > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Dear All, > > > > > > > > > > > > > > > > > > > > > > I'm newbe > > > > > > > > > > > with Metron and actually I'm just figure out how to > > > > > > > > > > > install it to perform some tests. > > > > > > > > > > > > > > > > > > > > > > Currently, I > > > > > > > > > > > would start installing Metron in a single VM to do my > > > > > > > > > > > tests. > > > > > > > > > > > > > > > > > > > > > > I don't know > > > > > > > > > > > which are the differences between 0.3.1 and 0.4.0. > > > > > > > > > > > > > > > > > > > > > > Unfortunately > > > > > > > > > > > for me, my CPU does not support virtualization. That means > > > > > > > > > > > that I cannot > > > > > > > > > > > use Docker. > > > > > > > > > > > > > > > > > > > > > > The only > > > > > > > > > > > workaround that I found is to use AWS directly but for me > > > > > > > > > > > that I > > > > > > > > > > > have never > > > > > > > > > > > used Mentor it could be a so big step... > > > > > > > > > > > > > > > > > > > > > > So the > > > > > > > > > > > question is, do I lose many things if I start with Mentor > > > > > > > > > > > 0.3.1 > > > > > > > > > > > into a single > > > > > > > > > > > VM without Docker? > > > > > > > > > > > > > > > > > > > > > > Best regards, > > > > > > > > > > > > > > > > > > > > > > Simone > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > Jon >
