Metron Installation

2017-09-15 Thread Syed Hammad Tahir
Hello, I need a guide to install metron on my PC from scratch. Regards

Re: Metron Installation

2017-09-15 Thread Syed Hammad Tahir
gb of RAM > will not work. You need server grade machines for Metron to work reliably. > > On Sep 15, 2017 2:41 PM, "Syed Hammad Tahir" <mscs16...@itu.edu.pk> wrote: > > My PC is core i5, 8GB RAM and a few hundred GBs of disk space. It doesnt > have any OS as I will install

Re: Metron Installation

2017-09-15 Thread Syed Hammad Tahir
ormation, which operating system your PC. > > Thanks, > Venkatesh > > On Fri, Sep 15, 2017 at 2:57 PM, Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> Hello, >> >> I need a guide to install metron on my PC from scratch. >> >> Regards >> > >

Re: Metron Installation

2017-09-15 Thread Syed Hammad Tahir
extremely painful and I gave up shifting to a server > machine with loads of RAM and processing power. > > On Sep 15, 2017 2:51 PM, "Syed Hammad Tahir" <mscs16...@itu.edu.pk> wrote: > >> Even a basic VM install wont work? It says that 8Gb ram might work. >&g

Re: Metron Installation

2017-09-15 Thread Syed Hammad Tahir
se you're > installing on a desktop), our full dev environment might be a better > approach for you and get you up and running faster: > https://github.com/apache/metron/tree/master/metron- > deployment/vagrant/full-dev-platform. > > Ryan > > On Fri, Sep 15, 2017 at 9:06 AM, Syed H

Re: Metron Installation

2017-09-15 Thread Syed Hammad Tahir
etron+REST >> >> Thanks, >> Venkatesh >> >> On Fri, Sep 15, 2017 at 3:27 PM, Khurram Ahmed <khurramah...@gmail.com> >> wrote: >> >>> My experience was extremely painful and I gave up shifting to a server >>> machine with loads of RAM and p

System Requrements

2017-09-20 Thread Syed Hammad Tahir
Hello, What would be the system required in order to run metron and analyzy a LAN environment of almost 100 nodes using single node full development depoloyment. Regards.

Re: System Requrements

2017-09-20 Thread Syed Hammad Tahir
ow many events per > second is it, and (3) what are you planning to do with the data (profiling, > MaaS, enrichments, etc.)? > > Jon > > On Wed, Sep 20, 2017, 04:04 Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> Hello, >> >> What would be the syste

Re: System Requrements

2017-09-20 Thread Syed Hammad Tahir
internet use, email, etc.)? Are they behind network > firewalls or NAT, or are they exposed? Are they shared machines or one > primary user each? If there are any internet exposed services, what are > they? > > Jon > > On Wed, Sep 20, 2017, 06:50 Syed Hammad Tahir <msc

Re: Initial Testing

2017-10-05 Thread Syed Hammad Tahir
ovide you the exact tutorials. However, > I believe you can find something here: > https://cwiki.apache.org/confluence/display/METRON/Metron+Architecture > > If not exact answer you will the enough idea to do R to achieve your > goals. > > On 5 October 2017 at 13:43, Syed Hamm

Re: Initial Testing

2017-10-05 Thread Syed Hammad Tahir
e it do data modelling phase where you can use python kind of > language to apply different modelling techniques on your data. > > Cheers, > Umesh Kaushik > 9620023458 > > Sent from mobile device, kindly ignore the typographical errors. > > On 05-Oct-2017 10:55 AM, "Sye

Guide

2017-10-02 Thread Syed Hammad Tahir
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=68718548 Does this installaion guide work any more? I am trying to to it on my 32gb ram ubuntu PC. Please let me know if there are any changes to be made in this.

Re: Snort

2017-10-17 Thread Syed Hammad Tahir
And I am sorry about one confusion but isnt snort builtin into the metron framework? If so then cant we access that snort and do the tasks you mentioned earlier? On Tue, Oct 17, 2017 at 11:39 AM, Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > Hi, > > Thanks for t

Re: Snort

2017-10-17 Thread Syed Hammad Tahir
> wonderful things with it. :) > > > On Tue, Oct 17, 2017 at 4:00 AM, Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> And I am sorry about one confusion but isnt snort builtin into the metron >> framework? If so then cant we access that snort and do the task

Getting Started

2017-09-06 Thread Syed Hammad Tahir
Hello, I intend to use Apache Metron framework for the analysis of our local area network. What is the best way to get started? Which installation is most suitable for me as listed in the following link: https://cwiki.apache.org/confluence/display/METRON/Installation Kindly help me with this.

Re: Getting Started

2017-09-06 Thread Syed Hammad Tahir
o store PCAP? > > Jon > > On Wed, Sep 6, 2017, 01:59 Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > >> Hello, >> >> I intend to use Apache Metron framework for the analysis of our local >> area network. What is the best way to get started? Which insta

Re: Getting Started

2017-09-07 Thread Syed Hammad Tahir
Thu, Sep 7, 2017, 09:13 Syed Hammad Tahir <mscs16...@itu.edu.pk > <javascript:_e(%7B%7D,'cvml','mscs16...@itu.edu.pk');>> wrote: > >> I will confirm about batch or streaming data. The sensors you mentioned, >> are they some particular devices or you are referring to

Re: Getting Started

2017-09-07 Thread Syed Hammad Tahir
t you will be feeding into Metron, and to know > that you need to set up the sensors and get the network traffic first. > > Jon > > On Thu, Sep 7, 2017, 00:40 Syed Hammad Tahir <mscs16...@itu.edu.pk > <javascript:_e(%7B%7D,'cvml','mscs16...@itu.edu.pk');>> wrote: > >&

Re: Getting Started

2017-09-06 Thread Syed Hammad Tahir
bare metal install. In your case you don't seem > interested in PCAP, which means you _may_ be able to get away with > something in EC2 or similar. > > Jon > > On Wed, Sep 6, 2017 at 6:41 AM Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> Hello, >> >&g

Installation Issues

2017-09-25 Thread Syed Hammad Tahir
Hello everyone, any Idea how I can resolve this? [image: Inline image 1]

Re: Installation Issues

2017-09-25 Thread Syed Hammad Tahir
unless proven otherwise. Your best bet is to requisition > some server grade hardware from your university to test metron even if it's > just the dev version. > > > > On Tue, Sep 26, 2017 at 9:50 AM, Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> Hello eve

Re: Metron Installation

2017-09-25 Thread Syed Hammad Tahir
use (leaving < 8GB for Metron testing). I don't > recall the specifics of your system, are you making sure you have over 8GB > *free* when you start spinning this up? > > Jon > > On Mon, Sep 25, 2017, 03:25 Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> B

Metron Installation

2017-09-24 Thread Syed Hammad Tahir
Any fix for this? [image: Inline image 2]

Re: Metron Installation

2017-09-25 Thread Syed Hammad Tahir
e base platform > for Metron. I would strongly recommend going for something cloud based. > > I would also consider using the mpack method on an existing ambari, and > avoiding the ansible method, that will be a little less brittle. > > Simon > > > > On 25 Sep 2017, at 0

Re: Snort

2017-10-12 Thread Syed Hammad Tahir
tries out of the > box. You have to setup Snort on your own and push the output into a kafka > topic (most likely using NiFi). From there on you can use the output of > Snort in Metron. > > > 10.10.2017, 00:48, "Syed Hammad Tahir" <mscs16...@itu.edu.pk>: > > Hi, >

Re: Installation Issues

2017-09-27 Thread Syed Hammad Tahir
is can you > login and check what part the cluster deploy failed at. > > > Regards, > > Aaron > > > From: Syed Hammad Tahir > Sent: Wednesday, 27 September, 06:28 > Subject: Installation Issues > To: user@metron.apache.org > Cc: Muhammad Umar Janjua > > >

Re: Installation Issues

2017-09-27 Thread Syed Hammad Tahir
gt; On 27/09/17 13:16, Syed Hammad Tahir wrote: > > This is what I see when I login into ambari. How do I check where cluster > deployment failed? > > [image: Inline image 1] > > On Wed, Sep 27, 2017 at 10:54 AM, Aaron Harris <aaron.s.har...@outlook.com > > wrote: > &

Re: Installation Issues

2017-09-27 Thread Syed Hammad Tahir
yes, which one should I pursue in order to find the issue? On Wed, Sep 27, 2017 at 12:50 PM, tkg_cangkul <yuza.ras...@gmail.com> wrote: > what alert that you see on ambari? there are 24 alert on your screenshot > below. > > > On 27/09/17 13:50, Syed Hammad Tahir wro

Re: Snort

2017-10-17 Thread Syed Hammad Tahir
f you are not familiar with how Ansible roles are defined, just start at > the main.yml, then follow through each of the other files as they are > included. It is pretty readable once you get use to the layout. > > On Tue, Oct 17, 2017 at 12:05 PM, Syed Hammad Tahir <mscs16..

Re: Snort

2017-10-17 Thread Syed Hammad Tahir
for more information. > > https://github.com/apache/metron/tree/master/metron- > deployment/roles/sensor-stubs > > > > On Tue, Oct 17, 2017 at 10:16 AM, Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> yes,, but when i do snort -v in vagrant ssh console it says

Re: Snort

2017-10-19 Thread Syed Hammad Tahir
gt; here is change a config value. > > Simon > > On 19 Oct 2017, at 11:46, Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > > Ran it without -i swtich, gives this: > > > > On Thu, Oct 19, 2017 at 2:56 PM, zeo...@gmail.com <zeo...@gmail.com> > wrote: &

Re: Snort Installation

2017-10-23 Thread Syed Hammad Tahir
nort.org/documents) or reaching > out to their community (https://snort.org/community), as they have more > expertise in this area. > > Jon > > On Mon, Oct 23, 2017, 03:52 Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> Hi guys, >> >> I tried to add anothe

Re: Snort Logs

2017-11-12 Thread Syed Hammad Tahir
hi, This problem still persists guys . On Thu, Nov 9, 2017 at 11:13 PM, Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > Any solution to these issues guys? > > On Thu, Nov 9, 2017 at 6:01 AM, Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> I have

Re: Snort Logs

2017-11-13 Thread Syed Hammad Tahir
ok, Doing it. On Mon, Nov 13, 2017 at 3:07 PM, zeo...@gmail.com <zeo...@gmail.com> wrote: > Can you restart storm and give it another shot? > > Jon > > On Mon, Nov 13, 2017, 00:30 Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> hi, This problem st

Re: Snort enrichment issue

2017-11-17 Thread Syed Hammad Tahir
a-management/index.html# > GeoLite2_Loader > > Also, we can’t really see the error from screenshots, please send log > entries. > > Simon > > On 17 Nov 2017, at 07:11, Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > > Hi all, I am starting it again. Last one got a bit m

Re: Snort enrichment issue

2017-11-17 Thread Syed Hammad Tahir
ANd I dint load anything. It was supposed to be loaded during installation? My installation is ambari based single node VM install on ubuntu host. On Fri, Nov 17, 2017 at 3:55 PM, Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > Here you go, the error part of the log is in the a

Monit and sensor stubs

2017-11-16 Thread Syed Hammad Tahir
Hi, I re deployed single node ambari based metron cluster and this time with ansibleSkipTags= 'quick_dev' and now monit and sersor stubs are gone. I run sudo service monit status and it says monit: unrecognized service

ML in Metron

2017-11-21 Thread Syed Hammad Tahir
HI all, I have succesfully pushed real snort logs in to metron, now I need to apply a machine learning or data science algorithm on it. How could I do that? I want to code in python/R and then apply it in metron. Regards.

Re: HDFS SIze

2017-11-15 Thread Syed Hammad Tahir
on is to add a complete new node, then install the datanode > service on it through Ambari. > > > Regards, > > Aaron > -- > *From:* Syed Hammad Tahir <mscs16...@itu.edu.pk> > *Sent:* Thursday, November 16, 2017 5:47:49 AM > *To:* user@metron.ap

Re: Snort Logs

2017-11-03 Thread Syed Hammad Tahir
And how do I install elasticsearch head on the vagrant VM?

Re: Snort Logs

2017-11-05 Thread Syed Hammad Tahir
gt; Jon > > On Fri, Nov 3, 2017 at 12:19 PM Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> >> -- Forwarded message -- >> From: Syed Hammad Tahir <mscs16...@itu.edu.pk> >> Date: Fri, Nov 3, 2017 at 5:07 PM >> Subject: Re:

Re: Snort Logs

2017-11-08 Thread Syed Hammad Tahir
P > > ? > > Jon > > On Wed, Nov 8, 2017 at 1:49 PM Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> This is the script/command i used >> >> sudo cat snort.out | >> /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh >> --broker-list

memory issue

2017-11-03 Thread Syed Hammad Tahir
How do I increase vagrant vm`s RAM. I have plenty of RAM to allocate to it. [image: Inline image 1]

Re: ML in Metron

2017-12-02 Thread Syed Hammad Tahir
gt; > Thanks, > James > > > 21.11.2017, 04:44, "Simon Elliston Ball" <si...@simonellistonball.com>: > > Use MaaS: > http://metron.apache.org/current-book/metron-analytics/ > metron-maas-service/index.html > > > On 21 Nov 2017, at 11:43, Syed Hammad Tahir

Basic analysis

2017-12-05 Thread Syed Hammad Tahir
Hi, Can I setup custom visualization to show lets say the peak netrwork usage traffic in a certain time? Regards.

Re: Basic analysis

2017-12-06 Thread Syed Hammad Tahir
logged for an ‘example’ notebook for this would be > appropriate as well? > > > On December 6, 2017 at 07:06:30, Simon Elliston Ball ( > si...@simonellistonball.com) wrote: > > Yes. Consider a zeppelin notebook, or kibana dashboard for this. > > If you want to use these val

Re: Snort Logs

2017-10-30 Thread Syed Hammad Tahir
com> wrote: > You need text logs. Here's an example of some properly formatted logs - > https://raw.githubusercontent.com/apache/metron/master/metron- > deployment/roles/sensor-stubs/files/snort.out > > Jon > > On Mon, Oct 30, 2017, 01:34 Syed Hammad Tahir <mscs16...@itu.edu.

Re: Kibana Error

2017-10-25 Thread Syed Hammad Tahir
e problem is that it is not > responding. I assume you have tried restarting elastic. > > On 25 Oct 2017, at 13:12, Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > > It shows healthy > > > But when I click in any quick link it shows this > > > > On Wed,

Re: Kibana Error

2017-10-25 Thread Syed Hammad Tahir
t; search, kafka, hadoop (hdfs in particular) and Linux. Our docs will assume > you have at least some familiarity with those technologies. > > Simon > > On 25 Oct 2017, at 11:40, Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > > Sorry, I didnt understand. Which baremetal guide

Re: Kibana Error

2017-10-25 Thread Syed Hammad Tahir
shutting down. Find the > elastic processes, kill them, and start it up again. > > > On 25 Oct 2017, at 13:15, Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > > Just gave the command but its stuck here. I restart it earleir via ambari > after changing heapsize. Now doing

Re: Snort Installation

2017-10-24 Thread Syed Hammad Tahir
connected snort with external source ? > (Metron Snort ?) > > On Tue, Oct 24, 2017 at 8:27 PM, Nick Allen <n...@nickallen.org> wrote: > >> Take a look at `kafka-console-producer.sh`, which is installed as part of >> Kafka. >> >> On Tue, Oct 24, 2017 at 2

Re: Kibana Error

2017-10-25 Thread Syed Hammad Tahir
com> wrote: > Its a bug reported in metron, > > Look into barematel guide, Turn Red to green Cluster google it. > > On Oct 25, 2017 1:21 PM, "Syed Hammad Tahir" <mscs16...@itu.edu.pk> wrote: > >> SHould I do it from here? If yes then please guide me how to &

Re: Snort Installation

2017-10-23 Thread Syed Hammad Tahir
Hi guys, I tried to add another network interface in order to bridge it to LAN. I tried to do it on virtualbox vm settings and when i did vagrant up after that, there was no bridged interface. Can anyone help me on this? On Sun, Oct 22, 2017 at 11:44 AM, Syed Hammad Tahir <mscs16...@itu.edu