Re: Snort logs flow issue

2019-04-09 Thread Hema malini
typo. Can you please help with the required >>>>>>> configuration. >>>>>>> >>>>>>> On Sat, Apr 6, 2019, 5:39 PM Hema malini >>>>>>> wrote: >>>>>>> >>>>>>>> Are we mis

Re: Snort logs flow issue

2019-04-09 Thread Michael Miklavcic
;>>>>> >>>>>> On Sat, Apr 6, 2019, 5:39 PM Hema malini >>>>>> wrote: >>>>>> >>>>>>> Are we missing any configuration? Initially elastic search was down. >>>>>>> We figured out the issue and fixed it .Now elast

Re: Snort logs flow issue

2019-04-09 Thread Hema malini
rom:* Hema malini [mailto:nhemamalin...@gmail.com] > *Sent:* Tuesday, April 09, 2019 09:42 > *To:* user@metron.apache.org > *Subject:* Re: Snort logs flow issue > > > > Hi Michael, > > > > Sorry just noticed the error in metron rest logs - Table 'user settings' &

RE: Snort logs flow issue

2019-04-09 Thread stephane.davy
Hello Hema, Unless I’m wrong, this must be setup in MySQL, the database you use for Metron REST. From: Hema malini [mailto:nhemamalin...@gmail.com] Sent: Tuesday, April 09, 2019 09:42 To: user@metron.apache.org Subject: Re: Snort logs flow issue Hi Michael, Sorry just noticed the error

Re: Snort logs flow issue

2019-04-09 Thread Hema malini
out the issue and fixed it .Now elastic search is up . We >>>>> restarted metron indexing but still those indices not created. So we >>>>> created it manually.Do we have to change any parser configuration . How >>>>> logs will flow into metron alert

Re: Snort logs flow issue

2019-04-09 Thread Hema malini
alerts dashboard and kibana dashboard..what is the required >>>> congratulation >>>> >>>> On Fri, Apr 5, 2019, 11:52 PM Hema malini >>>> wrote: >>>> >>>>> Sample messages flown in indexing topic >>>>> {"

Re: Snort logs flow issue

2019-04-08 Thread Michael Miklavcic
gt; congratulation >>> >>> On Fri, Apr 5, 2019, 11:52 PM Hema malini >>> wrote: >>> >>>> Sample messages flown in indexing topic >>>> {"msg":"'snort test alert'","parallelenricher.splitter.end.ts":" >

Re: Snort logs flow issue

2019-04-08 Thread Hema malini
a malini >> wrote: >> >>> Sample messages flown in indexing topic >>> {"msg":"'snort test alert'","parallelenricher.splitter.end.ts":" >>> 1554384505264","sig_rev":"0","ip_d

Re: Snort logs flow issue

2019-04-06 Thread Hema malini
t; >> Sample messages flown in indexing topic >> {"msg":"'snort test alert'","parallelenricher.splitter.end.ts":" >> 1554384505264","sig_rev":"0","ip_dst_port":"50183","ethsrc":

Re: Snort logs flow issue

2019-04-06 Thread Hema malini
into metron alerts dashboard and kibana dashboard..what is the required congratulation On Fri, Apr 5, 2019, 11:52 PM Hema malini wrote: > Sample messages flown in indexing topic > {"msg":"'snort test alert'","parallelenricher.splitter.end.ts":" > 15543

Re: Snort logs flow issue

2019-04-05 Thread Hema malini
Sample messages flown in indexing topic {"msg":"'snort test alert'","parallelenricher.splitter.end.ts":" 1554384505264","sig_rev":"0","ip_dst_port":"50183","ethsrc": "08:00:27:E8:B0:7A","thr

Re: Snort logs flow issue

2019-04-05 Thread Hema malini
gt; How did you validate the logs are making it to the indexing topology? >>> >>> On Fri, Apr 5, 2019 at 8:12 AM Hema malini >>> wrote: >>> >>>> >>>> Hi, >>>> >>>> >>>> >>>> We have installed Metron 0.7.1

Re: Snort logs flow issue

2019-04-05 Thread Michael Miklavcic
gt;>> >>> Hi, >>> >>> >>> >>> We have installed Metron 0.7.1 in centos 7 using Amabari.Using Nifi we >>> sent the sample snort logs copied from metron git repo to snort kafka >>> topic.We did the same for bro topic.Logs are getting

Re: Snort logs flow issue

2019-04-05 Thread Hema malini
t; >> >> We have installed Metron 0.7.1 in centos 7 using Amabari.Using Nifi we >> sent the sample snort logs copied from metron git repo to snort kafka >> topic.We did the same for bro topic.Logs are getting parsed and reached >> indexing topology . Elastic search indi

Re: Snort logs flow issue

2019-04-05 Thread Michael Miklavcic
How did you validate the logs are making it to the indexing topology? On Fri, Apr 5, 2019 at 8:12 AM Hema malini wrote: > > Hi, > > > > We have installed Metron 0.7.1 in centos 7 using Amabari.Using Nifi we > sent the sample snort logs copied from metron git repo to snort

Snort logs flow issue

2019-04-05 Thread Hema malini
Hi, We have installed Metron 0.7.1 in centos 7 using Amabari.Using Nifi we sent the sample snort logs copied from metron git repo to snort kafka topic.We did the same for bro topic.Logs are getting parsed and reached indexing topology . Elastic search indices are not getting created though we

Re: Parser Error while Snort IDS usage

2018-06-28 Thread Farrukh Naveed Anjum
Thanks, I resolved it by allowing the config show_year in snort.conf file and the snort parser date format configurations. On Thu, Jun 28, 2018 at 7:06 PM, Otto Fowler wrote: > Forgot to put the default format in. It is : private static String > defaultDateFormat > =

Parser Error while Snort IDS usage

2018-06-28 Thread Farrukh Naveed Anjum
Hi, I am getting following errors when I am using snort in IDS mode. java.lang.IllegalStateException: Unable to parse message: 06/28-02:06:18.667820 ,1,384,5,"ICMP PING",ICMP,92.222.186.1,,158.69.118.104,,00:FF:FF:FF:FF:FD,0C:C4:7A:79:83:7C,0x3C,,10,8,1,32,32768,8

Re: Snort enrichment issue

2017-11-17 Thread Syed Hammad Tahir
t a bit messy >> >> Ok, Now I have started everything again from scratch (redeployed single >> node based ambari metron cluster with ansibleSkipTags = 'quick-dev') and >> now when I execute this command: >> >> shuf -n 10 snort.out | sed -e "s/[^,]\+ ,/`date

Re: Snort enrichment issue

2017-11-17 Thread Syed Hammad Tahir
,/g" | > /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh > --broker-list node1:6667 --topic snort > > (format of ths command was taken from: https://github.com/apach > e/metron/blob/master/metron-deployment/roles/sensor-stubs/ > templates/start-snort-stub) > &g

Re: Snort enrichment issue

2017-11-17 Thread Simon Elliston Ball
node > based ambari metron cluster with ansibleSkipTags = 'quick-dev') and now when > I execute this command: > > shuf -n 10 snort.out | sed -e "s/[^,]\+ ,/`date > +'%m\/%d\/%y-%H:%M:%S'`.00 ,/g" | > /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh

Re: Snort Logs

2017-11-13 Thread Syed Hammad Tahir
t;zeo...@gmail.com> >>>> wrote: >>>> >>>>> What is the output of: >>>>> >>>>> /usr/metron/0.4.1/bin/zk_load_configs.sh -z node1:2181 -m DUMP >>>>> >>>>> ? >>>>> >>>>>

Re: Snort Logs

2017-11-12 Thread Syed Hammad Tahir
gt;> /usr/metron/0.4.1/bin/zk_load_configs.sh -z node1:2181 -m DUMP >>> >>> ? >>> >>> Jon >>> >>> On Wed, Nov 8, 2017 at 1:49 PM Syed Hammad Tahir <mscs16...@itu.edu.pk> >>> wrote: >>> >>>> This is the script

Re: Snort Logs

2017-11-08 Thread Syed Hammad Tahir
P > > ? > > Jon > > On Wed, Nov 8, 2017 at 1:49 PM Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> This is the script/command i used >> >> sudo cat snort.out | >> /usr/hdp/current/kafka-broker/bin/kafka-console-producer.sh >> --broker-list

Re: Snort Logs

2017-11-05 Thread Syed Hammad Tahir
gt; Jon > > On Fri, Nov 3, 2017 at 12:19 PM Syed Hammad Tahir <mscs16...@itu.edu.pk> > wrote: > >> >> -- Forwarded message -- >> From: Syed Hammad Tahir <mscs16...@itu.edu.pk> >> Date: Fri, Nov 3, 2017 at 5:07 PM >> Subject: Re:

Re: Snort Logs

2017-11-03 Thread Otto Fowler
You can install it into the chrome web browser from the play store. On November 3, 2017 at 07:47:47, Syed Hammad Tahir (mscs16...@itu.edu.pk) wrote: And how do I install elasticsearch head on the vagrant VM?

Re: Snort Logs

2017-11-03 Thread Syed Hammad Tahir
And how do I install elasticsearch head on the vagrant VM?

Re: Snort Logs

2017-10-30 Thread zeo...@gmail.com
They need to meet the format of the logs I sent earlier. Look into the snort output options - may require you rerun snort, depending on your situation Jon On Mon, Oct 30, 2017, 06:53 Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > Yes, I have converted them to text but those logs a

Re: Snort Logs

2017-10-30 Thread Syed Hammad Tahir
Yes, I have converted them to text but those logs are simply captured packet headers over the local network. Now I just push them via that kafka producer command under topic name of snort and they will be visible in metron? On Mon, Oct 30, 2017 at 2:41 PM, zeo...@gmail.com <zeo...@gmail.

Re: Snort Logs

2017-10-30 Thread zeo...@gmail.com
> wrote: > >> On the 25th I said: >> >> It should be in /usr/hdp/current/kafka-broker/bin/ or similar (from >> memory) on node1, assuming you are running full dev. >> >> Jon >> >> >> Jon >> >> On Fri, Oct 27, 2017 at 6

Re: Snort Installation

2017-10-24 Thread Syed Hammad Tahir
All I did was install snort separately on vagrant ssh console. The ran it to collect logs. Now I need to bring those logs to metron. On Wed, Oct 25, 2017 at 9:50 AM, Farrukh Naveed Anjum < anjum.farr...@gmail.com> wrote: > Hi Syed Hammed, > > Can you share the steps how did you

Re: Snort Installation

2017-10-24 Thread Nick Allen
Take a look at `kafka-console-producer.sh`, which is installed as part of Kafka. On Tue, Oct 24, 2017 at 2:11 AM, Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > Ok, I have fixed everything on my own. Now that I have snort logs saved in > a file, I need to get them to metron. Can

Re: Snort Installation

2017-10-23 Thread Syed Hammad Tahir
yes nut I am a bit confused here. Let me ask them as well then. On Mon, Oct 23, 2017 at 3:35 PM, zeo...@gmail.com <zeo...@gmail.com> wrote: > Hi Syed, > > Just to clarify, this a snort issue you are having? If so I suggest > looking at their documentation (https://s

Re: Snort Installation

2017-10-23 Thread zeo...@gmail.com
Hi Syed, Just to clarify, this a snort issue you are having? If so I suggest looking at their documentation (https://snort.org/documents) or reaching out to their community (https://snort.org/community), as they have more expertise in this area. Jon On Mon, Oct 23, 2017, 03:52 Syed Hammad

Re: Snort Installation

2017-10-23 Thread Syed Hammad Tahir
.pk> wrote: > Ok, thankyou. I will let you know once I make snort sniff the traffic in > the given configuration, might be helpful for others. I will then try to do > that kafka topic and will ask if any help is needed. > > On Sun, Oct 22, 2017 at 6:10 AM, Laurens Vets <

Re: Snort

2017-10-19 Thread Syed Hammad Tahir
t; wrote: >> >>> I did what this guide said to install the original sensor: >>> https://github.com/apache/metron/tree/master/metron-deployme >>> nt/roles/sensor-stubs >>> >>> Still didnt work. How do I install snort into this? >>&g

Re: Snort

2017-10-17 Thread Syed Hammad Tahir
I am so noob in all of this. I am using full-dev vm metron install to do my research. So I have 2 options to install snort: as per my understanding 1- Install it in a usual way (like that on a regular linux machine) and then make its kafka topic 2- Use ansible role to do all of that. Read

Re: Snort

2017-10-17 Thread Nick Allen
No special commands. Install and configure Snort however you like and get those logs into a Kafka topic. Metron is completely agnostic to how sensor telemetry lands in Kafka. We also have an Ansible role that will install Snort along with a simple mechanism to transport its logs to Kafka

Re: Snort

2017-10-17 Thread Syed Hammad Tahir
Ok, Now I get it. Now should I install snort in vagrant ssh in the normal way snort is usually install on a linux distro or do I need to run some special commands again? On Tue, Oct 17, 2017 at 7:45 PM, Nick Allen <n...@nickallen.org> wrote: > In the Full Dev environment, Snort is not

Re: Snort

2017-10-17 Thread Nick Allen
In the Full Dev environment, Snort is not installed. We install "Sensor Stubs" which is just a mechanism that continually replays canned telemetry logs repetitively to mimic real sensors. We have to do this because of resource constraints when running all of Metron on a singl

Re: Snort

2017-10-17 Thread Syed Hammad Tahir
yes,, but when i do snort -v in vagrant ssh console it says snort isnt installed where as it can be seen working in metron. Due to that reason I am confused because James Sirota said to install snort. On Tue, Oct 17, 2017 at 7:05 PM, Nick Allen <n...@nickallen.org> wrote: > From

Re: Snort

2017-10-17 Thread Nick Allen
>From Metron's perspective, Snort is just another sensor. Snort is installed, managed and executed completely independent of Metron itself. As with any sensor, you are responsible for getting the telemetry produced by Snort into Kafka. Metron can then consume that telemetry from Kafka and

Re: Snort

2017-10-17 Thread Syed Hammad Tahir
And I am sorry about one confusion but isnt snort builtin into the metron framework? If so then cant we access that snort and do the tasks you mentioned earlier? On Tue, Oct 17, 2017 at 11:39 AM, Syed Hammad Tahir <mscs16...@itu.edu.pk> wrote: > Hi, > > Thanks for t

Re: Snort

2017-10-16 Thread James Sirota
What I mean is that you should install snort, load the appropriate Snort rules for your use case, set Snort to log to a directory, and send traffic to the network interface where Snort is listening. That will produce Snort log files. Then you can push the contents of Snort logs either to Kafka

Re: Snort

2017-10-12 Thread Syed Hammad Tahir
You mean that I must start snort from terminal by doing snort -v and then push it to kafka topic? I need to start snort in packet capture mode. On Tue, Oct 10, 2017 at 9:52 PM, James Sirota <jsir...@apache.org> wrote: > Yes, you can use Snort. Metron can consume Snort teleme

Suricata support for snort parsers

2017-04-25 Thread Ian Abreu
Hello, In the info discovery phase, and I'm just curious if anyone has tried/had any problems with leveraging existing snort parsers for suricata logs. Cheers, Ian 'z0r0' Abreu