Re: Getting Syslogs to Metron

2018-01-21 Thread Farrukh Naveed Anjum
Hi Guys, Its seems like we are able to make NIFI connection and data indeed is going through KAFKA Topic yet using CEF Parser (SysLogs) we are unable to create the elastic search index. On Mon, Jan 22, 2018 at 12:32 PM, Farrukh Naveed Anjum < anjum.farr...@gmail.com> wrote: > Hi, Gaurav, > >

Re: Getting Syslogs to Metron

2018-01-21 Thread Farrukh Naveed Anjum
Hi, Gaurav, Did you solved it ? I am also following same usecase for SysLog using UDP (Rsyslogs) It seems like data is coming to KAFKA Topic. As you can see its showing up. But Elasticsearch index is not created. On Tue, Jan 16, 2018 at 12:37 PM, Gaurav Bapat wrote:

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
But I cant find how to configure it On 16 January 2018 at 11:38, Farrukh Naveed Anjum wrote: > yes, do configure it as per metron reference usecase > > On Tue, Jan 16, 2018 at 8:35 AM, Gaurav Bapat > wrote: > >> Hi Kyle, >> >> I saw that I can

Re: Getting Syslogs to Metron

2018-01-15 Thread Farrukh Naveed Anjum
yes, do configure it as per metron reference usecase On Tue, Jan 16, 2018 at 8:35 AM, Gaurav Bapat wrote: > Hi Kyle, > > I saw that I can ping from my OS to VM and from VM to OS. Looks like this > is some Kafka or Zookeeper environment variables setup issue, do I need to

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
Hi Kyle, I saw that I can ping from my OS to VM and from VM to OS. Looks like this is some Kafka or Zookeeper environment variables setup issue, do I need to configure that in vagrant ssh? On 16 January 2018 at 08:59, Gaurav Bapat wrote: > Hey Kyle, > > I am running NiFi

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
Hey Laurens, My kafka processor says "Failed while waiting for acks from Kafka" On 15 January 2018 at 21:00, Laurens Vets wrote: > Hi Gaurav, > > If you click on the red squares in the upper right corners of your > processors, what error messages do you see? > > On

Re: Getting Syslogs to Metron

2018-01-15 Thread Kyle Richardson
It looks like your Nifi instance is running on your laptop/desktop (e.g. the VM host). My guess would be that name resolution or networking is not properly configured between the host and the guest preventing the data from getting from Nifi to Kafka. What's the contents of /etc/hosts on the VM

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
Hi Farrukh, I cant find any folder by my topic On 15 January 2018 at 16:33, Farrukh Naveed Anjum wrote: > Can you check /kafaka-logs on your VM box (It should have a folder named > your topic). Can you check if it is there ? > > On Mon, Jan 15, 2018 at 3:49 PM, Gaurav

Re: Getting Syslogs to Metron

2018-01-15 Thread Farrukh Naveed Anjum
Can you check /kafaka-logs on your VM box (It should have a folder named your topic). Can you check if it is there ? On Mon, Jan 15, 2018 at 3:49 PM, Gaurav Bapat wrote: > I am not getting data into my Kafka topic > > I have used i5 4 Core Processor with 16 GB RAM and I

Re: Getting Syslogs to Metron

2018-01-15 Thread Farrukh Naveed Anjum
Can you tell me is your KAFKA Topic getting data ? What are you machine specifications ? On Mon, Jan 15, 2018 at 2:56 PM, Gaurav Bapat wrote: > Thanks Farrukh, > > I am not getting data in my kafka topic even after creating one, the issue > seems to be with broker

Re: Getting Syslogs to Metron

2018-01-15 Thread Gaurav Bapat
Thanks Farrukh, I am not getting data in my kafka topic even after creating one, the issue seems to be with broker config, how to configure Kafka and Zookeeper port? On 15 January 2018 at 13:23, Farrukh Naveed Anjum wrote: > Hi, > > I had similar issue it turned out to

Getting Syslogs to Metron

2018-01-10 Thread Gaurav Bapat
Hello everyone, I have deployed Metron on a single node machine and I would like to know how do I get Syslogs from NiFi into Kibana dashboard? I have created a Kafka topic by the name "cef" and I can see that the topic exists in Metron Configuration but I am unable to connect it with Kibana Need