Re: No data in HDFS at /apps/metron/indexing/indexed after complete deployment of Full Development VM

2018-02-12 Thread Michael Miklavcic
MySQL should not have an influence on Kibana On Fri, Feb 9, 2018 at 8:45 AM, zeo...@gmail.com wrote: > Related: The documentation > > should probably be updated to account for METRON-1302. > > O

Re: No data in HDFS at /apps/metron/indexing/indexed after complete deployment of Full Development VM

2018-02-09 Thread zeo...@gmail.com
Related: The documentation should probably be updated to account for METRON-1302. On Fri, Feb 9, 2018 at 8:18 AM R K Sharma wrote: > Thanks Michael... I can see similar information for my setup

Re: No data in HDFS at /apps/metron/indexing/indexed after complete deployment of Full Development VM

2018-02-09 Thread R K Sharma
Thanks Michael... I can see similar information for my setup as well. What I could notice is that MySQL service is not running on my machine Which I think could be an issue for kibana. What's your view ? Regards RK Sharma On Thu, Feb 8, 2018 at 9:11 PM, Michael Miklavcic < michael.miklav...@gmail

Re: No data in HDFS at /apps/metron/indexing/indexed after complete deployment of Full Development VM

2018-02-08 Thread Michael Miklavcic
We now have 2 topologies for indexing - random access and batch. Double check that both are currently running - our full dev environment is pretty full with resources currently. random_access_indexing batch_indexing random_access_indexing is responsible for getting data into Elasticsearch. You can

Re: No data in HDFS at /apps/metron/indexing/indexed after complete deployment of Full Development VM

2018-02-08 Thread R K Sharma
Thanks Ryan...I see some data fro Snort & Bro sensors. Another problem which I have is that there is no information from Kibana dashboard.Do I need to deploy some additional component to populate kibana ? Regards RK Sharma On Wed, Feb 7, 2018 at 3:38 PM, Ryan Merriman wrote: > I think you need

Re: No data in HDFS at /apps/metron/indexing/indexed after complete deployment of Full Development VM

2018-02-07 Thread Ryan Merriman
I think you need to go one level deeper, those are directories. Here is what I see in my dev environment: [root@node1 ~]# hdfs dfs -ls /apps/metron/indexing/indexed Found 2 items drwxrwxr-x - storm hadoop 0 2018-02-07 01:20 /apps/metron/indexing/indexed/bro drwxrwxr-x - storm hadoop

No data in HDFS at /apps/metron/indexing/indexed after complete deployment of Full Development VM

2018-02-07 Thread R K Sharma
Hi, I have deployed Full Development VM on Virtual Box and all services including metron, kafka, storm etc. are started. However, when I check if there is some data written into HDFS ( /apps/metron/indexing/ indexed/yaf|bro|snort ) for any data sources, I don't see any data. Hereby below is