Re: DataWorks Summit San Jose

2018-02-07 Thread pele_smk
Hey Jon, Would this be a reasonable place to present examples of apache zeppelin used to answer network security related questions? Daniel On Wed, Feb 7, 2018 at 9:17 AM, zeo...@gmail.com wrote: > Hi All, > > Just a heads up that *the San Jose DataWorks Summit's call for papers is > coming to a

DataWorks Summit San Jose

2018-02-07 Thread zeo...@gmail.com
Hi All, Just a heads up that *the San Jose DataWorks Summit's call for papers is coming to a close soon *(February 9th, in 2 days!). If you are doing anything cool with open source big data and security that you want to talk about, please submit to the Cyber Security track. I'm hoping to attend

Re: elasticsearch template question.

2018-02-07 Thread Laurens Vets
Hi Simon, No particular usecase, I just noticed that this field was indexed differently in elasticsearch between indices and I'm trying to 'rectify' it... My current 'solution' is to ignore this field for now :) Kind regards, Laurens On 2018-02-07 02:47, Simon Elliston Ball wrote: Hi Lauren

Re: No data in HDFS at /apps/metron/indexing/indexed after complete deployment of Full Development VM

2018-02-07 Thread Ryan Merriman
I think you need to go one level deeper, those are directories. Here is what I see in my dev environment: [root@node1 ~]# hdfs dfs -ls /apps/metron/indexing/indexed Found 2 items drwxrwxr-x - storm hadoop 0 2018-02-07 01:20 /apps/metron/indexing/indexed/bro drwxrwxr-x - storm hadoop

Re: CentOS and Ubuntu

2018-02-07 Thread Otto Fowler
The Ubuntu support in Apache Metron is new. Really new. At the moment, developers are not going to be required to test things on Ubuntu when submitting or committing pull requests. Work is also ongoing to get the Ambari install complete. The Ubuntu support should be considered experimental at t

Re: CentOS and Ubuntu

2018-02-07 Thread Simon Elliston Ball
Not particularly. The centos builds seem to be used by more people on dev, probably because they’ve been around for longer, and so are arguably more tested. The area where it’s most likely to be relevant is in the install of repos for ES and potentially the fastcapa pcap probe (don’t quote me on

CentOS and Ubuntu

2018-02-07 Thread Helder Reia
Hey everyone! I am new to Apache Metron and I don't know much about this! Are there any differences on using CentOS or Ubuntu ? I am used to work with Ubuntu but I can look for CentOS if it is easier to use / has advantages ! Thank you for your help! -- Helder Reia ALF-AL TM

Re: elasticsearch template question.

2018-02-07 Thread Simon Elliston Ball
Hi Laurens, In Metron all fields tend to get flattened into an un-nested structure of keys and values. Some of the keys do represent a flattened tree structure (for example our standard enrichment fields). The reason for this is essentially ingest speed for nested documents in lucene based ind

No data in HDFS at /apps/metron/indexing/indexed after complete deployment of Full Development VM

2018-02-07 Thread R K Sharma
Hi, I have deployed Full Development VM on Virtual Box and all services including metron, kafka, storm etc. are started. However, when I check if there is some data written into HDFS ( /apps/metron/indexing/ indexed/yaf|bro|snort ) for any data sources, I don't see any data. Hereby below is