If you don’t send them through the kafka topic, and use nifi to write to hdfs directly, then you will be skipping the enrichment and ES indexing. Is that what you want?
On December 21, 2017 at 06:52:37, Gaurav Bapat (gauravb3...@gmail.com) wrote: Can I send syslogs to HDFS using NiFi without using Kafka Topic? On 21 Dec 2017 5:16 p.m., "zeo...@gmail.com" <zeo...@gmail.com> wrote: > Where did you get the plugin from, and do you have $BRO_SRC set? This > plugin has recently moved, had a release, and became a package. The > documentation you point to is outdated at this point, and updated > documentation is a part of a release that's currently being voted on. > > Please use bro-pkg to install this, or go directly to > https://github.com/apache/metron-bro-plugin-kafka > > Bro dist is definitely in configure, https://github.com/apache/ > metron-bro-plugin-kafka/blob/master/configure#L86 > > Jon > > On Thu, Dec 21, 2017, 00:16 pele_smk <pele...@gmail.com> wrote: > >> I'm following the instructions for building the bro Kafka plugin and I'm >> getting an error with the --bro-dist option does not exist in ./configure >> >> The command: >> ./configure --bro-dist=$BRO_SRC >> >> The instructions I'm following: >> https://metron.apache.org/current-book/metron-sensors/ >> bro-plugin-kafka/index.html >> >> The --enable-sasl option exists in the configure and works fine >> >> ./configure --enable-sasl >> >> >> >> Am I missing something obvious? >> >> Thanks, >> Daniel >> > -- > > Jon >
