Re: Processors in cluster mode

2016-08-08 Thread Bryan Bende
Hi Manish, This post [1] has an overview of how to distribute data across your NiFi cluster. In general though, NiFi runs the same flow on each node and the data needs to be divided across the nodes appropriately depending on the situation. The only exception to running the same flow on every

Processors in cluster mode

2016-08-08 Thread Manish Gupta 8
Hi, I am running a multi-node NiFi (0.7.0) cluster and trying to implement a streaming ingestion pipeline (@ 200 MB/s at peak and around 30 MB/s at non-peak hours) and routing to different destinations (Kafka, Azure Storage, HDFS). The dataflow will be exposing a TCP port for incoming data and