Re: [EXT] High-performance Nifi decoder

2017-08-24 Thread Ali Nazemian
Hi Peter, It hasn't been finalized yet, but we can configure it to be reasonably low. Basically the higher batch size. In regards to my question, which strategy you think will provide more throughput? Regards, Ali On Wed, Aug 23, 2017 at 6:49 PM, Peter Wicks (pwicks) wrote:

RE: [EXT] High-performance Nifi decoder

2017-08-23 Thread Peter Wicks (pwicks)
Hi Ali, How many FlowFile’s are you expecting per minute? My experience with NiFi has been that if you have 1 FlowFile that is several GB’s in size you can frequently process it faster than 100k FlowFile’s at a fraction the size. There is a lot of overhead in managing the life cycle of a