Re: Question with ExtractText Processor

2017-07-12 Thread Lee Laim
Atish, ExtractText has a setting called Max Buffer Size that defaults to 1 MB, but I don't think this is causing your queue to build up before Extract Text. While I don't know the exact details of your flow, I suggest you try Split Text instead of Split Content, as this is a more commonly used

Re: NiFi Processors show 30 Second Execution time, 0 executions

2017-03-31 Thread Lee Laim
Is it potentially related to yield duration? > On Mar 31, 2017, at 6:58 AM, Peter Wicks (pwicks) wrote: > > channel.

Re: When should MergeContent stop and proceed to next processor?

2017-03-15 Thread Lee Laim
Srini, You should set your merge strategy to "defragment" on the MergeContent processor. This will merge based on the parent record that was split at splitJson. Thanks, Lee On Wed, Mar 15, 2017 at 3:55 PM, srini wrote: > Hi, > I have a subflow like this. From

Re: Merging content with n events with MergeContent / bin packing algorithm

2017-01-25 Thread Lee Laim
Sam, I'll throw out a few options that may help. 1. Split the file of events into groups of 100 first, then split again to single events for transformation. Set the merge strategy to defragment. The merge will wait for the initial 100 events before sending them on. This will guarantee

Re: How to sort contents in a file?

2016-12-12 Thread Lee Laim
Srini, You can also use execute stream command and bypass the PutFile. The Execute Stream command processor triggers on an incoming flowfile and can execute the 'sort' on the contents and output the results to the next processor. This approach keeps everything streaming through memory. Lee

Re: Nifi Capability for Fast transfer of Data

2016-11-25 Thread Lee Laim
Shweta, While this may deviate from your initial requirements, NiFi offers the ability to compress, resize, and extract metadata from your images. You can use NiFi to build a image-processing pipeline for incoming images to prioritize and route ~10% of images data that needs to arrive in 4

Re: Double-click action

2016-10-24 Thread Lee Laim
; already a JIRA for it [1]. Use of double click on the connection is a great > counter point for consistency between the components. > > [1] https://issues.apache.org/jira/browse/NIFI-1580 > > On Mon, Oct 24, 2016 at 10:45 AM, Lee Laim <lee.l...@gmail.com> wrote: > > Don't fo

Re: ExecuteProcess Question

2016-09-27 Thread Lee Laim
Hi Dale, You could also check the permissions on the script. I was able to echo text from a bash script which placed the text in the flowfile content. Thanks, Lee On Tue, Sep 27, 2016 at 6:32 PM, Andy LoPresto wrote: > Hi Dale, > > I just tried to replicate this and