Re: ExecuteScript Processor Performance

Just to provide an update. I did rewrite the same logic in lua and used in executescript processor. The performance is 5-10x faster compare to jython. very pleased with performance of lua processor. Next steps: will checkout https://issues.apache.org/jira/browse/NIFI-1822 to test multiple

Re: ExecuteScript Processor Performance

Thanks Matt and Joe for your input. I will go through your suggestions. On Mon, May 2, 2016 at 10:16 AM, Matt Burgess wrote: > Madhu, > > In addition to Joe's suggestions, currently ExecuteScript only allows > for one task at a time, which is currently a pretty bad

Re: ExecuteScript Processor Performance

Madhu, In addition to Joe's suggestions, currently ExecuteScript only allows for one task at a time, which is currently a pretty bad bottleneck if you are dealing with lots of throughput. However I have written up a Jira [1] for this and issued a PR [2] to fix it, feel free to try that out and/or

Re: ExecuteScript Processor Performance

Madhu, My testing showed the jython script performance to be poor as well. Couple of options to tackle this worth trying: 1) write the script such that it handles multiple flowfiles per process session (basically batching). This works presuming the slowness is the setup/teardown of the script

ExecuteScript Processor Performance

Hi I am using ExecuteScript Processor( using python/jython script pasted below) to process http querystring along with useragent parsing. The processor is very slow and not able to handle heavy load. Lot of them of getting queued and waiting for the processor to process it. How can i improve the