Just to provide an update. I did rewrite the same logic in lua and used in
executescript processor. The performance is 5-10x faster compare to jython.
very pleased with performance of lua processor.
Next steps:
will checkout https://issues.apache.org/jira/browse/NIFI-1822 to test multiple
concurr
Thanks Matt and Joe for your input. I will go through your suggestions.
On Mon, May 2, 2016 at 10:16 AM, Matt Burgess wrote:
> Madhu,
>
> In addition to Joe's suggestions, currently ExecuteScript only allows
> for one task at a time, which is currently a pretty bad bottleneck if
> you are dealin
Madhu,
In addition to Joe's suggestions, currently ExecuteScript only allows
for one task at a time, which is currently a pretty bad bottleneck if
you are dealing with lots of throughput. However I have written up a
Jira [1] for this and issued a PR [2] to fix it, feel free to try that
out and/or
Madhu,
My testing showed the jython script performance to be poor as well.
Couple of options to tackle this worth trying:
1) write the script such that it handles multiple flowfiles per
process session (basically batching). This works presuming the
slowness is the setup/teardown of the script exe
Hi
I am using ExecuteScript Processor( using python/jython script pasted
below) to process http querystring along with useragent parsing. The
processor is very slow and not able to handle heavy load. Lot of them of
getting queued and waiting for the processor to process it. How can i
improve the p