ijokarumawak commented on issue #3538: NIFI-6385 Add option to penalize waiting FlowFiles URL: https://github.com/apache/nifi/pull/3538#issuecomment-503667484 @markap14 I was wondering if we should penalize the 'wait' relationship, too. But ended up adding a property. The main reason is to avoid unexpected negative performance impact to existing flows. We haven't penalized 'wait' relationship, and I imagine users left 'Penalize Duration' as the default value, which is '30 secs'. And what if we start penalizing it automatically? When a FlowFile arrives at 10:30:30 and its signal is not notified yet, the FlowFile would be penalized. Then even if the signal is notified right after, like 10:30:31, the FlowFile won't be released until 10:31:00. We could enable penalizing by default and write a migration guide to update 'Penalize Duration' to more adequate value, but I thought it will be a bad user experience. Similar to that, not penalizing FlowFiles would provide the best latency to release a FlowFile when its signal arrive(processor works busier, though). And I think the current behavior may be expected in some context, that is, wait for the highest priority FlowFile to be released before any other FlowFiles even if their signal arrives.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
