ijokarumawak commented on issue #3538: NIFI-6385 Add option to penalize waiting FlowFiles URL: https://github.com/apache/nifi/pull/3538#issuecomment-503729406 @aramatev Thanks for the explanation. That makes sense. You're right, Penalizing FlowFiles won't help in that case. So, what needed is an ordering mechanism something like 'order by priority attribute grouped by signal id'. That is actually difficult to address at NiFi framework layer such as Prioritizers or Penalization. We need more coding at Wait processor. My idea is: - Add internal state at Wait to track when each signal.id is checked - Add a Wait processor property to specify signal.id re-check duration - Similar to what 'Penalty Duration' does, but not for per FlowFile, but for signal.id unit. This is required because if there are multiple signal.ids, 'aa' and 'bb', then each signal.id has multiple FlowFiles with different priority. When Wait processor checks signal.id 'aa' and found 'aa' is not notified yet, it needs to check 'bb' at the next run - `0 ms` by default - Add FlowFile filtering at Wait processor using above data to decide which signal.id to check I will implement that and update this PR later. Thanks!
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
