Dániel Bakai created MINIFICPP-1210:
---------------------------------------

             Summary: Add proper backpressure handling to 
SourceInitiatedSubscriptionListener
                 Key: MINIFICPP-1210
                 URL: https://issues.apache.org/jira/browse/MINIFICPP-1210
             Project: Apache NiFi MiNiFi C++
          Issue Type: Improvement
            Reporter: Dániel Bakai


Currently there is no backpressure handling at all - FlowFiles are just pumped 
out of the processor.

Because of its inherent subscription model, this is not trivial to do. Even if 
we don't create FlowFiles, we would have to hold the incoming data in an 
in-memory queue.

This can probably be solved by generating faults on backpressure and letting 
the sources resubscribe with the saved bookmark at the point of faulting, but 
this is very much untrivial - further parts of the undocumented protocol have 
to be figured out.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to