I am using Nifi 2.3.0. I want to use an InvokeHTTP processor to poll a REST endpoint every 30s and get a flowfile from the response containing the payload (it'll be protobuf). I've found that I have to use a GenerateFlowFile as input to InvokeHTTP if I want the output on the Response relationship. I also want to implement exponential backoff under certain conditions, e.g. if I'm getting 500 errors; I'm concerned there because if I'm running GFF every 30s, it'll just keep making the request. I feel like I'm missing something here; is the idea maybe to use backpressure to make sure that only one request can be in the queue at a time? Would appreciate some advice.
Thanks, Dave