datasherlock commented on PR #101: URL: https://github.com/apache/bahir/pull/101#issuecomment-1418648833
Based on https://spark.apache.org/docs/latest/streaming-custom-receivers.html#receiver-reliability, the rate control mechanism will have to be implemented by the receiver (if reliable). I do not see any logic that caps the input rates to the `maxRate` in the code. Could that be the reason why the backpressure limits are not honoured? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
