Github user junhaoMg commented on the pull request:
https://github.com/apache/spark/pull/9593#issuecomment-155631922
Given an appropriate initial value can make sure the job success in the
first batch, then the backpressure mechanism can work and adjust data receive
rate according to the processing capacity of the system, the receive rate
backpressure mechanism predicted can either greater or smaller than the
initial value, so the spark.streaming.receiver.maxRate is not reasonable as an
initial value.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
