spark.streaming.receiver.maxRate is per receiver. You should multiply with
number of receivers with max rate.
On Mon, Sep 19, 2016 at 9:31 AM, Aravindh [via Apache Spark User List] <
> I am trying to throttle my spark cluster reading events from kinesis by
> setting spark.streaming.receiver.maxRate to 100. The batch interval is 1
> second. But spark seems to read thousands of events for every second. Am I
> missing anything here?
> If you reply to this email, your message will be added to the discussion
> To start a new topic under Apache Spark User List, email
> To unsubscribe from Apache Spark User List, click here
View this message in context:
Sent from the Apache Spark User List mailing list archive at Nabble.com.