[
https://issues.apache.org/jira/browse/SPARK-13069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15141998#comment-15141998
]
Lin Zhao commented on SPARK-13069:
----------------------------------
There also seems to be no way to specify bounded blocking mailbox for
ActorReceiverSupervisor, which would solve this. Only way I can think of is
adding a storeSync to ActorReceiver.
> ActorHelper is not throttled by rate limiter
> --------------------------------------------
>
> Key: SPARK-13069
> URL: https://issues.apache.org/jira/browse/SPARK-13069
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.6.0
> Reporter: Lin Zhao
>
> The rate an actor receiver sends data to spark is not limited by maxRate or
> back pressure. Spark would control how fast it writes the data to block
> manager, but the receiver actor sends events asynchronously and would fill
> out akka mailbox with millions of events until memory runs out.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
