[
https://issues.apache.org/jira/browse/SPARK-13069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15141992#comment-15141992
]
Lin Zhao commented on SPARK-13069:
----------------------------------
I haven't tested with the master code but looking at the source it almost
certain has the same issue.
> ActorHelper is not throttled by rate limiter
> --------------------------------------------
>
> Key: SPARK-13069
> URL: https://issues.apache.org/jira/browse/SPARK-13069
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Affects Versions: 1.6.0
> Reporter: Lin Zhao
>
> The rate an actor receiver sends data to spark is not limited by maxRate or
> back pressure. Spark would control how fast it writes the data to block
> manager, but the receiver actor sends events asynchronously and would fill
> out akka mailbox with millions of events until memory runs out.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
