[jira] [Created] (SPARK-1400) Spark Streaming's received data is not cleaned up from BlockManagers when not needed any more

[Tathagata Das (JIRA)]

Tathagata Das created SPARK-1400:
------------------------------------

             Summary: Spark Streaming's received data is not cleaned up from 
BlockManagers when not needed any more
                 Key: SPARK-1400
                 URL: https://issues.apache.org/jira/browse/SPARK-1400
             Project: Spark
          Issue Type: Bug
          Components: Streaming
    Affects Versions: 0.9.0
            Reporter: Tathagata Das


Spark Streaming generates BlockRDDs with the data received over the network. 
These data blocks are not automatically cleared, they spill over from memory 
based on LRU, which slows down processing.



--
This message was sent by Atlassian JIRA
(v6.2#6252)