[ 
https://issues.apache.org/jira/browse/SPARK-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14082929#comment-14082929
 ] 

Tathagata Das commented on SPARK-1730:
--------------------------------------

[~hshreedharan] I am closing this JIRA based on our previous conversation. 
SPARK-1729 was done using store(buffer), which returns only after replicating 
the block into multiple executors. So the transaction between Spark and the new 
Flume's Sink in SPARK-1729 succeeds only after data has been replicated. So 
executor failure should not cause data loss.

> Make receiver store data reliably to avoid data-loss on executor failures
> -------------------------------------------------------------------------
>
>                 Key: SPARK-1730
>                 URL: https://issues.apache.org/jira/browse/SPARK-1730
>             Project: Spark
>          Issue Type: Sub-task
>          Components: Streaming
>    Affects Versions: 1.0.0
>            Reporter: Tathagata Das
>            Assignee: Hari Shreedharan
>




--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to