GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/20161
[SPARK-21525][streaming] Check error code from supervisor RPC.
The code was ignoring the error code from the AddBlock RPC, which
means that a failure to write to the WAL was being ignored by the
receiver, and would lead to the block being acked (in the case of
the Flume receiver) and data potentially lost.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vanzin/spark SPARK-21525
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20161.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20161
----
commit 3175bd6d98d14df6dbdaf95eb1bc05166e6fa8ac
Author: Marcelo Vanzin <vanzin@...>
Date: 2018-01-04T23:25:01Z
[SPARK-21525][streaming] Check error code from supervisor RPC.
The code was ignoring the error code from the AddBlock RPC, which
means that a failure to write to the WAL was being ignored by the
receiver, and would lead to the block being acked (in the case of
the Flume receiver) and data potentially lost.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
