Repository: spark Updated Branches: refs/heads/branch-1.2 6d23af6a4 -> 78096837c
[SPARK-5131][Streaming][DOC]: There is a discrepancy in WAL implementation and configuration doc. There is a discrepancy in WAL implementation and configuration doc. Author: uncleGen <[email protected]> Closes #3930 from uncleGen/master-clean-doc and squashes the following commits: 3a4245f [uncleGen] doc typo 8e407d3 [uncleGen] doc typo (cherry picked from commit 39e333ec4350ddafe29ee0958c37eec07bec85df) Signed-off-by: Andrew Or <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/78096837 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/78096837 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/78096837 Branch: refs/heads/branch-1.2 Commit: 78096837c85ca41ce4ffa1aca2663b6d0f14d20d Parents: 6d23af6 Author: uncleGen <[email protected]> Authored: Tue Jan 13 10:07:19 2015 -0800 Committer: Andrew Or <[email protected]> Committed: Tue Jan 13 10:07:26 2015 -0800 ---------------------------------------------------------------------- docs/configuration.md | 2 +- docs/streaming-programming-guide.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/78096837/docs/configuration.md ---------------------------------------------------------------------- diff --git a/docs/configuration.md b/docs/configuration.md index 260cdc4..6e9a62c 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -1218,7 +1218,7 @@ Apart from these, the following properties are also available, and may be useful </td> </tr> <tr> - <td><code>spark.streaming.receiver.writeAheadLogs.enable</code></td> + <td><code>spark.streaming.receiver.writeAheadLog.enable</code></td> <td>false</td> <td> Enable write ahead logs for receivers. All the input data received through receivers http://git-wip-us.apache.org/repos/asf/spark/blob/78096837/docs/streaming-programming-guide.md ---------------------------------------------------------------------- diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index 1ac5b9e..1fcc3bc 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -1574,7 +1574,7 @@ To run a Spark Streaming applications, you need to have the following. recovery, thus ensuring zero data loss (discussed in detail in the [Fault-tolerance Semantics](#fault-tolerance-semantics) section). This can be enabled by setting the [configuration parameter](configuration.html#spark-streaming) - `spark.streaming.receiver.writeAheadLogs.enable` to `true`. However, these stronger semantics may + `spark.streaming.receiver.writeAheadLog.enable` to `true`. However, these stronger semantics may come at the cost of the receiving throughput of individual receivers. This can be corrected by running [more receivers in parallel](#level-of-parallelism-in-data-receiving) to increase aggregate throughput. Additionally, it is recommended that the replication of the --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
