Wing Yew Poon created SPARK-5485:
------------------------------------
Summary: typo in spark streaming configuration parameter
Key: SPARK-5485
URL: https://issues.apache.org/jira/browse/SPARK-5485
Project: Spark
Issue Type: Bug
Components: Documentation
Affects Versions: 1.2.0
Reporter: Wing Yew Poon
In
https://spark.apache.org/docs/1.2.0/streaming-programming-guide.html#deploying-applications,
under "Requirements", the bullet point on "Configuring write ahead logs" says
"This can be enabled by setting the configuration parameter
spark.streaming.receiver.writeAheadLogs.enable to true."
There is an unfortunate typo in the name of the parameter, which I
copied-and-pasted into my deployment where I was testing it out and seeing data
loss as a result.
The same typo occurs in https://spark.apache.org/docs/1.2.0/configuration.html,
which is even more unfortunate.
Documentation should not have typos like this for configuration parameters. I
later found the correct parameter on
http://databricks.com/blog/2015/01/15/improved-driver-fault-tolerance-and-zero-data-loss-in-spark-streaming.html.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
