Small changes from Matei review
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/1450b8ef Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/1450b8ef Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/1450b8ef Branch: refs/heads/scala-2.10 Commit: 1450b8ef87d65634800941bbaf259d9b4dd6cc3b Parents: b1c6fa1 Author: Patrick Wendell <[email protected]> Authored: Wed Dec 4 18:49:32 2013 -0800 Committer: Patrick Wendell <[email protected]> Committed: Wed Dec 4 18:49:32 2013 -0800 ---------------------------------------------------------------------- docs/configuration.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/1450b8ef/docs/configuration.md ---------------------------------------------------------------------- diff --git a/docs/configuration.md b/docs/configuration.md index 1a3eef3..22abe1c 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -331,7 +331,7 @@ Apart from these, the following properties are also available, and may be useful <td>spark.shuffle.consolidateFiles</td> <td>false</td> <td> - If set to "true", consolidates intermediate files created during a shuffle. + If set to "true", consolidates intermediate files created during a shuffle. Creating fewer files can improve filesystem performance if you run shuffles with large numbers of reduce tasks. </td> </tr> <tr> @@ -346,7 +346,7 @@ Apart from these, the following properties are also available, and may be useful <td>spark.speculation.interval</td> <td>100</td> <td> - How often Spark will check for tasks to speculate, in seconds. + How often Spark will check for tasks to speculate, in milliseconds. </td> </tr> <tr>
