Update documentation for externalSorting
Project: http://git-wip-us.apache.org/repos/asf/incubator-spark/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-spark/commit/2e393cd5 Tree: http://git-wip-us.apache.org/repos/asf/incubator-spark/tree/2e393cd5 Diff: http://git-wip-us.apache.org/repos/asf/incubator-spark/diff/2e393cd5 Branch: refs/heads/master Commit: 2e393cd5fdfbf3a85fced370b5c42315e86dad49 Parents: e4c51d2 Author: Andrew Or <andrewo...@gmail.com> Authored: Fri Jan 10 15:45:38 2014 -0800 Committer: Andrew Or <andrewo...@gmail.com> Committed: Fri Jan 10 15:45:38 2014 -0800 ---------------------------------------------------------------------- docs/configuration.md | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-spark/blob/2e393cd5/docs/configuration.md ---------------------------------------------------------------------- diff --git a/docs/configuration.md b/docs/configuration.md index c115849..40a57c4 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -391,9 +391,8 @@ Apart from these, the following properties are also available, and may be useful <td>spark.shuffle.externalSorting</td> <td>true</td> <td> - If set to "true", spills in-memory maps used for shuffles to disk when a memory threshold is reached. This - threshold is specified by <code>spark.shuffle.memoryFraction</code>. Enable this especially for memory-intensive - applications. + If set to "true", limits the amount of memory used during reduces by spilling data out to disk. This spilling + threshold is specified by <code>spark.shuffle.memoryFraction</code>. </td> </tr> <tr>
