Repository: spark Updated Branches: refs/heads/branch-2.0 12f00b6ed -> 4fc4eb943
[SPARK-16025][CORE] Document OFF_HEAP storage level in 2.0 This has changed from 1.6, and now stores memory off-heap using spark's off-heap support instead of in tachyon. Author: Eric Liang <[email protected]> Closes #13744 from ericl/spark-16025. (cherry picked from commit 07367533de68817e1e6cf9cf2b056a04dd160c8a) Signed-off-by: Reynold Xin <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4fc4eb94 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/4fc4eb94 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/4fc4eb94 Branch: refs/heads/branch-2.0 Commit: 4fc4eb9434676d6c7be1b0dd8ff1dc67d7d2b308 Parents: 12f00b6 Author: Eric Liang <[email protected]> Authored: Mon Jun 20 21:56:44 2016 -0700 Committer: Reynold Xin <[email protected]> Committed: Mon Jun 20 21:56:49 2016 -0700 ---------------------------------------------------------------------- docs/programming-guide.md | 5 +++++ 1 file changed, 5 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/4fc4eb94/docs/programming-guide.md ---------------------------------------------------------------------- diff --git a/docs/programming-guide.md b/docs/programming-guide.md index 97bcb51..3872aec 100644 --- a/docs/programming-guide.md +++ b/docs/programming-guide.md @@ -1220,6 +1220,11 @@ storage levels is: <td> MEMORY_ONLY_2, MEMORY_AND_DISK_2, etc. </td> <td> Same as the levels above, but replicate each partition on two cluster nodes. </td> </tr> +<tr> + <td> OFF_HEAP (experimental) </td> + <td> Similar to MEMORY_ONLY_SER, but store the data in + <a href="configuration.html#memory-management">off-heap memory</a>. This requires off-heap memory to be enabled. </td> +</tr> </table> **Note:** *In Python, stored objects will always be serialized with the [Pickle](https://docs.python.org/2/library/pickle.html) library, --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
