Repository: spark Updated Branches: refs/heads/branch-2.0 f35b10ab1 -> bc6c0d9f9
[SPARK-17318][TESTS] Fix ReplSuite replicating blocks of object with class defined in repl ## What changes were proposed in this pull request? There are a lot of failures recently: http://spark-tests.appspot.com/tests/org.apache.spark.repl.ReplSuite/replicating%20blocks%20of%20object%20with%20class%20defined%20in%20repl This PR just changed the persist level to `MEMORY_AND_DISK_2` to avoid blocks being evicted from memory. ## How was this patch tested? Jenkins unit tests. Author: Shixiong Zhu <[email protected]> Closes #14884 from zsxwing/SPARK-17318. (cherry picked from commit 231f973295129dca976f2e4a8222a63318d4aafe) Signed-off-by: Shixiong Zhu <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bc6c0d9f Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/bc6c0d9f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/bc6c0d9f Branch: refs/heads/branch-2.0 Commit: bc6c0d9f96da6a9aaf8279ee4ad11a82bcd69cb5 Parents: f35b10a Author: Shixiong Zhu <[email protected]> Authored: Tue Aug 30 20:04:52 2016 -0700 Committer: Shixiong Zhu <[email protected]> Committed: Tue Aug 30 20:05:06 2016 -0700 ---------------------------------------------------------------------- .../src/test/scala/org/apache/spark/repl/ReplSuite.scala | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/bc6c0d9f/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala ---------------------------------------------------------------------- diff --git a/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala b/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala index 06b09f3..f1284b1 100644 --- a/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala +++ b/repl/scala-2.11/src/test/scala/org/apache/spark/repl/ReplSuite.scala @@ -401,7 +401,7 @@ class ReplSuite extends SparkFunSuite { """ |import org.apache.spark.storage.StorageLevel._ |case class Foo(i: Int) - |val ret = sc.parallelize((1 to 100).map(Foo), 10).persist(MEMORY_ONLY_2) + |val ret = sc.parallelize((1 to 100).map(Foo), 10).persist(MEMORY_AND_DISK_2) |ret.count() |sc.getExecutorStorageStatus.map(s => s.rddBlocksById(ret.id).size).sum """.stripMargin) --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
