Repository: spark Updated Branches: refs/heads/branch-2.0 1bce96db5 -> 0c721eedc
[SPARK-15740][MLLIB] ignore big model load / save in Word2VecSuite ## What changes were proposed in this pull request? andrewor14 noticed some OOM errors caused by "test big model load / save" in Word2VecSuite, e.g., https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test/job/spark-master-test-maven-hadoop-2.2/1168/consoleFull. It doesn't show up in the test result because it was OOMed. This PR disables the test. I will leave the JIRA open for a proper fix ## How was this patch tested? No new features. Author: Xiangrui Meng <m...@databricks.com> Closes #13478 from mengxr/SPARK-15740. (cherry picked from commit e23370ec617c527ffa3a1f7d285ee2c4ffc51b77) Signed-off-by: Andrew Or <and...@databricks.com> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0c721eed Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/0c721eed Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0c721eed Branch: refs/heads/branch-2.0 Commit: 0c721eedcc8a20092e3867c4eacb1341c4cb1831 Parents: 1bce96d Author: Xiangrui Meng <m...@databricks.com> Authored: Thu Jun 2 17:41:31 2016 -0700 Committer: Andrew Or <and...@databricks.com> Committed: Thu Jun 2 17:41:39 2016 -0700 ---------------------------------------------------------------------- .../test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/0c721eed/mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala ---------------------------------------------------------------------- diff --git a/mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala b/mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala index 6d69944..c9fb976 100644 --- a/mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala +++ b/mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala @@ -91,7 +91,7 @@ class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext { } - test("big model load / save") { + ignore("big model load / save") { // create a model bigger than 32MB since 9000 * 1000 * 4 > 2^25 val word2VecMap = Map((0 to 9000).map(i => s"$i" -> Array.fill(1000)(0.1f)): _*) val model = new Word2VecModel(word2VecMap) --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
