Repository: spark Updated Branches: refs/heads/master f34aadc54 -> e23370ec6
[SPARK-15740][MLLIB] ignore big model load / save in Word2VecSuite ## What changes were proposed in this pull request? andrewor14 noticed some OOM errors caused by "test big model load / save" in Word2VecSuite, e.g., https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test/job/spark-master-test-maven-hadoop-2.2/1168/consoleFull. It doesn't show up in the test result because it was OOMed. This PR disables the test. I will leave the JIRA open for a proper fix ## How was this patch tested? No new features. Author: Xiangrui Meng <[email protected]> Closes #13478 from mengxr/SPARK-15740. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e23370ec Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e23370ec Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e23370ec Branch: refs/heads/master Commit: e23370ec617c527ffa3a1f7d285ee2c4ffc51b77 Parents: f34aadc Author: Xiangrui Meng <[email protected]> Authored: Thu Jun 2 17:41:31 2016 -0700 Committer: Andrew Or <[email protected]> Committed: Thu Jun 2 17:41:31 2016 -0700 ---------------------------------------------------------------------- .../test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/e23370ec/mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala ---------------------------------------------------------------------- diff --git a/mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala b/mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala index 6d69944..c9fb976 100644 --- a/mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala +++ b/mllib/src/test/scala/org/apache/spark/mllib/feature/Word2VecSuite.scala @@ -91,7 +91,7 @@ class Word2VecSuite extends SparkFunSuite with MLlibTestSparkContext { } - test("big model load / save") { + ignore("big model load / save") { // create a model bigger than 32MB since 9000 * 1000 * 4 > 2^25 val word2VecMap = Map((0 to 9000).map(i => s"$i" -> Array.fill(1000)(0.1f)): _*) val model = new Word2VecModel(word2VecMap) --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
