This is an automated email from the ASF dual-hosted git repository.
yamamuro pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 710d81e [SPARK-26732][CORE][TEST] Wait for listener bus to process
events in SparkContextInfoSuite.
710d81e is described below
commit 710d81ea87b5ba0c3d49b3dfbc591129685c2a13
Author: Marcelo Vanzin <van...@cloudera.com>
AuthorDate: Thu Jan 31 00:10:23 2019 +0900
[SPARK-26732][CORE][TEST] Wait for listener bus to process events in
SparkContextInfoSuite.
Otherwise the RDD data may be out of date by the time the test tries to
check it.
Tested with an artificial delay inserted in AppStatusListener.
Closes #23654 from vanzin/SPARK-26732.
Authored-by: Marcelo Vanzin <van...@cloudera.com>
Signed-off-by: Takeshi Yamamuro <yamam...@apache.org>
(cherry picked from commit 6a2f3dcc2bd601fd1fe7610854bc0f5bf90300f4)
Signed-off-by: Takeshi Yamamuro <yamam...@apache.org>
---
core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala | 1 +
1 file changed, 1 insertion(+)
diff --git a/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
b/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
index 8feb3de..051a13c 100644
--- a/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
+++ b/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
@@ -60,6 +60,7 @@ class SparkContextInfoSuite extends SparkFunSuite with
LocalSparkContext {
val rdd = sc.makeRDD(Array(1, 2, 3, 4), 2).cache()
assert(sc.getRDDStorageInfo.size === 0)
rdd.collect()
+ sc.listenerBus.waitUntilEmpty(10000)
assert(sc.getRDDStorageInfo.size === 1)
assert(sc.getRDDStorageInfo.head.isCached)
assert(sc.getRDDStorageInfo.head.memSize > 0)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
