This is an automated email from the ASF dual-hosted git repository.
yamamuro pushed a commit to branch branch-2.3
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.3 by this push:
new f6391e1 [SPARK-26732][CORE][TEST] Wait for listener bus to process
events in SparkContextInfoSuite.
f6391e1 is described below
commit f6391e165b8e4dde8a9636fc220042b38eabd056
Author: Marcelo Vanzin <[email protected]>
AuthorDate: Thu Jan 31 00:10:23 2019 +0900
[SPARK-26732][CORE][TEST] Wait for listener bus to process events in
SparkContextInfoSuite.
Otherwise the RDD data may be out of date by the time the test tries to
check it.
Tested with an artificial delay inserted in AppStatusListener.
Closes #23654 from vanzin/SPARK-26732.
Authored-by: Marcelo Vanzin <[email protected]>
Signed-off-by: Takeshi Yamamuro <[email protected]>
(cherry picked from commit 6a2f3dcc2bd601fd1fe7610854bc0f5bf90300f4)
Signed-off-by: Takeshi Yamamuro <[email protected]>
---
core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala | 1 +
1 file changed, 1 insertion(+)
diff --git a/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
b/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
index 8feb3de..051a13c 100644
--- a/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
+++ b/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
@@ -60,6 +60,7 @@ class SparkContextInfoSuite extends SparkFunSuite with
LocalSparkContext {
val rdd = sc.makeRDD(Array(1, 2, 3, 4), 2).cache()
assert(sc.getRDDStorageInfo.size === 0)
rdd.collect()
+ sc.listenerBus.waitUntilEmpty(10000)
assert(sc.getRDDStorageInfo.size === 1)
assert(sc.getRDDStorageInfo.head.isCached)
assert(sc.getRDDStorageInfo.head.memSize > 0)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
