This is an automated email from the ASF dual-hosted git repository.
yamamuro pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 6a2f3dc [SPARK-26732][CORE][TEST] Wait for listener bus to process
events in SparkContextInfoSuite.
6a2f3dc is described below
commit 6a2f3dcc2bd601fd1fe7610854bc0f5bf90300f4
Author: Marcelo Vanzin <[email protected]>
AuthorDate: Thu Jan 31 00:10:23 2019 +0900
[SPARK-26732][CORE][TEST] Wait for listener bus to process events in
SparkContextInfoSuite.
Otherwise the RDD data may be out of date by the time the test tries to
check it.
Tested with an artificial delay inserted in AppStatusListener.
Closes #23654 from vanzin/SPARK-26732.
Authored-by: Marcelo Vanzin <[email protected]>
Signed-off-by: Takeshi Yamamuro <[email protected]>
---
core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala | 1 +
1 file changed, 1 insertion(+)
diff --git a/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
b/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
index 8feb3de..051a13c 100644
--- a/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
+++ b/core/src/test/scala/org/apache/spark/SparkContextInfoSuite.scala
@@ -60,6 +60,7 @@ class SparkContextInfoSuite extends SparkFunSuite with
LocalSparkContext {
val rdd = sc.makeRDD(Array(1, 2, 3, 4), 2).cache()
assert(sc.getRDDStorageInfo.size === 0)
rdd.collect()
+ sc.listenerBus.waitUntilEmpty(10000)
assert(sc.getRDDStorageInfo.size === 1)
assert(sc.getRDDStorageInfo.head.isCached)
assert(sc.getRDDStorageInfo.head.memSize > 0)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]