spark git commit: [SPARK-21663][TESTS] test("remote fetch below max RPC message size") should call masterTracker.stop() in MapOutputTrackerSuite
Repository: spark
Updated Branches:
refs/heads/master b35660dd0 -> 6426adffa
[SPARK-21663][TESTS] test("remote fetch below max RPC message size") should
call masterTracker.stop() in MapOutputTrackerSuite
Signed-off-by: 10087686
## What changes were proposed in this pull request?
After Unit tests endï¼there should be call masterTracker.stop() to free
resource;
(Please fill in changes proposed in this fix)
## How was this patch tested?
Run Unit tests;
(Please explain how this patch was tested. E.g. unit tests, integration tests,
manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
Please review http://spark.apache.org/contributing.html before opening a pull
request.
Author: 10087686
Closes #18867 from wangjiaochun/mapout.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6426adff
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/6426adff
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/6426adff
Branch: refs/heads/master
Commit: 6426adffaf152651c30d481bb925d5025fd6130a
Parents: b35660d
Author: 10087686
Authored: Wed Aug 9 18:45:38 2017 +0800
Committer: Wenchen Fan
Committed: Wed Aug 9 18:45:38 2017 +0800
--
.../src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala | 5 +++--
1 file changed, 3 insertions(+), 2 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/spark/blob/6426adff/core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
--
diff --git a/core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
b/core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
index bc3d23e..493ae51 100644
--- a/core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
+++ b/core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
@@ -176,7 +176,8 @@ class MapOutputTrackerSuite extends SparkFunSuite {
val masterTracker = newTrackerMaster(newConf)
val rpcEnv = createRpcEnv("spark")
val masterEndpoint = new MapOutputTrackerMasterEndpoint(rpcEnv,
masterTracker, newConf)
-rpcEnv.setupEndpoint(MapOutputTracker.ENDPOINT_NAME, masterEndpoint)
+masterTracker.trackerEndpoint =
+ rpcEnv.setupEndpoint(MapOutputTracker.ENDPOINT_NAME, masterEndpoint)
// Message size should be ~123B, and no exception should be thrown
masterTracker.registerShuffle(10, 1)
@@ -191,7 +192,7 @@ class MapOutputTrackerSuite extends SparkFunSuite {
verify(rpcCallContext, timeout(3)).reply(any())
assert(0 == masterTracker.getNumCachedSerializedBroadcast)
-//masterTracker.stop() // this throws an exception
+masterTracker.stop()
rpcEnv.shutdown()
}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
spark git commit: [SPARK-21663][TESTS] test("remote fetch below max RPC message size") should call masterTracker.stop() in MapOutputTrackerSuite
Repository: spark
Updated Branches:
refs/heads/branch-2.2 f6d56d2f1 -> 3ca55eaaf
[SPARK-21663][TESTS] test("remote fetch below max RPC message size") should
call masterTracker.stop() in MapOutputTrackerSuite
Signed-off-by: 10087686
## What changes were proposed in this pull request?
After Unit tests endï¼there should be call masterTracker.stop() to free
resource;
(Please fill in changes proposed in this fix)
## How was this patch tested?
Run Unit tests;
(Please explain how this patch was tested. E.g. unit tests, integration tests,
manual tests)
(If this patch involves UI changes, please attach a screenshot; otherwise,
remove this)
Please review http://spark.apache.org/contributing.html before opening a pull
request.
Author: 10087686
Closes #18867 from wangjiaochun/mapout.
(cherry picked from commit 6426adffaf152651c30d481bb925d5025fd6130a)
Signed-off-by: Wenchen Fan
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/3ca55eaa
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/3ca55eaa
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/3ca55eaa
Branch: refs/heads/branch-2.2
Commit: 3ca55eaafee8f4216eb5466021a97604713033a1
Parents: f6d56d2
Author: 10087686
Authored: Wed Aug 9 18:45:38 2017 +0800
Committer: Wenchen Fan
Committed: Wed Aug 9 18:45:53 2017 +0800
--
.../src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala | 5 +++--
1 file changed, 3 insertions(+), 2 deletions(-)
--
http://git-wip-us.apache.org/repos/asf/spark/blob/3ca55eaa/core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
--
diff --git a/core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
b/core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
index 71bedda..ca94fd1 100644
--- a/core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
+++ b/core/src/test/scala/org/apache/spark/MapOutputTrackerSuite.scala
@@ -175,7 +175,8 @@ class MapOutputTrackerSuite extends SparkFunSuite {
val masterTracker = newTrackerMaster(newConf)
val rpcEnv = createRpcEnv("spark")
val masterEndpoint = new MapOutputTrackerMasterEndpoint(rpcEnv,
masterTracker, newConf)
-rpcEnv.setupEndpoint(MapOutputTracker.ENDPOINT_NAME, masterEndpoint)
+masterTracker.trackerEndpoint =
+ rpcEnv.setupEndpoint(MapOutputTracker.ENDPOINT_NAME, masterEndpoint)
// Message size should be ~123B, and no exception should be thrown
masterTracker.registerShuffle(10, 1)
@@ -190,7 +191,7 @@ class MapOutputTrackerSuite extends SparkFunSuite {
verify(rpcCallContext, timeout(3)).reply(any())
assert(0 == masterTracker.getNumCachedSerializedBroadcast)
-//masterTracker.stop() // this throws an exception
+masterTracker.stop()
rpcEnv.shutdown()
}
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
