GitHub user yufan-liu opened a pull request:
https://github.com/apache/spark/pull/6778
Remove mapOutputTracker in TaskSchedulerImpl
Because TaskSchedulerImpl's mapOutputTracker field is only referenced once
in TaskSetManager.
I think we could remove the mapOutputTracker field in the TaskSchedulerImpl
class.
Instead, we could reference the mapOutputTracker from SparkEnv directly in
TaskSetManager.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yufan-liu/spark master
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6778.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6778
----
commit b45f4d894cc2ad944bbe3c4b522b4a472121196c
Author: åé°å¸ <[email protected]>
Date: 2015-06-12T06:17:28Z
Remove mapOutputTracker reference
The mapOutputTracker reference is used once only in the TaskSetManager.
We could refer the mapOutputTracker directly from SparkEnv in the
TaskSetManager instead of from TaskSchedulerImpl.
commit 435a465d65ab33082d16cfc6b60ffeb919ecd450
Author: åé°å¸ <[email protected]>
Date: 2015-06-12T06:20:30Z
Get mapOutputTracker from SparkEnv
Get mapOutputTracker from SparkEnv directly.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
