GitHub user kayousterhout opened a pull request:
https://github.com/apache/spark/pull/16876
[SPARK-19537] Move pendingPartitions to ShuffleMapStage.
The pendingPartitions instance variable should be moved to ShuffleMapStage,
because it is only used by ShuffleMapStages. This change is purely
refactoring
and does not change functionality.
I fixed this in an attempt to clarify some of the discussion around #16620,
which I was having trouble reasoning about. I stole the helpful comment Imran
wrote for pendingPartitions and used it here.
cc @squito @markhamstra @jinxing64
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/kayousterhout/spark-1 SPARK-19537
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16876.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16876
----
commit 3e9af42a6238bc786153db41320a5dbc10d917d0
Author: Kay Ousterhout <[email protected]>
Date: 2017-02-09T22:00:18Z
[SPARK-19537] Move pendingPartitions to ShuffleMapStage.
The pendingPartitions instance variable should be moved to ShuffleMapStage,
because it is only used by ShuffleMapStages. This change is purely
refactoring
and does not change functionality.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
