GitHub user ilganeli reopened a pull request:
https://github.com/apache/spark/pull/4708
[SPARK-4655][Core] Split Stage into ShuffleMapStage and ResultStage
subclasses
Hi all - this patch changes the Stage class to an abstract class and
introduces two new classes that extend it: ShuffleMapStage and ResultStage -
with the goal of increasing readability of the DAGScheduler class. Their usage
is updated within DAGScheduler.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ilganeli/spark SPARK-4655
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4708.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4708
----
commit 83494e94ff45e0f275966d405d777d22cb167800
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-20T21:22:18Z
Added new Stage classes
commit cfd6f10d4f30d1940c7dbc61b58af22cfd647980
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-20T21:54:29Z
Updated DAGScheduler to use new ResultStage and ShuffleMapStage classes
commit 96dd161b604dd999448172047519e201e25ed28b
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-20T22:34:54Z
Fixed minor style error
commit 83ed849dbc063d8a6ec3b763932792b092a5a2d3
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-21T03:35:20Z
moved braces for consistency
commit a57dfcd919342e9b06cddc0d7ac7e576cdcdafcd
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-23T06:11:44Z
Added MiMA exclusion to get around binary compatibility check
commit b85c5fe14fdece4769fc98bbedcba80252b325bf
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-23T17:42:02Z
Added minor fixes
commit 6da3a7101c3c8087a9a924b998889eb6e1b3446f
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-23T17:48:33Z
Trailing whitespace
commit 0dacaf3c505181a43db5ad69cc18ecc7cdcf1043
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-23T18:14:07Z
Got rid of stale import
commit c3ae5c231f15e382adbaaaa00d3a912b00cdf6e0
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-23T18:19:09Z
Explicit typing
commit d548cafab4b6f36ee7e9bed696419567f0bc3d94
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-23T18:37:24Z
Formatting fix
commit c9288e2d91ded0efcb6280b18fffae84a9abfba6
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-24T01:14:19Z
More minor formatting and refactoring
commit 1b3471b110d5c8b499c49185560f0f8788850996
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-24T21:59:30Z
Merge remote-tracking branch 'upstream/master' into SPARK-4655
commit 6f1a5db82aadf42211a0fbde651849d2cc9dd71a
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-24T23:00:14Z
Revert "More minor formatting and refactoring"
This reverts commit c9288e2d91ded0efcb6280b18fffae84a9abfba6.
commit 6b43d7b4e94025fdba6263d2627a18cb47414e7d
Author: Ilya Ganelin <[email protected]>
Date: 2015-02-24T23:03:19Z
Got rid of some spaces
commit 2eba262b6e77cfd818b9da59ba25fb506f290f80
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-10T20:22:28Z
Merge remote-tracking branch 'upstream/master' into SPARK-4655
commit 0f0c6245f64d5f4d83faa74be10cf1fa70f2be55
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-17T06:01:55Z
Fixed merge conflict
commit b6257a0727b95dd6a769438183a2290fad20b35c
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-17T06:09:30Z
Update MimaExcludes.scala
commit c755a0998f2de2ab63d51edc6b819dbcfe9f2213
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-17T21:15:06Z
Some more stylistic updates and minor refactoring
commit 02c6981b6b5d241a0e3ff4dc450ad067599df699
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-17T21:15:32Z
Merge branch 'SPARK-4655' of github.com:ilganeli/spark into SPARK-4655
commit 41402adf6f1b0219b5a0f20c11dcf20bbf20b664
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-17T21:42:20Z
Style fixes
commit c6fffbb8bd29eac70e606fabf81a6ad505a112ab
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-17T21:45:01Z
newline
commit 4bff208324c0db54e02b11bae0448bf7926814ab
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-18T13:18:10Z
Minor stylistic fixes
commit 6912c55274cdc33aff561c53c287fc5f57fd8ae5
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-24T17:34:43Z
Resolved merge conflict
commit 3d5cf204e2a6696f6aecaace8c3443fdabbe8506
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-24T18:08:57Z
[SPARK-4655] Moved mima exclude to 1.4
commit a2cb03f8f99b14530d18f8e8edc0b141557e933d
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-24T20:18:37Z
[SPARK-4655] Replaced usages of Nil and eliminated some code reuse
commit c004f621552dd7778f35f98c51f6d09e994c1fba
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-24T20:22:21Z
Update DAGScheduler.scala
Renaming
commit 4ec53ac469865f11c55cff81a7f6ae0b89968c11
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-25T20:05:41Z
Merge remote-tracking branch 'upstream/master' into SPARK-4655
commit e8031d8b9bd5dcc1cfd58259305ad97a939a585f
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-25T20:05:53Z
Minor string fixes
commit 845bc8727246466bdf35caf4243329c6da5fb82c
Author: Ilya Ganelin <[email protected]>
Date: 2015-03-25T20:06:11Z
Merge branch 'SPARK-4655' of github.com:ilganeli/spark into SPARK-4655
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
