GitHub user ilganeli opened a pull request:
https://github.com/apache/spark/pull/4022
[SPARK-733] Add documentation on use of accumulators in lazy transformation
I've added documentation clarifying the particular lack of clarity
highlighted in the relevant JIRA. I've also added code examples for this issue
to clarify the explanation.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ilganeli/spark SPARK-733
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4022.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4022
----
commit c64da4fabbd805bf289780bbd3fe0f6aec435957
Author: Ilya Ganelin <[email protected]>
Date: 2015-01-07T21:05:30Z
Partially updated task metrics to make some vars private
commit 5525c2011d96929d6143e24cf1abdd9823a9fe26
Author: Ilya Ganelin <[email protected]>
Date: 2015-01-07T21:25:40Z
Completed refactoring to make vars in TaskMetrics class private
commit 1fd59b27a91d645b15e7c701cedb8bc56fbd987a
Author: Ilya Ganelin <[email protected]>
Date: 2015-01-08T17:08:10Z
Updated documentation for accumulators to highlight lazy evaluation issue
commit 33b5a2d4f0ea354d546fdefb0eaed3330709f3c2
Author: Ilya Ganelin <[email protected]>
Date: 2015-01-08T17:14:32Z
Added code examples for java and python
commit 3a38db1ea96f0b1045f78fb5aa093be302c1ab42
Author: Ilya Ganelin <[email protected]>
Date: 2015-01-09T18:30:55Z
Verified documentation update by building via jekyll
commit 4dc2cdbb9806d01df0f3192469b6e129f4d2de29
Author: Ilya Ganelin <[email protected]>
Date: 2015-01-09T18:31:15Z
Merge remote-tracking branch 'upstream/master' into SPARK-733
commit 58034fb6b867db97bbcd74dea6c9678c3eea2948
Author: Ilya Ganelin <[email protected]>
Date: 2015-01-13T17:45:04Z
Merge remote-tracking branch 'upstream/master' into SPARK-733
commit 3f6c5127b094519be0fe3d7ec99a8654d3a58728
Author: Ilya Ganelin <[email protected]>
Date: 2015-01-13T17:51:03Z
Revert "Completed refactoring to make vars in TaskMetrics class private"
This reverts commit 5525c2011d96929d6143e24cf1abdd9823a9fe26.
commit df3afd7895b97c5280bf28d8c24e543d60775834
Author: Ilya Ganelin <[email protected]>
Date: 2015-01-13T17:51:18Z
Revert "Partially updated task metrics to make some vars private"
This reverts commit c64da4fabbd805bf289780bbd3fe0f6aec435957.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
