[
https://issues.apache.org/jira/browse/SPARK-2991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14715417#comment-14715417
]
Erik Erlandson commented on SPARK-2991:
---------------------------------------
This RFE now has a [pull-req|https://github.com/willb/silex/pull/28] against
the 3rd-party [silex|https://github.com/willb/silex] library:
https://github.com/willb/silex/pull/28
> RDD transforms for scan and scanLeft
> -------------------------------------
>
> Key: SPARK-2991
> URL: https://issues.apache.org/jira/browse/SPARK-2991
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core
> Reporter: Erik Erlandson
> Assignee: Erik Erlandson
> Priority: Minor
> Labels: features
>
> Provide RDD transforms analogous to Scala scan(z)(f) (parallel prefix scan)
> and scanLeft(z)(f) (sequential prefix scan)
> Discussion of a scanLeft implementation:
> http://erikerlandson.github.io/blog/2014/08/09/implementing-an-rdd-scanleft-transform-with-cascade-rdds/
> Discussion of scan:
> http://erikerlandson.github.io/blog/2014/08/12/implementing-parallel-prefix-scan-as-a-spark-rdd-transform/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
