[
https://issues.apache.org/jira/browse/TINKERPOP-705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Stephen Mallette closed TINKERPOP-705.
--------------------------------------
Resolution: Won't Do
For 3.5.0 and TINKERPOP-2076 we've upgraded to Spark 3.0 and refactored against
the latest accumulator APIs. As that's all working well on that branch at the
moment, I don't think we'll make any additional changes there.
> Make use of a MemoryRDD instead of Accumulators in SparkGraphComputer?
> ----------------------------------------------------------------------
>
> Key: TINKERPOP-705
> URL: https://issues.apache.org/jira/browse/TINKERPOP-705
> Project: TinkerPop
> Issue Type: Improvement
> Components: hadoop
> Affects Versions: 3.0.2-incubating
> Reporter: Marko A. Rodriguez
> Priority: Major
>
> The current problem with accumulators in Spark is that they must be in an
> action, not midway in an RDD computation. A {{MemoryRDD}} can simulate such
> aggregation. Think it through and see if makes sense for SparkGraphComputer.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
