context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-GraphX-pregel-like-with-global-variables-accumulator-broadcast-tp12742p12895.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To uns
At 2014-08-26 01:20:09 -0700, BertrandR
wrote:
> I actually tried without unpersisting, but given the performance I tryed to
> add these in order to free the memory. After your anwser I tried to remove
> them again, but without any change in the execution time...
This is probably a related issue
completed.
Is this still related to unpersisting ? I'm mostly a mathematician, and so
I'm not well acquainted with the depth of Spark...
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-GraphX-pregel-like-with-global-variables-accumulato
At 2014-08-25 06:41:36 -0700, BertrandR
wrote:
> Unfortunately, this works well for extremely small graphs, but it becomes
> exponentially slow with the size of the graph and the number of iterations
> (doesn't finish 20 iterations with graphs having 48000 edges).
> [...]
> It seems to me that a
iter = iter + 1
}
}
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-GraphX-pregel-like-with-global-variables-accumulator-broadcast-tp12742.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
