Shay Elbaz created SPARK-32578:
----------------------------------
Summary: PageRank not sending the correct values in Pergel
sendMessage
Key: SPARK-32578
URL: https://issues.apache.org/jira/browse/SPARK-32578
Project: Spark
Issue Type: Bug
Components: GraphX
Affects Versions: 3.0.0, 2.4.0, 2.3.0
Reporter: Shay Elbaz
The core sendMessage method is incorrect:
{code:java}
def sendMessage(edge: EdgeTriplet[(Double, Double), Double]) = {
if (edge.srcAttr._2 > tol) {
Iterator((edge.dstId, edge.srcAttr._2 * edge.attr))
// THIS ^
} else {
Iterator.empty
}
}{code}
Instead of sending the source PR value, it sends the PR delta. This is not the
documented behavior, nor a valid PR algorithm AFAIK.
This is a 7 years old code, all versions affected.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
