Github user shijinkui commented on the pull request:
https://github.com/apache/spark/pull/3866#issuecomment-68974660
@ankurdave
Solution 1 is better. It have to add `joinVertices ` for reset
`isAttrChanged` to default value.
It have two problem having no idea for solving:
1. Progressive increase one second every iteration.
We can't accept one second progressive increased, because after 600th
iteration, the extra cost will become 600s. It like this:
iteration | increace | cost
------------ | ------------- | ------------
100 | 1 | 150
101 | 1 | 151
102 | 1 | 152
103 | 1 | 153
104 | 1 | 154
.. | 1 | ..
700 | 1 | 850
701 | 1 | 851
703 | 1 | 852
704 | 1 | 853
2 `joinVertices`
`joinVertices` will own half cost of the whole `Pregel-liked` cost.
The more iteration the bigger of `joinVertices`. It's a linear increase.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]