Github user wesolowskim commented on the issue:
https://github.com/apache/spark/pull/14137
I removed counts at the end of outside loop. I added it before because
without it I still encountered problems, but I guess something else must have
been wrong. I reasoned that despite the fact that sccGraph is persisted it can
be evicted before it is used again. It was quite strange, because it doesn't
happen much between sccGraph reuse and this additional counts. I tested it once
again and it works with current version.
I added change that saves some computing time in some cases - if while loop
leaves because iter>maxIter Pregels are useless.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
