[
https://issues.apache.org/jira/browse/FLINK-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17334322#comment-17334322
]
Flink Jira Bot commented on FLINK-3997:
---------------------------------------
This issue was marked "stale-assigned" and has not received an update in 7
days. It is now automatically unassigned. If you are still working on it, you
can assign it to yourself again. Please also give an update about the status of
the work.
> PRNG Skip-ahead
> ---------------
>
> Key: FLINK-3997
> URL: https://issues.apache.org/jira/browse/FLINK-3997
> Project: Flink
> Issue Type: Improvement
> Components: Library / Graph Processing (Gelly)
> Affects Versions: 1.1.0
> Reporter: Greg Hogan
> Assignee: Greg Hogan
> Priority: Major
> Labels: stale-assigned
>
> The current sources of randomness for Gelly Graph Generators use fixed-size
> blocks of work which include an initial seed. There are two issues with this
> approach. First, the size of the collection of blocks can exceed the Akka
> limit and cause the job to silently fail. Second, as the block seeds are
> randomly chosen, the likelihood of blocks overlapping and producing the same
> sequence increases with the size of the graph.
> The random generators will be reimplemented using {{SplittableIterator}} and
> PRNGs supporting skip-ahead.
> This ticket will implement skip-ahead with LCGs [0]. Future work may add
> support for xorshift generators ([1], section 5 "Jumping Ahead").
> [0]
> https://mit-crpg.github.io/openmc/methods/random_numbers.html#skip-ahead-capability
> [1] https://arxiv.org/pdf/1404.0390.pdf
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
