Greg Hogan created FLINK-3997: --------------------------------- Summary: PRNG Skip-ahead Key: FLINK-3997 URL: https://issues.apache.org/jira/browse/FLINK-3997 Project: Flink Issue Type: Improvement Components: Gelly Affects Versions: 1.1.0 Reporter: Greg Hogan Assignee: Greg Hogan
The current sources of randomness for Gelly Graph Generators use fixed-size blocks of work which include an initial seed. There are two issues with this approach. First, the size of the collection of blocks can exceed the Akka limit and cause the job to silently fail. Second, as the block seeds are randomly chosen, the likelihood of blocks overlapping and producing the same sequence increases with the size of the graph. The random generators will be reimplemented using {{SplittableIterator}} and PRNGs supporting skip-ahead. This ticket will implement skip-ahead with LCGs [0]. Future work may add support for xorshift generators ([1], section 5 "Jumping Ahead"). [0] https://mit-crpg.github.io/openmc/methods/random_numbers.html#skip-ahead-capability [1] https://arxiv.org/pdf/1404.0390.pdf -- This message was sent by Atlassian JIRA (v6.3.4#6332)