[
https://issues.apache.org/jira/browse/FLINK-3997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Flink Jira Bot updated FLINK-3997:
----------------------------------
Labels: auto-deprioritized-major auto-deprioritized-minor auto-unassigned
(was: auto-deprioritized-major auto-unassigned stale-minor)
Priority: Not a Priority (was: Minor)
This issue was labeled "stale-minor" 7 days ago and has not received any
updates so it is being deprioritized. If this ticket is actually Minor, please
raise the priority and ask a committer to assign you the issue or revive the
public discussion.
> PRNG Skip-ahead
> ---------------
>
> Key: FLINK-3997
> URL: https://issues.apache.org/jira/browse/FLINK-3997
> Project: Flink
> Issue Type: Improvement
> Components: Library / Graph Processing (Gelly)
> Affects Versions: 1.1.0
> Reporter: Greg Hogan
> Priority: Not a Priority
> Labels: auto-deprioritized-major, auto-deprioritized-minor,
> auto-unassigned
>
> The current sources of randomness for Gelly Graph Generators use fixed-size
> blocks of work which include an initial seed. There are two issues with this
> approach. First, the size of the collection of blocks can exceed the Akka
> limit and cause the job to silently fail. Second, as the block seeds are
> randomly chosen, the likelihood of blocks overlapping and producing the same
> sequence increases with the size of the graph.
> The random generators will be reimplemented using {{SplittableIterator}} and
> PRNGs supporting skip-ahead.
> This ticket will implement skip-ahead with LCGs [0]. Future work may add
> support for xorshift generators ([1], section 5 "Jumping Ahead").
> [0]
> https://mit-crpg.github.io/openmc/methods/random_numbers.html#skip-ahead-capability
> [1] https://arxiv.org/pdf/1404.0390.pdf
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
