[
https://issues.apache.org/jira/browse/FLINK-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638448#comment-14638448
]
Till Rohrmann commented on FLINK-1901:
--------------------------------------
Currently, whats happening to decide whether an operator is on a dynamic path
or not is to look at the inputs of the operator. If they are dynamic so is the
current operator. The iteration {{DataSets}}, {{WorksetPlaceHolder}},
{{SolutionSetPlaceHolder}} and {{PartialSolutionPlaceHolder}}, are always
dynamic. What could be an idea is to allow other operators also to be declared
dynamic. That way they can also start dynamic path. Afterwards, we have to make
sure that not only the iteration {{DataSets}} get a {{IterationHead}}
prepended, which kicks off the iterations, but also all the other operators
which start a dynamic path.
> Create sample operator for Dataset
> ----------------------------------
>
> Key: FLINK-1901
> URL: https://issues.apache.org/jira/browse/FLINK-1901
> Project: Flink
> Issue Type: Improvement
> Components: Core
> Reporter: Theodore Vasiloudis
> Assignee: Chengxiang Li
>
> In order to be able to implement Stochastic Gradient Descent and a number of
> other machine learning algorithms we need to have a way to take a random
> sample from a Dataset.
> We need to be able to sample with or without replacement from the Dataset,
> choose the relative size of the sample, and set a seed for reproducibility.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
