[ 
https://issues.apache.org/jira/browse/FLINK-1901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635102#comment-14635102
 ] 

Sachin Goel commented on FLINK-1901:
------------------------------------

Yes. I do agree. I'll see if what I've written can work with iterations 
out-of-box. Fingers crossed.
And I meant, in random sampling, every point is sampled with probability 1/N. I 
was wondering about cases when this probability is not constant across all 
elements, instead is a function of the element itself. I guess that's too 
specific to be a feature in itself.

> Create sample operator for Dataset
> ----------------------------------
>
>                 Key: FLINK-1901
>                 URL: https://issues.apache.org/jira/browse/FLINK-1901
>             Project: Flink
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Theodore Vasiloudis
>            Assignee: Chengxiang Li
>
> In order to be able to implement Stochastic Gradient Descent and a number of 
> other machine learning algorithms we need to have a way to take a random 
> sample from a Dataset.
> We need to be able to sample with or without replacement from the Dataset, 
> choose the relative size of the sample, and set a seed for reproducibility.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to