[ 
https://issues.apache.org/jira/browse/CRUNCH-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13598127#comment-13598127
 ] 

Christian Tzolov commented on CRUNCH-178:
-----------------------------------------

Just out of curiosity, the patch seems to implement the A-ES algorithm, useful 
for WRS-N-W and WRS-R sampling (according to the article). Is the WRS-N-P case 
less common? (just curious) 
Also would the 'jumps' optimisation be worth implementing in the context of 
Hadoop M/R? 

                
> Add library functions for performing distributed reservoir sampling
> -------------------------------------------------------------------
>
>                 Key: CRUNCH-178
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-178
>             Project: Crunch
>          Issue Type: Improvement
>          Components: MapReduce Patterns
>            Reporter: Josh Wills
>         Attachments: CRUNCH-178.patch
>
>
> For a project I've been working on, I wrote up some Crunch functions for 
> performing reservoir sampling and weighted reservoir sampling that I think 
> would be useful enough to put in lib.* Here's the paper that I used as a 
> reference for the implementations I wrote:
> http://arxiv.org/pdf/1012.0256.pdf

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to