[
https://issues.apache.org/jira/browse/CRUNCH-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13598127#comment-13598127
]
Christian Tzolov commented on CRUNCH-178:
-----------------------------------------
Just out of curiosity, the patch seems to implement the A-ES algorithm, useful
for WRS-N-W and WRS-R sampling (according to the article). Is the WRS-N-P case
less common? (just curious)
Also would the 'jumps' optimisation be worth implementing in the context of
Hadoop M/R?
> Add library functions for performing distributed reservoir sampling
> -------------------------------------------------------------------
>
> Key: CRUNCH-178
> URL: https://issues.apache.org/jira/browse/CRUNCH-178
> Project: Crunch
> Issue Type: Improvement
> Components: MapReduce Patterns
> Reporter: Josh Wills
> Attachments: CRUNCH-178.patch
>
>
> For a project I've been working on, I wrote up some Crunch functions for
> performing reservoir sampling and weighted reservoir sampling that I think
> would be useful enough to put in lib.* Here's the paper that I used as a
> reference for the implementations I wrote:
> http://arxiv.org/pdf/1012.0256.pdf
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira