[
https://issues.apache.org/jira/browse/BEAM-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231673#comment-17231673
]
Monica Song commented on BEAM-10855:
------------------------------------
I will make a PR soon but in the meantime the papers to reference are:
- For the general KMV algorithm (with modifications):
http://cs.haifa.ac.il/~ilan/randomized_algorithms/bar-yosef_jayram.pdf
- For the log correction:
https://www.win.tue.nl/~opapapetrou/papers/Bloomfilters-DAPD.pdf
> Add reference for appoximate unique algorithms in java and python SDK
> ---------------------------------------------------------------------
>
> Key: BEAM-10855
> URL: https://issues.apache.org/jira/browse/BEAM-10855
> Project: Beam
> Issue Type: Improvement
> Components: sdk-java-core, sdk-py-core
> Reporter: Monica Song
> Assignee: Monica Song
> Priority: P3
> Labels: Clarified, doc_cleanup, stale-assigned
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> The java [1] and python [2] classes for ApproximateUnique should reference a
> paper or some other form of online documentation as a source for their
> algorithm.
> [1]
> [https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/ApproximateUnique.java]
> [2]
> [https://github.com/apache/beam/blob/master/sdks/python/apache_beam/transforms/stats.py]
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
