Edmon Begoli created KAFKA-6152:
-----------------------------------
Summary: Support ExpanderSketch algorithm for space and time
efficient stream processing.
Key: KAFKA-6152
URL: https://issues.apache.org/jira/browse/KAFKA-6152
Project: Kafka
Issue Type: New Feature
Components: core
Reporter: Edmon Begoli
Attachments: larsen2016.pdf
Support a new ExpanderSketch algorithm (Larsen et al., 2016) based on
cluster-preserving clustering and considered the best contemporary streaming
algorithm (Quanta, 2017).
It achieves optimal O(ε^{p}log_n) space, O(log_n) update time, and fast
O(ε^{p}poly(log_n)) query time, and whp correctness
Larsen, K. G., Nelson, J., Nguyên, H. L., & Thorup, M. (2016, October). Heavy
hitters via cluster-preserving clustering. In Foundations of Computer Science
(FOCS), 2016 IEEE 57th Annual Symposium on (pp. 61-70). IEEE.
https://arxiv.org/abs/1604.01357
Hartnett, K., (2017, October). Best-Ever Algorithm Found for Huge Streams of
Data. Quanta Magazine, October 2017, online at:
https://www.quantamagazine.org/best-ever-algorithm-found-for-huge-streams-of-data-20171024/
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)