[GitHub] [incubator-doris] zbtzbtzbt opened a new issue, #9100: [Enhancement] Hyperloglog support user selectable Error rate

[GitBox]

zbtzbtzbt opened a new issue, #9100:
URL: https://github.com/apache/incubator-doris/issues/9100

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and 
found no similar issues.
   
   
   ### Description
   
   Currently, Doris Hyperloglog Error rate is **2.44%**, more specifically, in 
99% cases, HLL error rate is under 2.44%.
   In Meituan, some users say: "**we want a more accurate HLL!** we cannot 
tolerant such a high error rate"
   Therefore, we intend to support a selectable error rate Hyperloglog like 
kylin.
   
   <img width="864" alt="hyperloglog1" 
src="https://user-images.githubusercontent.com/35688959/163920227-7b50ea19-fdb5-4643-97ef-169826cafd36.png";>
   <img width="551" alt="hyperloglog2" 
src="https://user-images.githubusercontent.com/35688959/163923186-c87b4e26-fe55-4a69-b59a-3ac359ffaf82.png";>
   
   
   
   ### Solution
   
   reference：
   https://cn.kyligence.io/blog/count-distinct-hyperloglog/
   http://algo.inria.fr/flajolet/Publications/FlFuGaMe07.pdf
   
https://static.googleusercontent.com/media/research.google.com/zh-CN//pubs/archive/40671.pdf
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org