leerho commented on PR #554: URL: https://github.com/apache/datasketches-java/pull/554#issuecomment-2093651735
The one concept that I want you to take away from our discussion about KLL sketch size is this: When _**n**_ gets large enough, the internal sketch structure reaches a stable form. This is where you see the curve slope dramatically flatten. From that point on, as _**n**_ continues to grow the sketch size will increase by adding only 8 items to its retained items for every factor of 2 growth in _**n**_! For example, looking at the last graph, the stable form is reached at about 100K 64B items. So if n grows from 100k to 200k items the sketch size increases by about 8 items. -- Or, growing from 1T items to 2T items the sketch increases in size by about 8 items! Thus, planning for a memory space for the sketch to grow in should be straight-forward. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
