This is an automated email from the ASF dual-hosted git repository.
tisonkun pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/datasketches-rust.git
The following commit(s) were added to refs/heads/main by this push:
new 2d40717 docs(cpc): state finite 128-column shift identity in table
comments (#380)
2d40717 is described below
commit 2d4071717f9f9228b170de5e59041e1b95164e35
Author: tison <[email protected]>
AuthorDate: Mon Nov 16 17:41:51 2026 +0800
docs(cpc): state finite 128-column shift identity in table comments (#380)
---
datasketches/src/cpc/compression_data.rs | 22 ++++++++++++++--------
1 file changed, 14 insertions(+), 8 deletions(-)
diff --git a/datasketches/src/cpc/compression_data.rs
b/datasketches/src/cpc/compression_data.rs
index 38342f0..911e49f 100644
--- a/datasketches/src/cpc/compression_data.rs
+++ b/datasketches/src/cpc/compression_data.rs
@@ -12014,14 +12014,20 @@ mod tests {
/// within `1.1e-14`, whereas the binomial model at `K = 2^32` misses them
by `6.1e-12`. That
/// residual halves with every unit added to the base (`3.1e-12` at `7.0 +
phase`, `1.5e-12` at
/// `8.0 + phase`), which is the `2^-col / K` signature of the finite-`K`
correction at the
- /// window columns, not an effect of the matrix edge. Although `lambda` is
solved over all 128
- /// columns, the Poisson identity `f(2 * lambda) = f(lambda) + 1 -
exp(-lambda)` for
- /// `f(lambda) = E[C] / K` means that raising the base by one doubles
`lambda` and shifts the
- /// window by one column up to a relative `ln(2) * exp(-lambda)`, about
`2e-23` at `C / K = 6 +
- /// 1/32` (`lambda ≈ 51.9`). Consequently `K = 2^32` with any base from
`14` to `84` also
- /// matches both the entropy and average-length headers of all 16
steady-state tables within
- /// `HEADER_STATS_TOLERANCE`; the Poisson limit at base `6` is preferred
because a single
- /// operating point then explains both the byte tables and the
permutations, which are
+ /// window columns, not an effect of the matrix edge.
+ /// Although `lambda` is solved over all 128 columns (`f_128(lambda) =
E[C] / K`), the
+ /// finite-column shift identity
+ ///
+ /// f_128(2 * lambda) = f_128(lambda) + (1 - exp(-lambda)) - (1 -
exp(-lambda / 2^128))
+ ///
+ /// means that raising the base by one doubles `lambda` and shifts the
window by one column up
+ /// to both boundary terms. At `C / K = 6 + 1/32` (`lambda ≈ 51.9`), the
left-edge term
+ /// `exp(-lambda)` is about `2.8e-23` and the right-edge term `1 -
exp(-lambda / 2^128)` is
+ /// about `1.53e-37`, both negligible compared to `6.1e-12`; by base `84`
(`C / K = 84 + 1/32`),
+ /// the right-edge term grows to about `4.61e-14`. Consequently `K = 2^32`
with any base from
+ /// `14` to `84` also matches both the entropy and average-length headers
of all 16 steady-state
+ /// tables within `HEADER_STATS_TOLERANCE`; the Poisson limit at base `6`
is preferred because
+ /// a single operating point then explains both the byte tables and the
permutations, which are
/// insensitive to `K`.
const STEADY_STATE_MODEL: Occupancy = Occupancy::Poisson;
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]