tisonkun opened a new issue, #1268: URL: https://github.com/apache/paimon-rust/issues/1268
Paimon currently depends on DataSketches 0.2 and maintains HLL byte-layout workarounds plus a custom Theta parser, union, and serializer in `crates/paimon/src/table/aggregator/sketch.rs`. DataSketches 0.6.0 can decode the HLL formats covered by Paimon's Java fixtures and provides compact Theta deserialization, union, and serialization. Upgrade the direct dependency with the `hll` and `theta` features, remove the obsolete HLL workarounds, and delegate Theta set operations to the library. Java mutable QuickSelect Theta images still require a compatibility adapter because the Rust library only deserializes compact Theta images. Preserve that input support and verify exact and estimation-mode unions against Java-generated fixtures, including repeated merges and malformed inputs. The existing HLL regression covering three table commits should read the result without rewriting its header. The full-text index's Tantivy dependency still requires DataSketches 0.2; upgrading that separate dependency chain is outside this change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
