kerwin-zk commented on PR #8382: URL: https://github.com/apache/paimon/pull/8382#issuecomment-4842161202
Thanks for the suggestion. I have updated this PR from a metadata-only step to a complete core implementation: - statistics sidecar file writer / reader for multiple typed blob payloads - JSON lifecycle with backward compatibility - sidecar read / write APIs and sidecar cleanup on statistics deletion - orphan-file cleanup protection for sidecars referenced by live statistics files - mergeable NDV blob support based on Apache DataSketches Theta sketch I kept Spark ANALYZE integration out of this PR for now so that we can first review the core format and lifecycle behavior. If this direction looks reasonable, Spark can be wired to produce / consume the NDV sidecar in a follow-up PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
