wgtmac commented on PR #14803: URL: https://github.com/apache/arrow/pull/14803#issuecomment-1339103465
> I just realized: in this API, `encoded_min_values` and `min_values` use different conventions? (one is dense, the other is sparse). Yes, the encoded values are directly populated from the thrift ColumnIndex object, with null pages filled by an empty string. The decoded values have excluded null pages so it is much easier to do binary search if the boundary order is ASC or DESC without considering null pages. This is especially effective to implement predicate push down. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
