Hi dev@,

Last week we had a twofer: e2e tool and integration test validating the
contract of column indexes/indices (if all values are between min and max
and if set whether the boundary order is correct). There are some takeaways
and corrections to be made to the former (like the max->min typo) - thanks
for the feedback on that!

The next installment is also an integration test that tests the filtering
logic on files including simple and special cases (user defined function,
complex filtering, no filtering, etc.).

https://github.com/apache/parquet-mr/blob/e7db9e20f52c925a207ea62d6dda6dc4e870294e/parquet-hadoop/src/test/java/org/apache/parquet/hadoop/TestColumnIndexFiltering.java

Please let me know if you have any questions/comments.

Best,
Anna

Reply via email to