DarkWanderer opened a new pull request, #9011: URL: https://github.com/apache/arrow-rs/pull/9011
# Which issue does this PR close? <!-- We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an issue to this PR using the GitHub syntax. --> - Closes #9010 # Rationale for this change Some databases, one example being Grafana Tempo, utilize column dictionaries as makeshift column indexes, to improve filtering speed ad-hoc. Checking if low-cardinality value is present in dictionary allows to effectively pre-filter data by skipping whole row group. This PR adds this capability # What changes are included in this PR? Add public `get_row_group_column_dictionary` function to ParquetRecordBatchStreamBuilder # Are these changes tested? Tests have been added # Are there any user-facing changes? Public API extension for `ParquetRecordBatchStreamBuilder` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
