mzabaluev opened a new pull request, #9419:
URL: https://github.com/apache/arrow-rs/pull/9419
# Rationale for this change
The inner loop in `Projector::project_record` gives the optimizer somewhat
complicated dynamic data to branch through.
The sparse arrays in `Projector` are redundantly coded: `None` in the index
positions of `writer_to_reader` must match `Some` in `skip_decoders` and vice
versa.
# What changes are included in this PR?
Refactor record projection state with a single array of directive-like enums
corresponding to each writer schema field.
# Are these changes tested?
Added a benchmark for record projection (the benchmark code is partially
shared with #9397).
Somewhat counterintuitively for me, it does not show improvement on a more
complex case with a mix of projected fields, but does improve the simpler
one-field projection cases.
Passes the existing tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
