HippoBaro commented on code in PR #9848:
URL: https://github.com/apache/arrow-rs/pull/9848#discussion_r3368607198
##########
parquet/src/arrow/array_reader/builder.rs:
##########
@@ -113,9 +113,7 @@ impl<'a> ArrayReaderBuilder<'a> {
}
}
- /// Set the batch size used to pre-allocate internal buffers.
- ///
- /// This avoids reallocations when reading the first batch of data.
Review Comment:
With selective padding, leaf value buffers are now sized from the decoded
level counts rather than the batch size. I've restored a doc that describes the
new semantics as a hint: full-padding readers still pre-allocate from it, and
selectively-padded readers size from the values actually decoded.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
