etseidl commented on PR #11159: URL: https://github.com/apache/arrow-rs/pull/11159#issuecomment-5784624056
One last interesting tidbit. I tried running the benchmark with the `Vec<Vec<Option<T>>>` version of the page index and was getting very strange behavior. The time to parse the footer went up for cases where the page index was in use. Turns out that creating and dropping all those nested vecs was trashing memory. Another reason to go with the `Grid`. Thanks for suggesting it @adriangb 😄 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
