alamb commented on PR #10880: URL: https://github.com/apache/arrow-rs/pull/10880#issuecomment-5443041691
It makes sense to me Claude mentioned this still happens once per row group So one potential follow on would be > - Hoist across row groups. Column writers are recreated per row group, so a wide schema × many row groups still does one search per column per row group. Caching Vec<ResolvedColumnProperties> per leaf in SerializedFileWriter/ArrowWriter would make it once per file. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
