JingsongLi commented on PR #633: URL: https://github.com/apache/paimon-rust/pull/633#issuecomment-5129168868
The budget passing process can be simplified as follows: - Add an optional `with_parquet_read_budget` parameter to `PaimonReadBuilder`, which DataFusion injects before `new_read()`. - Avoid first creating and then discarding a default budget for each partition, only to override it later via the exposed `TableRead::with_parquet_read_budget` method. - If shared resources such as caches and memory reservations are added later, they can be centralized into a single `ReadContext` to reduce the current field passing across a dozen or so readers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
