alamb commented on PR #18971: URL: https://github.com/apache/datafusion/pull/18971#issuecomment-3597363259
> My concern is that if there are _many_ files then the pre-warming of the cache may slow down the main operation. I am not sure how many is too many though. > > But I guess you could leave it as is for now and optimize it only after there is an evidence that it really causes slow downs for someone. Thanks @martin-g -- I do agree that is a concern. However, I think the idea is that any subsequent query is going to collect the statistics anyways, so this PR simply moves which statement triggers the collection -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
