jackylee-ch commented on PR #25694: URL: https://github.com/apache/datafusion/pull/25694#issuecomment-6217485922
Sorry, that was unclear. "Broad gate" meant one check in `StatisticsContext`, which sees what every operator and provider returns. This PR adds it: unless `column_statistics` has one entry per field, planning fails with an error naming the culprit. Too few entries can make filters, joins, `GROUP BY`, `count`, `min`/`max` panic, too many can give `min`/`max` another column's values; such plans now fail, plain scans too. File scans also reject extras but still pad short statistics (virtual columns, delta-rs). `count`/`min`/`max` use `.get(idx)?`: `value_from_stats` cannot return an error. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
