theirix commented on issue #13268: URL: https://github.com/apache/datafusion/issues/13268#issuecomment-2496157453
This issue is fixed by avoiding pushing down volatile filters, so the sampling is achieved by a manual `random() < 0.1` expression. @findebi, regarding the sampling support, it would be great to have it supported for select statements. [DuckDB](https://duckdb.org/docs/sql/samples.html#table-samples) and [PostgreSQL](https://www.postgresql.org/docs/current/sql-select.html#SQL-FROM) support it in the form of a `SELECT * FROM tbl TABLESAMPLE SYSTEM (10 PERCENT)`, and [Clickhouse](https://clickhouse.com/docs/en/sql-reference/statements/select/sample) with `SELECT * FROM tbl SAMPLE 0.1`. DataFusion could support it by using sampling directly in the parquet reader. I've only seen a single mention of this functionality in #11554. What do you think? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
