2010YOUY01 commented on PR #15730: URL: https://github.com/apache/datafusion/pull/15730#issuecomment-2814427116
I'm wondering what's the semantics of `fetch` in `DataSourceExec` now, I think it makes sense to be either - exact fetch: if datasource's output size is `>= fetch`, exact `fetch` number of rows will be returned - best-effort fetch (or fetch hint): data source is okay to return more rows than fetch The best effort one seems a better API interface to me, because it can simplify implementation for some custom scanner: for example only early terminate at batch level instead of row level. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
