XiangpengHao commented on issue #14816: URL: https://github.com/apache/datafusion/issues/14816#issuecomment-2819130637
> Is there any way in datafusion that we get different iterators for each of the file partitions we do when we create the physical plan? Not sure if this is what you want, but probably relevant: https://github.com/apache/datafusion/blob/main/datafusion/datasource-parquet/src/opener.rs#L277 cc @mbutrovich who might also be interested in this discussion -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org