tustvold commented on issue #14854: URL: https://github.com/apache/datafusion/issues/14854#issuecomment-2695547746
> which components of datafusion require object store Most components of DataFusion that perform IO will do so via ObjectStore. The only notable exception I am aware of is ParquetExec, which can be constructed with a custom AsyncFileReader that dispatches IO to an abstraction of its choosing. > Even spilling works (I assume it is defaulting to some kind of local object store? Or does spilling not use object store?) By default DF does register a LocalFilesystem ObjectStore, although I am not familiar with the spilling logic to know if it makes use of this -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
