alamb commented on issue #16707: URL: https://github.com/apache/datafusion/issues/16707#issuecomment-3050296207
I double checked that the API used in the python script and it looks like depending on the exact type of the Python object, it seems it always gets the data in memory as a MemTable https://github.com/apache/datafusion-python/blob/2e1b71369eefc97c22b82be84bbabb414f748fb9/src/context.rs#L542-L572 Which then calls https://github.com/apache/datafusion-python/blob/2e1b71369eefc97c22b82be84bbabb414f748fb9/src/context.rs#L473 I am working on a writeup -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
