aditanase commented on issue #898: URL: https://github.com/apache/datafusion-python/issues/898#issuecomment-2829701511
What would be the expectation in that case? A MemTable resides on your heap, while CSV is potentially on disk. Would you expect that the data would be serialized as part of the plan? How would the execution work on the other side? I've seen some of this done in the substrait project: https://substrait.io/relations/logical_relations/#virtual-table I would imagine that one could write an extension codec that serializes the arrow table as well, but it would be extra work, not sure of the use case though. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
